-- Logs begin at Tue 2022-05-17 16:14:38 UTC, end at Tue 2022-05-17 17:27:12 UTC. -- May 17 16:55:42.082011 dv-cinder-842149-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 16:55:42 2022] *** May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: nodename: dv-cinder-842149-1-iscsi May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: machine: x86_64 May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: clock source: unix May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: pcre jit disabled May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: detected number of CPU cores: 4 May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: current working directory: / May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: detected binary path: /usr/bin/uwsgi-core May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: your processes number limit is 47680 May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: your memory page size is 4096 bytes May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: detected max file descriptor number: 2048 May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: lock engine: pthread robust mutexes May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: thunder lock: enabled May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 17 16:55:42.093592 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 16:55:42.137844 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: Python main interpreter initialized at 0x5623ce86c9c0 May 17 16:55:42.137844 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: python threads support enabled May 17 16:55:42.137844 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: your server socket listen backlog is limited to 100 connections May 17 16:55:42.137844 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: your mercy for graceful operations on workers is 90 seconds May 17 16:55:42.138218 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: mapped 403077 bytes (393 KB) for 2 cores May 17 16:55:42.138316 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: *** Operational MODE: preforking *** May 17 16:55:42.138603 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: *** uWSGI is running in multiple interpreter mode *** May 17 16:55:42.138603 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: spawned uWSGI master process (pid: 80054) May 17 16:55:42.138803 dv-cinder-842149-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 17 16:55:42.141605 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: spawned uWSGI worker 1 (pid: 80069, cores: 1) May 17 16:55:42.142008 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: spawned uWSGI worker 2 (pid: 80070, cores: 1) May 17 16:55:42.142202 dv-cinder-842149-1-iscsi devstack@keystone.service[80054]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 16:55:47.922467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 16:55:47.922467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: from cryptography.utils import int_from_bytes May 17 16:55:47.923452 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 16:55:47.923452 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: from cryptography.utils import int_from_bytes May 17 16:55:47.923957 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 16:55:47.923957 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: from cryptography.utils import int_from_bytes May 17 16:55:47.924803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 16:55:47.924803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: from cryptography.utils import int_from_bytes May 17 16:55:47.973381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 16:55:47.973634 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 16:55:47.973781 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] command line args: [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 16:55:47.973987 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 16:55:47.974087 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 16:55:47.974224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 16:55:47.974313 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ================================================================================ {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 16:55:47.974380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] command line args: [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 16:55:47.974438 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] admin_token = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.974632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 16:55:47.974728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] config_dir = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.974795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ================================================================================ {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 16:55:47.974859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.975020 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] config_source = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.975100 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] admin_token = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.975166 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] debug = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.975314 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] config_dir = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.975399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.977656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.977656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] config_source = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.977789 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.977856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] debug = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.977921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.977979 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978249 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978310 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] list_limit = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] log_config_append = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978616 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] log_dir = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] log_file = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_config_append = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978861 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.978925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_dir = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.979030 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.979087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_file = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.979143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.979205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.979268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.979333 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.979395 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.979395 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.979499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.979565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.980170 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.980170 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.980567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.980772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.981010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.981175 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.981374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.981568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.981768 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.981973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.982202 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.982375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.982570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.982798 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.982965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.983163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.983393 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.983607 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.983607 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.983962 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.984155 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.984383 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] publish_errors = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.984383 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.984383 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.984917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.985089 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.985300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] publish_errors = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.985474 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.985615 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.985749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.985923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.985923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.986231 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] standard_threads = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.986366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.986495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.986673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.986814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.986814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.987057 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] standard_threads = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.987191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] use_journal = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.987321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.987457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] use_json = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.987586 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.987755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] use_stderr = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.987885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.988048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] use_syslog = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.988218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] use_journal = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.988218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] use_json = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.988472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.988617 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] use_stderr = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.988746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.988881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] use_syslog = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.989018 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.989147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 16:55:47.989275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.989402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.989530 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.989658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.989798 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.989928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.990056 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.990184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.990318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.990457 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.990671 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.990807 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.990937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.991071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.991200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.991328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.991465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.991633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.991782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.991913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.992042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.992170 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.992317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.992456 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.992585 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.992724 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.992860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.992991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.993128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.993264 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.993399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.993535 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.993665 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.993793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.993934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.994082 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.994213 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.994348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.994477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.994605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.994742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.994877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.995006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.995135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.995264 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.995399 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.995536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.995727 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.995858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.995997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.996127 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.996256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.996396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.996532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.996667 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.996797 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.996924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.997127 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.997260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.997388 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.997516 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.997644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.997788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.997926 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.998055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.998183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.998318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.998453 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.998582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.999289 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.999519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.999696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.999826 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:47.999826 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.000081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.000218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.000360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.000488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.000622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.000755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.000908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.001141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.001291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.001430 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.001560 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.001695 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.001824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.001961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.002096 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.003289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.003500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.003743 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.003913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.004148 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.004314 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.004509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.004701 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.004895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.005087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.005314 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.005487 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.005747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.005950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.006126 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.006320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.006551 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.006754 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.006921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.007147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.007314 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.007506 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.007746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.007912 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.008105 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.008297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.008461 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.008641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.008820 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.008968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.009099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.009268 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.009411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.009542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.009672 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.009811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.009811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.010093 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.010231 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.010361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.010496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.010650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.010797 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.010928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.011064 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.011194 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.011353 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.011487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.011665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.011804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.011936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.012065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.012201 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.012331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.012482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.012613 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.012742 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.012873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.013003 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.013140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.013270 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.013399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.013528 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.013657 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.013786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.014043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.014043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.014882 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.015041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.015233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.015372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.015511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.015660 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.015796 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.015925 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.016056 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.016186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.016326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.016457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.016587 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.016716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.016856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.016987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.017126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.017256 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.017386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.017515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.017644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.017774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.017912 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.018051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.018195 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.018326 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.018463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.018635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.019104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.019248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.019389 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.019521 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.019682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.019819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.019950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.020079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.020219 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.020350 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.020481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.020610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.020750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.020886 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.021036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.021167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.021297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.021427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.021557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.021692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] auth.external = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.021841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.021972 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.022102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.022231 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.022364 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.022501 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.022632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.external = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.022805 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] auth.password = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.022949 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.023082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] auth.token = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.023211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.023343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.023474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.023744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.023882 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.password = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.024020 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.024158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.token = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.024290 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.024421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.024560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.024692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.024833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.024965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.025096 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.025226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.025365 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] credential.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.025498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.025628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.025765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.025896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.026027 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.026167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.026299 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.026429 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.026570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.026701 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.026832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.026972 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.027104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.027235 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.027364 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.027494 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.027673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.027845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.027979 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.028109 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.028239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.028369 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.028369 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.028636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.028767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.028898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.029028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.029165 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.029296 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.029435 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.029573 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.029705 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.029843 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.030013 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.030146 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.030288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.030431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.030571 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.030710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.030844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.030975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.031180 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.031314 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.031445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.031576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.031757 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.031889 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.032032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.032164 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.032306 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.032446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.032578 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.032709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.032853 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.032991 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.033122 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.033252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.033383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.033519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.033660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.033793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.033925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.034065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.034196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.034325 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.034464 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.034595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.034725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.034857 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.034988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.035127 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.035259 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.035390 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.035520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.035669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.035805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.035963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.036102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.036233 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.036233 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.036486 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.036624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.036764 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.036764 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.037012 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.037142 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.037272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.037403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.037542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.037684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.037816 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.037946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.038077 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.038206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.038349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.038480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.038611 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.038742 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.038873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.038873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.039128 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.039260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.039390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.039537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.039715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.039857 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.039998 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.040131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.040262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.040399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.040529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.040659 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.040808 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.040941 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.041071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.041202 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.041333 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.041482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.041623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.041755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.041886 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.042016 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.042255 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.042421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.042565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.042698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.042828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.042958 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.043087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.043217 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.043367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.043499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.043647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.043783 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.043913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.044043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.044190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.044324 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.044455 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.044586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.044717 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.044847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.044986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.045117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.045262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.045393 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.046057 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.046241 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.046389 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.046555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.046686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.046817 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.046817 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.047063 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.047202 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.047341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.047474 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.047650 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.047799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.047931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.048074 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.048207 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.048337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.048467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.048598 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.048729 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.048868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.048999 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.049129 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.049259 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.049390 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.049538 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.049672 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.049803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.049934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.050065 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.050194 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.050333 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.050465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.050595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.050727 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.050857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.050987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.051126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.051268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.051416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.051548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.051703 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.051835 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.051977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.052109 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.052246 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.052378 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.052508 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.052638 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.052778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.052910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.053041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.053182 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.053313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.053443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.053582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.053713 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.053844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.053974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.054104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.054234 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.054373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.054505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.054635 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.054861 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.055033 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.055178 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.055317 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.055449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.055579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.055758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.055890 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.056020 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.056163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.056295 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.056426 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.056556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.056686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.056816 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.056956 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.057097 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.057228 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.057359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.057489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.057619 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.057823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.057957 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.058089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.058219 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.058349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.058480 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.058618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.058749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.058880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.059022 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.059152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.059283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.059422 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.059554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.059717 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.059848 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.059978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.060109 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] role.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.060251 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.060383 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] role.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.060513 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.060644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.060788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.060919 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.061058 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.061779 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.061919 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.062051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.062183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.062313 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.062454 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] role.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.062591 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.062724 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] role.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.062854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.062984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.063113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.063263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.063396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.063526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.063703 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.063836 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.063979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.064112 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.064243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.064635 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.064770 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.064903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.065042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.065175 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.065317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.065449 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.065580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.065710 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.065850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.065987 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.066118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.066118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.066365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.066496 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.066635 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.066767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.066898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.067038 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.067169 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.067299 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.067440 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.067571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.067726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.067859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.067990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.068121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.068264 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.068397 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.068529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.068660 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.068801 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.068932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.069072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.069204 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.069204 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.069449 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.069583 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.069712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.069852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.069983 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.070114 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.070244 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.070374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.070513 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.070660 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.070791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.070921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.071051 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.071182 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.071321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.071453 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.071582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.071743 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.071877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.072017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.072158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.072290 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.072430 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.072430 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.072677 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.072807 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.072946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.072946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.073194 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.073325 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.073456 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.073586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.073726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.073858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.073988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.074118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.074258 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.074400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.074540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.074540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.074794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.074925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.075055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.connection = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.075194 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.075334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.075467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.075627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.075766 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.075898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.076028 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.076169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.076300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.076442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.076575 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.076706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.076869 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.077001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.077131 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.connection = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.077276 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.077425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.077566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.077566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.077814 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.077946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.078088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.078228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.078360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.078491 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.078622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.078752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.078883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.079022 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.079154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.079285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.079416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.079548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.079753 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.079974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.080109 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.080240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 16:55:48.080373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.080373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.080373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.080373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.080373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.080373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.080373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.080373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 16:55:48.080373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 16:55:48.091689 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.091689 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.091689 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.092887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.092887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.092887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.101567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.101982 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.132833 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.133191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.133291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.133428 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.187525 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.188663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.239757 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.239954 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.240042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.240270 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.306848 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.307075 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.307232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.307325 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.307506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.307744 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.307833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.307967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.308203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.308514 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.308827 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.309134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.332348 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.332577 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.332663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.332802 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.333024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.333105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.333242 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.333457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.333539 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.333670 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.333914 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.334224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.334532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.334849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.345676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.346196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.360454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.360690 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.360915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.361139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.361359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.361440 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.361574 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.361789 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80070) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.361921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.362247 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.362567 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.362885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.363203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.363518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 16:55:48.379106 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.379318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 16:55:48.379676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.379850 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.379936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 16:55:48.380139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.380298 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 16:55:48.380401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.380659 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.380892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.380974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.381252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 16:55:48.381615 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.381969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.382321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.382672 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.392480 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.392755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.393025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.393308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.394758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.395139 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.395510 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.395919 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.401381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.404217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.404660 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.405519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.405811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.406274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.406561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.406824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.407095 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.407372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.407664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.407939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.408205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.409283 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.409662 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.410041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.410535 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.410922 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.411285 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.411684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.412063 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.412438 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.412815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.413186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.435311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.437634 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.437863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.441316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.443030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.443438 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.443577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.443859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.444148 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.448948 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.449300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.449647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.451451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.451799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.456392 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.456674 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.456952 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.457228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.457455 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.457602 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.457758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.457922 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.458051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.458278 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.463042 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.463405 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.463776 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.464130 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.464474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.464817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.465155 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.465491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.477408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.477684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.482185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.485525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.485878 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.486389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.486685 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.490603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.491633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.494943 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.495172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.495371 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.498935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.499363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.499675 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.499960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.500238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.500518 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.500928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.504593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.508408 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.508776 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.509129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.509488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.509834 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.510183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.519440 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.519836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.520106 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.520370 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.528193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.529568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.530434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.530650 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.530793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.531065 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.531386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.533748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.534028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.534306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.534586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.534874 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.539613 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.541407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.541751 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.544862 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.545215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.546171 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.546508 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.546873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.548768 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.549049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.549334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.549613 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.549893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.550184 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.550459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.560225 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.560500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.560776 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.561062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.561383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.561663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.561934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.568674 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.571947 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.575236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.576890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.578501 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.578788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.579084 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.580129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.583373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.586443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.586695 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.588060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.588322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.589941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.590224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.590513 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.591250 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.591540 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.591848 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.592123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.598540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.600173 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.602066 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.602359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.602640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.603359 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.603667 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.603949 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.604219 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.611405 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80070) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.611704 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.611987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.612262 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.612533 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.612821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.613095 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.613371 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.613639 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.613908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.614053 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.614191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.614340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.614475 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.614620 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.614758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.614935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80070) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.622296 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 16:55:48.622573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.622851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.623124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.623396 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.623736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.624002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.624275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.624538 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.624811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.625079 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.625353 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.625622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.625877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 16:55:48.653674 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623ce86c9c0 pid: 80070 (default app) May 17 16:55:48.657774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87368e52-bd7e-4828-a412-bf85f432d1cd None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:55:48.658065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87368e52-bd7e-4828-a412-bf85f432d1cd None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:55:48.658352 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87368e52-bd7e-4828-a412-bf85f432d1cd None None] PATH_INFO: `/v3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:55:48.664277 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Tue May 17 16:55:48 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:55:48.665041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623ce86c9c0 pid: 80069 (default app) May 17 16:55:56.646021 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82627806-4bcf-4632-b874-51c7a6cf3a96 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:55:56.646596 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82627806-4bcf-4632-b874-51c7a6cf3a96 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:55:56.646596 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82627806-4bcf-4632-b874-51c7a6cf3a96 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:55:56.647948 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:55:56.655530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b200f7-166e-414d-b79d-657c44f92cf5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:55:56.655990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b200f7-166e-414d-b79d-657c44f92cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:55:56.656185 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b200f7-166e-414d-b79d-657c44f92cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:55:56.687851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG oslo_db.sqlalchemy.engines [None req-64b200f7-166e-414d-b79d-657c44f92cf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 16:55:56.878066 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG passlib.handlers.bcrypt [None req-64b200f7-166e-414d-b79d-657c44f92cf5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80069) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 17 16:55:56.878491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG passlib.handlers.bcrypt [None req-64b200f7-166e-414d-b79d-657c44f92cf5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80069) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 17 16:55:56.933654 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-64b200f7-166e-414d-b79d-657c44f92cf5 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:55:56.935242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-64b200f7-166e-414d-b79d-657c44f92cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:55:57.069147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1/3] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:55:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 17 16:55:57.250223 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82627806-4bcf-4632-b874-51c7a6cf3a96 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:55:57.283362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG oslo_db.sqlalchemy.engines [None req-82627806-4bcf-4632-b874-51c7a6cf3a96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 16:55:57.409759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82627806-4bcf-4632-b874-51c7a6cf3a96 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:55:57.414195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc703f-99f0-4467-917f-446f2564b2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:55:57.414881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc703f-99f0-4467-917f-446f2564b2cf admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:55:57.415164 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc703f-99f0-4467-917f-446f2564b2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:55:57.415440 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc703f-99f0-4467-917f-446f2564b2cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:55:57.425197 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc703f-99f0-4467-917f-446f2564b2cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:55:57.477176 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5fbc703f-99f0-4467-917f-446f2564b2cf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 17 16:55:57.477518 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc703f-99f0-4467-917f-446f2564b2cf admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:55:57.487663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1324 bytes} [Tue May 17 16:55:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 16:55:57.493645 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b200f7-166e-414d-b79d-657c44f92cf5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:55:57.508619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b200f7-166e-414d-b79d-657c44f92cf5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:55:57.512906 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a27e3-ba56-47ce-ad9b-636b3aa8af1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:55:57.514181 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a27e3-ba56-47ce-ad9b-636b3aa8af1d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:55:57.514568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a27e3-ba56-47ce-ad9b-636b3aa8af1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:55:57.514838 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a27e3-ba56-47ce-ad9b-636b3aa8af1d admin admin] PATH_INFO: `/v3/projects/3a3ee3f323ac4b12815e2057e52b4ed6` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:55:57.516372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a27e3-ba56-47ce-ad9b-636b3aa8af1d admin admin] RBAC: Authorizing `identity:get_project(project_id=3a3ee3f323ac4b12815e2057e52b4ed6)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:55:57.567322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a30a27e3-ba56-47ce-ad9b-636b3aa8af1d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 17 16:55:57.567684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a27e3-ba56-47ce-ad9b-636b3aa8af1d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:55:57.572174 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 2/5] 10.222.0.48 () {56 vars in 1207 bytes} [Tue May 17 16:55:57 2022] GET /identity/v3/projects/3a3ee3f323ac4b12815e2057e52b4ed6 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:55:59.777538 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdfc40-aa69-4634-b3e1-ca15b69de3c9 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:55:59.778090 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdfc40-aa69-4634-b3e1-ca15b69de3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:55:59.778090 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdfc40-aa69-4634-b3e1-ca15b69de3c9 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:55:59.782292 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 4/6] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:55:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:55:59.787640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace84ab3-9867-4b8e-95ad-29b6801fa625 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:55:59.788058 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace84ab3-9867-4b8e-95ad-29b6801fa625 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:55:59.788199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace84ab3-9867-4b8e-95ad-29b6801fa625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:55:59.807642 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ace84ab3-9867-4b8e-95ad-29b6801fa625 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:55:59.809134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ace84ab3-9867-4b8e-95ad-29b6801fa625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:55:59.817634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 3/7] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:55:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 17 16:55:59.840288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdfc40-aa69-4634-b3e1-ca15b69de3c9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:55:59.851917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdfc40-aa69-4634-b3e1-ca15b69de3c9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:55:59.856043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c22e61-ac72-4563-a253-3eada2f2d79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:55:59.856660 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c22e61-ac72-4563-a253-3eada2f2d79b admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:55:59.856943 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c22e61-ac72-4563-a253-3eada2f2d79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:55:59.857216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c22e61-ac72-4563-a253-3eada2f2d79b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:55:59.864774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c22e61-ac72-4563-a253-3eada2f2d79b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:55:59.866529 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c22e61-ac72-4563-a253-3eada2f2d79b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:55:59.875618 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1324 bytes} [Tue May 17 16:55:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 16:55:59.880696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace84ab3-9867-4b8e-95ad-29b6801fa625 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:55:59.890071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace84ab3-9867-4b8e-95ad-29b6801fa625 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:55:59.894403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8525ba-955a-4aa8-a351-8ed3c3fc2f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:55:59.895258 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8525ba-955a-4aa8-a351-8ed3c3fc2f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:55:59.895542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8525ba-955a-4aa8-a351-8ed3c3fc2f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:55:59.895849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8525ba-955a-4aa8-a351-8ed3c3fc2f93 admin admin] PATH_INFO: `/v3/users/f95fdce949f547f29f3329fa96fe74ac` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:55:59.897251 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8525ba-955a-4aa8-a351-8ed3c3fc2f93 admin admin] RBAC: Authorizing `identity:get_user(user_id=f95fdce949f547f29f3329fa96fe74ac)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:55:59.899071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8525ba-955a-4aa8-a351-8ed3c3fc2f93 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:55:59.900654 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 4/9] 10.222.0.48 () {56 vars in 1198 bytes} [Tue May 17 16:55:59 2022] GET /identity/v3/users/f95fdce949f547f29f3329fa96fe74ac => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:02.161118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3d359-f037-4444-b5b8-84919da2a69c None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:02.161622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3d359-f037-4444-b5b8-84919da2a69c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:02.161704 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3d359-f037-4444-b5b8-84919da2a69c None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:02.163001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:56:02.168259 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8911cc-b5a9-45f6-a1ad-ec7654bda74d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:02.168677 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8911cc-b5a9-45f6-a1ad-ec7654bda74d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:02.168816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8911cc-b5a9-45f6-a1ad-ec7654bda74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:02.203487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dff9a-2c3a-40bd-9d59-1cd206924b6e None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:02.203796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dff9a-2c3a-40bd-9d59-1cd206924b6e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:02.204071 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dff9a-2c3a-40bd-9d59-1cd206924b6e None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:02.205446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 7/11] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:02.213908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80da4c-71c4-40e5-b4c7-8809c425639d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:02.214192 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80da4c-71c4-40e5-b4c7-8809c425639d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:02.214466 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80da4c-71c4-40e5-b4c7-8809c425639d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:02.258008 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG passlib.handlers.bcrypt [None req-ee80da4c-71c4-40e5-b4c7-8809c425639d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80070) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 17 16:56:02.258443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG passlib.handlers.bcrypt [None req-ee80da4c-71c4-40e5-b4c7-8809c425639d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80070) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 17 16:56:02.296087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8f8911cc-b5a9-45f6-a1ad-ec7654bda74d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:02.297282 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8f8911cc-b5a9-45f6-a1ad-ec7654bda74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:02.305619 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ee80da4c-71c4-40e5-b4c7-8809c425639d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:02.307165 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ee80da4c-71c4-40e5-b4c7-8809c425639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:02.375788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 5/12] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:02.398912 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8911cc-b5a9-45f6-a1ad-ec7654bda74d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:02.409936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 8/13] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:02.432089 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80da4c-71c4-40e5-b4c7-8809c425639d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:02.494519 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8911cc-b5a9-45f6-a1ad-ec7654bda74d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:02.526602 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e4885-a37c-4644-bd79-165ec38b1afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:02.526795 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80da4c-71c4-40e5-b4c7-8809c425639d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:02.527389 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e4885-a37c-4644-bd79-165ec38b1afe None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:02.527698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e4885-a37c-4644-bd79-165ec38b1afe None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:02.527976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e4885-a37c-4644-bd79-165ec38b1afe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:02.538824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e4885-a37c-4644-bd79-165ec38b1afe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-833e4885-a37c-4644-bd79-165ec38b1afe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:02.550379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:02.551369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:02.552210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:02.552210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:02.552210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:02.552210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:02.552210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:02.552210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:02.552210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:02.552210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:02.552210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:02.552210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:02.552210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:02.552210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:02.552210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 6/14] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:56:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:56:02.557181 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e4885-a37c-4644-bd79-165ec38b1afe None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:02.559017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53009877-b656-4cec-8cfb-c157e033c89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:02.559947 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53009877-b656-4cec-8cfb-c157e033c89e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:02.560243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53009877-b656-4cec-8cfb-c157e033c89e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:02.560520 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53009877-b656-4cec-8cfb-c157e033c89e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:02.625048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53009877-b656-4cec-8cfb-c157e033c89e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:02.626618 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53009877-b656-4cec-8cfb-c157e033c89e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:02.649954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e4885-a37c-4644-bd79-165ec38b1afe None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:02.681762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee304a-a191-4158-8323-c4a419bc2ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:02.682426 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee304a-a191-4158-8323-c4a419bc2ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:02.682707 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee304a-a191-4158-8323-c4a419bc2ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:02.682982 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee304a-a191-4158-8323-c4a419bc2ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:02.683762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee304a-a191-4158-8323-c4a419bc2ce6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:02.684072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee304a-a191-4158-8323-c4a419bc2ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:02.685460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee304a-a191-4158-8323-c4a419bc2ce6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:02.697621 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 7/15] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:02.703151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee304a-a191-4158-8323-c4a419bc2ce6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:02.719932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 9/16] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 16:56:02.725283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53009877-b656-4cec-8cfb-c157e033c89e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:02.798681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee304a-a191-4158-8323-c4a419bc2ce6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:02.818465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53009877-b656-4cec-8cfb-c157e033c89e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:02.830688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c43a69-f625-4ed5-b319-d852888ac7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:02.831552 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c43a69-f625-4ed5-b319-d852888ac7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:02.831859 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c43a69-f625-4ed5-b319-d852888ac7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:02.832129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c43a69-f625-4ed5-b319-d852888ac7e2 None admin] PATH_INFO: `/v3/users/f95fdce949f547f29f3329fa96fe74ac` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:02.833320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c43a69-f625-4ed5-b319-d852888ac7e2 None admin] RBAC: Authorizing `identity:get_user(user_id=f95fdce949f547f29f3329fa96fe74ac)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:02.834784 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c43a69-f625-4ed5-b319-d852888ac7e2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:02.836423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 8/17] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:02 2022] GET /identity/v3/users/f95fdce949f547f29f3329fa96fe74ac => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:02.841678 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c43a69-f625-4ed5-b319-d852888ac7e2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:02.850777 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967899ea-b997-4524-a9ac-af7f3c0fd08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:02.851568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967899ea-b997-4524-a9ac-af7f3c0fd08b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:02.851881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967899ea-b997-4524-a9ac-af7f3c0fd08b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:02.852163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967899ea-b997-4524-a9ac-af7f3c0fd08b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:02.944240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c43a69-f625-4ed5-b319-d852888ac7e2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:02.977491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513d23b-6739-4577-a1fc-148364a7c899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:02.978243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967899ea-b997-4524-a9ac-af7f3c0fd08b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:02.978344 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d23b-6739-4577-a1fc-148364a7c899 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:02.978566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d23b-6739-4577-a1fc-148364a7c899 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:02.978844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d23b-6739-4577-a1fc-148364a7c899 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:02.979746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967899ea-b997-4524-a9ac-af7f3c0fd08b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:02.980068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513d23b-6739-4577-a1fc-148364a7c899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:02.981526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513d23b-6739-4577-a1fc-148364a7c899 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:02.983496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:02.989165 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513d23b-6739-4577-a1fc-148364a7c899 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:03.001343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-967899ea-b997-4524-a9ac-af7f3c0fd08b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:56:03.001343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:03.001343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:03.001343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:03.001343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:03.001343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:03.001343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:03.001343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:03.001343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:03.001343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:03.001343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:03.001343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:03.001343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:56:03.001343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:56:03.001343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:03.002318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:03.003132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:56:03.003132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:56:03.003132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:56:03.003132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:03.003132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:56:03.008339 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967899ea-b997-4524-a9ac-af7f3c0fd08b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:03.086505 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513d23b-6739-4577-a1fc-148364a7c899 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:03.105511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967899ea-b997-4524-a9ac-af7f3c0fd08b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:03.119231 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa981e-b3cf-42f4-8d5d-bd14f7991ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:03.119915 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa981e-b3cf-42f4-8d5d-bd14f7991ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:03.120197 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa981e-b3cf-42f4-8d5d-bd14f7991ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:03.120472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa981e-b3cf-42f4-8d5d-bd14f7991ed4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:03.121293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa981e-b3cf-42f4-8d5d-bd14f7991ed4 None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.domain.id=default, user.id=f95fdce949f547f29f3329fa96fe74ac) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:03.121605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa981e-b3cf-42f4-8d5d-bd14f7991ed4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:03.123050 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa981e-b3cf-42f4-8d5d-bd14f7991ed4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:03.130572 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 10/20] 10.222.0.48 () {56 vars in 1322 bytes} [Tue May 17 16:56:02 2022] GET /identity/v3/role_assignments?user.id=f95fdce949f547f29f3329fa96fe74ac&scope.domain.id=default&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:03.139016 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44492b25-47ff-4b3c-a1cd-a85511d24b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:03.139786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44492b25-47ff-4b3c-a1cd-a85511d24b4f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:03.140125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44492b25-47ff-4b3c-a1cd-a85511d24b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:03.140399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44492b25-47ff-4b3c-a1cd-a85511d24b4f None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:03.141136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44492b25-47ff-4b3c-a1cd-a85511d24b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:03.141442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44492b25-47ff-4b3c-a1cd-a85511d24b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:03.142898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44492b25-47ff-4b3c-a1cd-a85511d24b4f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:03.162249 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 11/21] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:05.857325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3899849-5ec4-4819-baf0-8ee4a19086f4 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:05.858558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3899849-5ec4-4819-baf0-8ee4a19086f4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:05.859052 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3899849-5ec4-4819-baf0-8ee4a19086f4 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:05.860987 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 11/22] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:05.866748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ef9ee-6869-4109-a324-32b8b4aca118 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:05.867583 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ef9ee-6869-4109-a324-32b8b4aca118 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:05.868254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ef9ee-6869-4109-a324-32b8b4aca118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:05.886344 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-275ef9ee-6869-4109-a324-32b8b4aca118 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:05.888023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-275ef9ee-6869-4109-a324-32b8b4aca118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:05.970308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:05.996294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdd7f9-9b28-4288-b876-a6232dfc2f7a None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:05.996876 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdd7f9-9b28-4288-b876-a6232dfc2f7a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:05.997356 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdd7f9-9b28-4288-b876-a6232dfc2f7a None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:05.999820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:06.005190 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fad1f-74d7-48d8-b85b-4e994cca39c7 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:06.005720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fad1f-74d7-48d8-b85b-4e994cca39c7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:06.006230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fad1f-74d7-48d8-b85b-4e994cca39c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:06.023661 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-367fad1f-74d7-48d8-b85b-4e994cca39c7 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:06.025176 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-367fad1f-74d7-48d8-b85b-4e994cca39c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:06.034765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdd7f9-9b28-4288-b876-a6232dfc2f7a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:06.129778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 13/25] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:06.133046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf67d6-66f0-4728-bab4-86c9a16b2953 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:06.133046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf67d6-66f0-4728-bab4-86c9a16b2953 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:06.133046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf67d6-66f0-4728-bab4-86c9a16b2953 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:06.133417 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 14/26] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:06.140549 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ca224-a45e-4e24-a99f-4b7539646604 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:06.140836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ca224-a45e-4e24-a99f-4b7539646604 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:06.141123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ca224-a45e-4e24-a99f-4b7539646604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:06.175075 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f87ca224-a45e-4e24-a99f-4b7539646604 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:06.176340 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f87ca224-a45e-4e24-a99f-4b7539646604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:06.187166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdd7f9-9b28-4288-b876-a6232dfc2f7a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:06.228300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc0e1c-bb43-4d4b-a94f-3846376c9603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:06.229116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc0e1c-bb43-4d4b-a94f-3846376c9603 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:06.229397 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc0e1c-bb43-4d4b-a94f-3846376c9603 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:06.229682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc0e1c-bb43-4d4b-a94f-3846376c9603 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:06.250380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc0e1c-bb43-4d4b-a94f-3846376c9603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-f5cc0e1c-bb43-4d4b-a94f-3846376c9603 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:06.258327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:06.259307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:06.260116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:06.260116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:06.260116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:06.260116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:06.260116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:06.260116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:06.260116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:06.260116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:06.260116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:06.260116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:06.260116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:06.260116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:06.262357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 13/27] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:56:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:06.266933 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc0e1c-bb43-4d4b-a94f-3846376c9603 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:06.293828 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 15/28] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:06.294687 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ca224-a45e-4e24-a99f-4b7539646604 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:06.402101 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc0e1c-bb43-4d4b-a94f-3846376c9603 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:06.448885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dc7dc-d166-45bd-8c42-793035eed4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:06.449971 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dc7dc-d166-45bd-8c42-793035eed4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:06.450396 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dc7dc-d166-45bd-8c42-793035eed4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:06.450810 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dc7dc-d166-45bd-8c42-793035eed4a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:06.452567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ca224-a45e-4e24-a99f-4b7539646604 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:06.472908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dc7dc-d166-45bd-8c42-793035eed4a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:06.474422 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dc7dc-d166-45bd-8c42-793035eed4a7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:06.499252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5d8dc7dc-d166-45bd-8c42-793035eed4a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:56:06.499252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:06.499252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:06.499252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:06.499252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:06.499252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:06.499252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:06.499252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:06.499252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:06.499252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:06.499252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:06.499252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:06.499252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:56:06.499252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:56:06.499252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:06.500133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:06.500990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:56:06.500990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:56:06.500990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:56:06.500990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:06.503192 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 14/29] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:06.504007 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8977294-17a5-4c46-bd6a-41069c878f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:06.504535 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dc7dc-d166-45bd-8c42-793035eed4a7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:06.504696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8977294-17a5-4c46-bd6a-41069c878f50 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:06.505159 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8977294-17a5-4c46-bd6a-41069c878f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:06.505570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8977294-17a5-4c46-bd6a-41069c878f50 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:06.506453 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8977294-17a5-4c46-bd6a-41069c878f50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:06.506899 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8977294-17a5-4c46-bd6a-41069c878f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:06.508559 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8977294-17a5-4c46-bd6a-41069c878f50 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:06.521634 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 16/30] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:06.522869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8977294-17a5-4c46-bd6a-41069c878f50 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:06.661138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8977294-17a5-4c46-bd6a-41069c878f50 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:06.661325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dc7dc-d166-45bd-8c42-793035eed4a7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:06.699841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727a4ef-a330-43a5-9db1-50be7e049bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:06.701147 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727a4ef-a330-43a5-9db1-50be7e049bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:06.703137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab13baa-8045-4009-a4af-073bd5ce531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:06.703577 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727a4ef-a330-43a5-9db1-50be7e049bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:06.704401 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab13baa-8045-4009-a4af-073bd5ce531a None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:06.704853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727a4ef-a330-43a5-9db1-50be7e049bd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:06.705737 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727a4ef-a330-43a5-9db1-50be7e049bd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:06.706160 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab13baa-8045-4009-a4af-073bd5ce531a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:06.706580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab13baa-8045-4009-a4af-073bd5ce531a None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:06.707025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727a4ef-a330-43a5-9db1-50be7e049bd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:06.707966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab13baa-8045-4009-a4af-073bd5ce531a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:06.709505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727a4ef-a330-43a5-9db1-50be7e049bd9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:06.711026 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab13baa-8045-4009-a4af-073bd5ce531a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:06.731152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 17/31] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:06.732409 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727a4ef-a330-43a5-9db1-50be7e049bd9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:06.844477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727a4ef-a330-43a5-9db1-50be7e049bd9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:06.878840 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9c18c-6c58-4155-9d03-a7cd6faf6d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:06.879718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 15/32] 10.222.0.48 () {60 vars in 1131 bytes} [Tue May 17 16:56:06 2022] POST /identity/v3/roles => generated 219 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:56:06.880695 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab13baa-8045-4009-a4af-073bd5ce531a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:06.881245 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9c18c-6c58-4155-9d03-a7cd6faf6d08 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:06.881774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9c18c-6c58-4155-9d03-a7cd6faf6d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:06.882252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9c18c-6c58-4155-9d03-a7cd6faf6d08 None admin] PATH_INFO: `/v3/users/f95fdce949f547f29f3329fa96fe74ac` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:06.884155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9c18c-6c58-4155-9d03-a7cd6faf6d08 None admin] RBAC: Authorizing `identity:get_user(user_id=f95fdce949f547f29f3329fa96fe74ac)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:06.885912 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9c18c-6c58-4155-9d03-a7cd6faf6d08 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:06.888348 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 18/33] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:06 2022] GET /identity/v3/users/f95fdce949f547f29f3329fa96fe74ac => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:06.890585 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677438e3-eadb-4fcf-a532-200922a88dfd None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:06.891107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677438e3-eadb-4fcf-a532-200922a88dfd None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:06.891588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677438e3-eadb-4fcf-a532-200922a88dfd None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:06.893938 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 19/34] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:06.895567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc80dcd-dc16-462d-9370-c0912234925b None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:06.896122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc80dcd-dc16-462d-9370-c0912234925b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:06.896599 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc80dcd-dc16-462d-9370-c0912234925b None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:06.898434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 20/35] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:06.899396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc80dcd-dc16-462d-9370-c0912234925b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:06.997455 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab13baa-8045-4009-a4af-073bd5ce531a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:07.015007 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc80dcd-dc16-462d-9370-c0912234925b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:07.040345 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1367f-d14a-43b7-9f69-6d1082070307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:07.041417 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1367f-d14a-43b7-9f69-6d1082070307 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:07.042012 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1367f-d14a-43b7-9f69-6d1082070307 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:07.047021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1367f-d14a-43b7-9f69-6d1082070307 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:07.048070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1367f-d14a-43b7-9f69-6d1082070307 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:07.050128 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1367f-d14a-43b7-9f69-6d1082070307 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:07.056274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4c1d5-6d6f-4373-8456-d14a13288b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:07.057102 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4c1d5-6d6f-4373-8456-d14a13288b5b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:07.057442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4c1d5-6d6f-4373-8456-d14a13288b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:07.057915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4c1d5-6d6f-4373-8456-d14a13288b5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:07.059414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4c1d5-6d6f-4373-8456-d14a13288b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:07.061275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4c1d5-6d6f-4373-8456-d14a13288b5b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:07.068322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 21/36] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:07.070148 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b938a-b4d3-4cd3-b093-a82291aee570 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:07.070670 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b938a-b4d3-4cd3-b093-a82291aee570 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:07.071106 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b938a-b4d3-4cd3-b093-a82291aee570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:07.097429 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ca1b938a-b4d3-4cd3-b093-a82291aee570 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:07.098832 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ca1b938a-b4d3-4cd3-b093-a82291aee570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:07.104933 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 16/37] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 16:56:06 2022] POST /identity/v3/projects => generated 301 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:56:07.106495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe5723-c697-4639-b53f-9fb7a3d650f6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:07.106838 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe5723-c697-4639-b53f-9fb7a3d650f6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:07.108382 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe5723-c697-4639-b53f-9fb7a3d650f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:07.135040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-20fe5723-c697-4639-b53f-9fb7a3d650f6 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:07.136663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-20fe5723-c697-4639-b53f-9fb7a3d650f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:07.197199 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 22/38] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:07.198284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b938a-b4d3-4cd3-b093-a82291aee570 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:07.223976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 17/39] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:07.242436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe5723-c697-4639-b53f-9fb7a3d650f6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:07.352274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b938a-b4d3-4cd3-b093-a82291aee570 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:07.381447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe5723-c697-4639-b53f-9fb7a3d650f6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:07.401002 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d643262-8b5c-4928-bcf0-aaff49832ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:07.402121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d643262-8b5c-4928-bcf0-aaff49832ac2 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:07.402407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d643262-8b5c-4928-bcf0-aaff49832ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:07.402694 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d643262-8b5c-4928-bcf0-aaff49832ac2 None admin] PATH_INFO: `/v3/domains/default/users/f95fdce949f547f29f3329fa96fe74ac/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:07.408481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d643262-8b5c-4928-bcf0-aaff49832ac2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f95fdce949f547f29f3329fa96fe74ac, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:07.410530 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d643262-8b5c-4928-bcf0-aaff49832ac2 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:07.425664 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02499869-2f2e-4b03-bd0e-fd949b69f4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:07.426341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02499869-2f2e-4b03-bd0e-fd949b69f4b6 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:07.426762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02499869-2f2e-4b03-bd0e-fd949b69f4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:07.427062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02499869-2f2e-4b03-bd0e-fd949b69f4b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:07.427865 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02499869-2f2e-4b03-bd0e-fd949b69f4b6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:07.429283 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02499869-2f2e-4b03-bd0e-fd949b69f4b6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:07.443795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 18/40] 10.222.0.48 () {60 vars in 1131 bytes} [Tue May 17 16:56:07 2022] POST /identity/v3/roles => generated 225 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:56:07.448695 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02499869-2f2e-4b03-bd0e-fd949b69f4b6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:07.536629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 23/41] 10.222.0.48 () {58 vars in 1361 bytes} [Tue May 17 16:56:07 2022] PUT /identity/v3/domains/default/users/f95fdce949f547f29f3329fa96fe74ac/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:56:07.580948 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02499869-2f2e-4b03-bd0e-fd949b69f4b6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:07.622927 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25107c95-a63b-4b92-8d74-0e00013ba290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:07.624591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25107c95-a63b-4b92-8d74-0e00013ba290 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:07.625103 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25107c95-a63b-4b92-8d74-0e00013ba290 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:07.625580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25107c95-a63b-4b92-8d74-0e00013ba290 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:07.626825 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25107c95-a63b-4b92-8d74-0e00013ba290 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:07.628601 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25107c95-a63b-4b92-8d74-0e00013ba290 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:07.647418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 19/42] 10.222.0.48 () {60 vars in 1131 bytes} [Tue May 17 16:56:07 2022] POST /identity/v3/roles => generated 223 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:56:07.679397 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62d534-d07f-455d-8089-2e34741771a8 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:07.679750 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62d534-d07f-455d-8089-2e34741771a8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:07.680014 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62d534-d07f-455d-8089-2e34741771a8 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:07.691375 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 24/43] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:07 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:07.698176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187867c1-c04e-4313-8ab8-a5180cdbd374 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:07.698517 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187867c1-c04e-4313-8ab8-a5180cdbd374 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:07.698820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187867c1-c04e-4313-8ab8-a5180cdbd374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:07.719935 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-187867c1-c04e-4313-8ab8-a5180cdbd374 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:07.721296 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-187867c1-c04e-4313-8ab8-a5180cdbd374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:07.807484 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 20/44] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:07.838351 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62d534-d07f-455d-8089-2e34741771a8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:07.952314 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62d534-d07f-455d-8089-2e34741771a8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:07.986804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a866b4a-e99b-4be7-9d00-dfb951c62cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:07.987799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a866b4a-e99b-4be7-9d00-dfb951c62cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:07.988113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a866b4a-e99b-4be7-9d00-dfb951c62cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:07.988394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a866b4a-e99b-4be7-9d00-dfb951c62cc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:07.989697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a866b4a-e99b-4be7-9d00-dfb951c62cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:07.991268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a866b4a-e99b-4be7-9d00-dfb951c62cc2 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:07.992948 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 25/45] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:08.000870 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187867c1-c04e-4313-8ab8-a5180cdbd374 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:08.111980 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187867c1-c04e-4313-8ab8-a5180cdbd374 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:08.148000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4add23-f8ba-4178-9df2-d07b66f07350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:08.148674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4add23-f8ba-4178-9df2-d07b66f07350 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:08.148959 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4add23-f8ba-4178-9df2-d07b66f07350 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:08.149236 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4add23-f8ba-4178-9df2-d07b66f07350 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:08.149958 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4add23-f8ba-4178-9df2-d07b66f07350 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:08.151418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4add23-f8ba-4178-9df2-d07b66f07350 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:08.178830 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 21/46] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 16:56:07 2022] POST /identity/v3/projects => generated 312 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:56:09.896679 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0860b9b-3134-4d52-8062-5a04574e8cf8 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:09.897238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0860b9b-3134-4d52-8062-5a04574e8cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:09.897238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0860b9b-3134-4d52-8062-5a04574e8cf8 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:09.898606 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 26/47] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:09.903961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6ba55-f26f-48b4-aa46-7743cb462a89 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:09.904427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6ba55-f26f-48b4-aa46-7743cb462a89 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:09.904530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6ba55-f26f-48b4-aa46-7743cb462a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:09.921230 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2fc6ba55-f26f-48b4-aa46-7743cb462a89 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:09.922391 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2fc6ba55-f26f-48b4-aa46-7743cb462a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:09.985140 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 22/48] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:10.007503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0860b9b-3134-4d52-8062-5a04574e8cf8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:10.104834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0860b9b-3134-4d52-8062-5a04574e8cf8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:10.136780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f380c-a310-4f62-b79a-636626fc0aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:10.137585 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f380c-a310-4f62-b79a-636626fc0aed None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:10.137871 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f380c-a310-4f62-b79a-636626fc0aed None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:10.138154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f380c-a310-4f62-b79a-636626fc0aed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:10.149682 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f380c-a310-4f62-b79a-636626fc0aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-a04f380c-a310-4f62-b79a-636626fc0aed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:10.159058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:10.159987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:10.160725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:10.160725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:10.160725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:10.160725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:10.160725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:10.160725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:10.160725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:10.160725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:10.160725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:10.160725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:10.160725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:10.160725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:10.160725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 27/49] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:56:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:10.166119 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6ba55-f26f-48b4-aa46-7743cb462a89 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:10.267736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6ba55-f26f-48b4-aa46-7743cb462a89 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:10.302880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a2111-6c8f-4037-9d65-418e0d00767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:10.303556 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a2111-6c8f-4037-9d65-418e0d00767c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:10.303870 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a2111-6c8f-4037-9d65-418e0d00767c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:10.304147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a2111-6c8f-4037-9d65-418e0d00767c None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:10.304895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a2111-6c8f-4037-9d65-418e0d00767c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:10.305202 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a2111-6c8f-4037-9d65-418e0d00767c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:10.306591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a2111-6c8f-4037-9d65-418e0d00767c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:10.315800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 23/50] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:10.321240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f380c-a310-4f62-b79a-636626fc0aed None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:10.416164 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f380c-a310-4f62-b79a-636626fc0aed None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:10.428327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b7eaa-0bf4-487f-a19b-5c4c45bff90b None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:10.428620 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b7eaa-0bf4-487f-a19b-5c4c45bff90b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:10.428900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b7eaa-0bf4-487f-a19b-5c4c45bff90b None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:10.430287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 24/51] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:56:10.435969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d68352-1d0d-4f3a-85b1-7a34b05da054 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:10.436286 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d68352-1d0d-4f3a-85b1-7a34b05da054 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:10.436544 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d68352-1d0d-4f3a-85b1-7a34b05da054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:10.449629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eecbf0-c000-4730-8dd7-808e40948670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:10.450506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eecbf0-c000-4730-8dd7-808e40948670 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:10.450785 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eecbf0-c000-4730-8dd7-808e40948670 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:10.451642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eecbf0-c000-4730-8dd7-808e40948670 None admin] PATH_INFO: `/v3/users/f95fdce949f547f29f3329fa96fe74ac` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:10.452926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eecbf0-c000-4730-8dd7-808e40948670 None admin] RBAC: Authorizing `identity:get_user(user_id=f95fdce949f547f29f3329fa96fe74ac)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:10.453416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f4d68352-1d0d-4f3a-85b1-7a34b05da054 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:10.454372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eecbf0-c000-4730-8dd7-808e40948670 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:10.454643 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f4d68352-1d0d-4f3a-85b1-7a34b05da054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:10.456015 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 28/52] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:10 2022] GET /identity/v3/users/f95fdce949f547f29f3329fa96fe74ac => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:10.461197 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eecbf0-c000-4730-8dd7-808e40948670 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:10.519126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 25/53] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:10.542551 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d68352-1d0d-4f3a-85b1-7a34b05da054 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:10.555421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eecbf0-c000-4730-8dd7-808e40948670 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:10.587137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db1587-400d-4f15-b22b-049a41375f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:10.587946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db1587-400d-4f15-b22b-049a41375f84 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:10.588227 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db1587-400d-4f15-b22b-049a41375f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:10.588501 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db1587-400d-4f15-b22b-049a41375f84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:10.589661 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db1587-400d-4f15-b22b-049a41375f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:10.591108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db1587-400d-4f15-b22b-049a41375f84 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:10.592757 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 29/54] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:10.598394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db1587-400d-4f15-b22b-049a41375f84 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:10.635872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d68352-1d0d-4f3a-85b1-7a34b05da054 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:10.668480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a8a0f-d19b-4462-bf89-11adf2c48703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:10.669216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a8a0f-d19b-4462-bf89-11adf2c48703 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:10.669502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a8a0f-d19b-4462-bf89-11adf2c48703 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:10.669782 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a8a0f-d19b-4462-bf89-11adf2c48703 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:10.671004 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a8a0f-d19b-4462-bf89-11adf2c48703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:10.672495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a8a0f-d19b-4462-bf89-11adf2c48703 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:10.674107 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 26/55] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:10.679439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a8a0f-d19b-4462-bf89-11adf2c48703 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:10.690904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db1587-400d-4f15-b22b-049a41375f84 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:10.723151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafdc59-d39d-4291-8071-070fb4d738b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:10.723834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafdc59-d39d-4291-8071-070fb4d738b8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:10.724120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafdc59-d39d-4291-8071-070fb4d738b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:10.724398 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafdc59-d39d-4291-8071-070fb4d738b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:10.725225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafdc59-d39d-4291-8071-070fb4d738b8 None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.domain.id=default, user.id=f95fdce949f547f29f3329fa96fe74ac) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:10.725540 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafdc59-d39d-4291-8071-070fb4d738b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:10.726985 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafdc59-d39d-4291-8071-070fb4d738b8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:10.734736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 30/56] 10.222.0.48 () {56 vars in 1322 bytes} [Tue May 17 16:56:10 2022] GET /identity/v3/role_assignments?user.id=f95fdce949f547f29f3329fa96fe74ac&scope.domain.id=default&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 530 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:10.776283 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a8a0f-d19b-4462-bf89-11adf2c48703 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:10.817834 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f91b0-2141-498d-915b-ee6a267a0721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:10.818509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f91b0-2141-498d-915b-ee6a267a0721 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:10.818793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f91b0-2141-498d-915b-ee6a267a0721 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:10.819068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f91b0-2141-498d-915b-ee6a267a0721 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:10.819810 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f91b0-2141-498d-915b-ee6a267a0721 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:10.821275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f91b0-2141-498d-915b-ee6a267a0721 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:10.848130 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 27/57] 10.222.0.48 () {60 vars in 1140 bytes} [Tue May 17 16:56:10 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:56:13.057526 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d535ec-5f02-4f9a-a0b3-33d8e1b3a113 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:13.058072 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d535ec-5f02-4f9a-a0b3-33d8e1b3a113 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:13.058072 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d535ec-5f02-4f9a-a0b3-33d8e1b3a113 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:13.059461 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 31/58] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:13.065671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de10fb8-f9eb-479c-bd21-4b9e47263d53 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:13.066068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de10fb8-f9eb-479c-bd21-4b9e47263d53 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:13.066238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de10fb8-f9eb-479c-bd21-4b9e47263d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:13.082443 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1de10fb8-f9eb-479c-bd21-4b9e47263d53 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:13.083635 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1de10fb8-f9eb-479c-bd21-4b9e47263d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:13.154669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 28/59] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:13.178764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d535ec-5f02-4f9a-a0b3-33d8e1b3a113 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:13.274708 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d535ec-5f02-4f9a-a0b3-33d8e1b3a113 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:13.305709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e1cca-3510-4bcf-9249-94b7dc439c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:13.306495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e1cca-3510-4bcf-9249-94b7dc439c7b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:13.306778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e1cca-3510-4bcf-9249-94b7dc439c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:13.307054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e1cca-3510-4bcf-9249-94b7dc439c7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:13.308284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e1cca-3510-4bcf-9249-94b7dc439c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:13.309683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e1cca-3510-4bcf-9249-94b7dc439c7b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:13.311788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 32/60] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:13.317483 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de10fb8-f9eb-479c-bd21-4b9e47263d53 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:13.409146 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de10fb8-f9eb-479c-bd21-4b9e47263d53 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:13.440973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3dea09-f890-4623-8d60-a8682e137f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:13.441636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dea09-f890-4623-8d60-a8682e137f41 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:13.441918 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dea09-f890-4623-8d60-a8682e137f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:13.442195 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dea09-f890-4623-8d60-a8682e137f41 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:13.442898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3dea09-f890-4623-8d60-a8682e137f41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:13.444395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3dea09-f890-4623-8d60-a8682e137f41 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:13.470444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 29/61] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:56:13 2022] POST /identity/v3/users => generated 275 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:56:16.901156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225d200-0b37-408d-beaa-84a4683b5456 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:16.902231 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225d200-0b37-408d-beaa-84a4683b5456 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:16.902722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225d200-0b37-408d-beaa-84a4683b5456 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:16.904351 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 33/62] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:16.917039 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb6a1c-4d70-4608-a52e-4dee9519f7f2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:16.917938 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb6a1c-4d70-4608-a52e-4dee9519f7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:16.918519 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb6a1c-4d70-4608-a52e-4dee9519f7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:16.922132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f62e94-09ca-4fe3-9f08-1b12d089753e None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:16.923156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f62e94-09ca-4fe3-9f08-1b12d089753e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:16.924749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f62e94-09ca-4fe3-9f08-1b12d089753e None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:16.929965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 34/63] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:16.936745 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3d444-b193-4f8e-9e98-cc6878057f2d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:16.937481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3d444-b193-4f8e-9e98-cc6878057f2d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:16.937971 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3d444-b193-4f8e-9e98-cc6878057f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:16.950196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-79eb6a1c-4d70-4608-a52e-4dee9519f7f2 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:16.956541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-79eb6a1c-4d70-4608-a52e-4dee9519f7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:16.970691 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-89f3d444-b193-4f8e-9e98-cc6878057f2d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:16.973300 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-89f3d444-b193-4f8e-9e98-cc6878057f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:17.037041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 30/64] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:17.038856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eab7b-cb57-4a9b-be30-92bb86bca7cf None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:17.039427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eab7b-cb57-4a9b-be30-92bb86bca7cf None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:17.039965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eab7b-cb57-4a9b-be30-92bb86bca7cf None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:17.041929 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 31/65] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:17.048372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bab47d-0baf-44be-9c0a-968a1504af66 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:17.050006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bab47d-0baf-44be-9c0a-968a1504af66 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:17.050685 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bab47d-0baf-44be-9c0a-968a1504af66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:17.076096 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-72bab47d-0baf-44be-9c0a-968a1504af66 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:17.077945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-72bab47d-0baf-44be-9c0a-968a1504af66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:17.085104 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 35/66] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:17.085971 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3d444-b193-4f8e-9e98-cc6878057f2d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:17.163785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 32/67] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:17.165040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bab47d-0baf-44be-9c0a-968a1504af66 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:17.197013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3d444-b193-4f8e-9e98-cc6878057f2d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:17.232088 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa09f0-c389-45ec-be24-2eaf0d69bc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:17.233423 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa09f0-c389-45ec-be24-2eaf0d69bc2d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:17.233711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa09f0-c389-45ec-be24-2eaf0d69bc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:17.233987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa09f0-c389-45ec-be24-2eaf0d69bc2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:17.244433 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa09f0-c389-45ec-be24-2eaf0d69bc2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-e8fa09f0-c389-45ec-be24-2eaf0d69bc2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:17.252796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:17.253710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:17.254449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:17.254449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:17.254449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:17.254449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:17.254449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:17.254449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:17.254449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:17.254449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:17.254449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:17.254449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:17.254449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:17.254449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:17.255625 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 36/68] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:17.257070 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa09f0-c389-45ec-be24-2eaf0d69bc2d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:17.282472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bab47d-0baf-44be-9c0a-968a1504af66 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:17.317412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bc095-de07-42ed-98c4-f16e0fe523af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:17.318217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bc095-de07-42ed-98c4-f16e0fe523af None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:17.318487 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bc095-de07-42ed-98c4-f16e0fe523af None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:17.318762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bc095-de07-42ed-98c4-f16e0fe523af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:17.329331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bc095-de07-42ed-98c4-f16e0fe523af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-aa4bc095-de07-42ed-98c4-f16e0fe523af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:17.337038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:17.337873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:17.338623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:17.338623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:17.338623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:17.338623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:17.338623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:17.338623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:17.338623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:17.338623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:17.338623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:17.338623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:17.338623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:17.338623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:17.338623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 33/69] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:56:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:17.339807 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99f734-19ee-41aa-96df-2d79d3ca3e1a None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:17.340096 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99f734-19ee-41aa-96df-2d79d3ca3e1a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:17.340372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99f734-19ee-41aa-96df-2d79d3ca3e1a None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:17.341779 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 34/70] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:17.347029 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99f734-19ee-41aa-96df-2d79d3ca3e1a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:17.362014 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa09f0-c389-45ec-be24-2eaf0d69bc2d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:17.396256 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c456d3-af5c-4251-925d-d0e560e377f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:17.397074 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c456d3-af5c-4251-925d-d0e560e377f4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:17.397361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c456d3-af5c-4251-925d-d0e560e377f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:17.397642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c456d3-af5c-4251-925d-d0e560e377f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:17.408699 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c456d3-af5c-4251-925d-d0e560e377f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-b1c456d3-af5c-4251-925d-d0e560e377f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:17.416853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:17.417706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:17.418488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:17.418488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:17.418488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:17.418488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:17.418488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:17.418488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:17.418488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:17.418488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:17.418488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:17.418488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:17.418488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:17.418488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:17.418488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 37/71] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:56:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:17.419105 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c456d3-af5c-4251-925d-d0e560e377f4 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:17.451062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99f734-19ee-41aa-96df-2d79d3ca3e1a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:17.487020 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e64710-ec64-4df5-bf2b-6c1c1ea37eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:17.487718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e64710-ec64-4df5-bf2b-6c1c1ea37eca None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:17.488007 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e64710-ec64-4df5-bf2b-6c1c1ea37eca None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:17.488283 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e64710-ec64-4df5-bf2b-6c1c1ea37eca None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:17.489022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e64710-ec64-4df5-bf2b-6c1c1ea37eca None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:17.489328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e64710-ec64-4df5-bf2b-6c1c1ea37eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:17.490731 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e64710-ec64-4df5-bf2b-6c1c1ea37eca None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:17.498977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 35/72] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:17.500141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03ad9e-d5df-44f8-a479-49a4e46a7525 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:17.500601 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03ad9e-d5df-44f8-a479-49a4e46a7525 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:17.501081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03ad9e-d5df-44f8-a479-49a4e46a7525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:17.517500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5a03ad9e-d5df-44f8-a479-49a4e46a7525 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:17.518656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5a03ad9e-d5df-44f8-a479-49a4e46a7525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:17.521893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c456d3-af5c-4251-925d-d0e560e377f4 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:17.555181 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ec6ff-3f5a-4f76-98fc-e52c8ddedd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:17.555885 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ec6ff-3f5a-4f76-98fc-e52c8ddedd3a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:17.556173 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ec6ff-3f5a-4f76-98fc-e52c8ddedd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:17.556449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ec6ff-3f5a-4f76-98fc-e52c8ddedd3a None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:17.557192 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ec6ff-3f5a-4f76-98fc-e52c8ddedd3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:17.557493 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ec6ff-3f5a-4f76-98fc-e52c8ddedd3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:17.558879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ec6ff-3f5a-4f76-98fc-e52c8ddedd3a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:17.567715 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 38/73] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:17.568457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ec6ff-3f5a-4f76-98fc-e52c8ddedd3a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:17.594744 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 36/74] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:17.596014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03ad9e-d5df-44f8-a479-49a4e46a7525 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:17.687720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ec6ff-3f5a-4f76-98fc-e52c8ddedd3a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:17.692925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03ad9e-d5df-44f8-a479-49a4e46a7525 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:17.720929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360e1fb-7469-4c16-a6f0-22f1eec5633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:17.721839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360e1fb-7469-4c16-a6f0-22f1eec5633f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:17.722120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360e1fb-7469-4c16-a6f0-22f1eec5633f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:17.722537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360e1fb-7469-4c16-a6f0-22f1eec5633f None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:17.723414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360e1fb-7469-4c16-a6f0-22f1eec5633f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:17.723890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360e1fb-7469-4c16-a6f0-22f1eec5633f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:17.725400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360e1fb-7469-4c16-a6f0-22f1eec5633f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:17.726495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f68c21-0a33-4c4d-871d-e8f2244dea28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:17.727369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f68c21-0a33-4c4d-871d-e8f2244dea28 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:17.727674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f68c21-0a33-4c4d-871d-e8f2244dea28 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:17.727955 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f68c21-0a33-4c4d-871d-e8f2244dea28 None admin] PATH_INFO: `/v3/users/3058449ec8824214b72208846e9a93f3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:17.738745 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 39/75] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:56:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:17.739909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360e1fb-7469-4c16-a6f0-22f1eec5633f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:17.741685 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f68c21-0a33-4c4d-871d-e8f2244dea28 None admin] RBAC: Authorizing `identity:get_user(user_id=3058449ec8824214b72208846e9a93f3)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:17.743153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f68c21-0a33-4c4d-871d-e8f2244dea28 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:17.744868 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 37/76] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:17 2022] GET /identity/v3/users/3058449ec8824214b72208846e9a93f3 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:17.745621 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f68c21-0a33-4c4d-871d-e8f2244dea28 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:17.836245 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360e1fb-7469-4c16-a6f0-22f1eec5633f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:17.843049 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f68c21-0a33-4c4d-871d-e8f2244dea28 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:17.867934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab24ef3-4385-48a1-ad1f-7619c7f1285a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:17.868794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab24ef3-4385-48a1-ad1f-7619c7f1285a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:17.869075 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab24ef3-4385-48a1-ad1f-7619c7f1285a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:17.869349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab24ef3-4385-48a1-ad1f-7619c7f1285a None admin] PATH_INFO: `/v3/users/f95fdce949f547f29f3329fa96fe74ac` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:17.870528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab24ef3-4385-48a1-ad1f-7619c7f1285a None admin] RBAC: Authorizing `identity:get_user(user_id=f95fdce949f547f29f3329fa96fe74ac)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:17.871982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab24ef3-4385-48a1-ad1f-7619c7f1285a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:17.874099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 40/77] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:17 2022] GET /identity/v3/users/f95fdce949f547f29f3329fa96fe74ac => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:17.874855 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab24ef3-4385-48a1-ad1f-7619c7f1285a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:17.875618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde49e6d-b619-4094-a852-9c9e57589c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:17.876428 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde49e6d-b619-4094-a852-9c9e57589c39 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:17.876716 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde49e6d-b619-4094-a852-9c9e57589c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:17.876992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde49e6d-b619-4094-a852-9c9e57589c39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:17.886783 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde49e6d-b619-4094-a852-9c9e57589c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-bde49e6d-b619-4094-a852-9c9e57589c39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:17.895384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:17.896245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:17.897077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:17.897077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:17.897077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:17.897077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:17.897077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:17.897077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:17.897077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:17.897077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:17.897077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:17.897077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:17.897077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:17.897077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:17.897077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 38/78] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:17.897692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde49e6d-b619-4094-a852-9c9e57589c39 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:17.973944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab24ef3-4385-48a1-ad1f-7619c7f1285a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:17.989544 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde49e6d-b619-4094-a852-9c9e57589c39 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:18.004866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4013e-c38c-4e7e-af93-252f72bf04ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:18.005729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4013e-c38c-4e7e-af93-252f72bf04ea None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:18.006013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4013e-c38c-4e7e-af93-252f72bf04ea None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:18.006288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4013e-c38c-4e7e-af93-252f72bf04ea None admin] PATH_INFO: `/v3/users/3058449ec8824214b72208846e9a93f3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:18.007466 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4013e-c38c-4e7e-af93-252f72bf04ea None admin] RBAC: Authorizing `identity:get_user(user_id=3058449ec8824214b72208846e9a93f3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:18.009001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4013e-c38c-4e7e-af93-252f72bf04ea None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:18.010758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 41/79] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:17 2022] GET /identity/v3/users/3058449ec8824214b72208846e9a93f3 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:18.011763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d85ef2-79b0-4960-a195-563108919440 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:18.012046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d85ef2-79b0-4960-a195-563108919440 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:18.012320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d85ef2-79b0-4960-a195-563108919440 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:18.013649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 42/80] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:18.014823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d85ef2-79b0-4960-a195-563108919440 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:18.022512 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7700c-8d5f-4347-9456-4e84c167519b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:18.023163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7700c-8d5f-4347-9456-4e84c167519b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:18.023448 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7700c-8d5f-4347-9456-4e84c167519b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:18.023767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7700c-8d5f-4347-9456-4e84c167519b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:18.087385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7700c-8d5f-4347-9456-4e84c167519b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:18.088507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7700c-8d5f-4347-9456-4e84c167519b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:18.111105 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d85ef2-79b0-4960-a195-563108919440 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:18.142926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fc5e6-410b-45c1-a5b9-c5bbbe42a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:18.143568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fc5e6-410b-45c1-a5b9-c5bbbe42a881 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:18.143889 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fc5e6-410b-45c1-a5b9-c5bbbe42a881 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:18.144163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fc5e6-410b-45c1-a5b9-c5bbbe42a881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:18.183782 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 39/81] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:18.184638 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7700c-8d5f-4347-9456-4e84c167519b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:18.211359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fc5e6-410b-45c1-a5b9-c5bbbe42a881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:18.213139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fc5e6-410b-45c1-a5b9-c5bbbe42a881 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:18.282189 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7700c-8d5f-4347-9456-4e84c167519b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:18.304542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 43/82] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:18.305371 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fc5e6-410b-45c1-a5b9-c5bbbe42a881 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:18.314800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a8827-2e72-46a9-966f-66d94abda631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:18.315468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a8827-2e72-46a9-966f-66d94abda631 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:18.315780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a8827-2e72-46a9-966f-66d94abda631 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:18.316060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a8827-2e72-46a9-966f-66d94abda631 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:18.316801 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a8827-2e72-46a9-966f-66d94abda631 None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:18.317110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a8827-2e72-46a9-966f-66d94abda631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:18.318491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a8827-2e72-46a9-966f-66d94abda631 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:18.326296 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 40/83] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:18.328407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650a710-8f76-4133-acae-948ab79c9138 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:18.328702 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650a710-8f76-4133-acae-948ab79c9138 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:18.328981 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650a710-8f76-4133-acae-948ab79c9138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:18.344359 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e650a710-8f76-4133-acae-948ab79c9138 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:18.345522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e650a710-8f76-4133-acae-948ab79c9138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:18.407492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fc5e6-410b-45c1-a5b9-c5bbbe42a881 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:18.409706 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 41/84] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:18.410539 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650a710-8f76-4133-acae-948ab79c9138 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:18.441149 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd2c7f-ec37-4bcb-bde5-722f23f7f8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:18.441805 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd2c7f-ec37-4bcb-bde5-722f23f7f8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:18.442118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd2c7f-ec37-4bcb-bde5-722f23f7f8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:18.442396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd2c7f-ec37-4bcb-bde5-722f23f7f8d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:18.506157 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd2c7f-ec37-4bcb-bde5-722f23f7f8d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:18.507158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650a710-8f76-4133-acae-948ab79c9138 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:18.508930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd2c7f-ec37-4bcb-bde5-722f23f7f8d2 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:18.540461 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9254f-78c2-449f-8741-9aaf031504f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:18.541247 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9254f-78c2-449f-8741-9aaf031504f0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:18.541531 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9254f-78c2-449f-8741-9aaf031504f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:18.541811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9254f-78c2-449f-8741-9aaf031504f0 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:18.542997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9254f-78c2-449f-8741-9aaf031504f0 None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:18.544487 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9254f-78c2-449f-8741-9aaf031504f0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:18.547213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 42/85] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:18 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:18.547810 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9254f-78c2-449f-8741-9aaf031504f0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:18.605690 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 44/86] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:18.606534 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd2c7f-ec37-4bcb-bde5-722f23f7f8d2 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:18.640721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9254f-78c2-449f-8741-9aaf031504f0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:18.672901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adbbba-73b7-40a8-bd1d-bd21e845bb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:18.673760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adbbba-73b7-40a8-bd1d-bd21e845bb02 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:18.674045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adbbba-73b7-40a8-bd1d-bd21e845bb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:18.674326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adbbba-73b7-40a8-bd1d-bd21e845bb02 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:18.675496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adbbba-73b7-40a8-bd1d-bd21e845bb02 None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:18.676993 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adbbba-73b7-40a8-bd1d-bd21e845bb02 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:18.678674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 43/87] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:18 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:18.679438 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adbbba-73b7-40a8-bd1d-bd21e845bb02 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:18.701435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd2c7f-ec37-4bcb-bde5-722f23f7f8d2 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:18.734283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7043b-9014-40f1-99b8-59586b009b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:18.735155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7043b-9014-40f1-99b8-59586b009b01 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:18.735442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7043b-9014-40f1-99b8-59586b009b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:18.735751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7043b-9014-40f1-99b8-59586b009b01 None admin] PATH_INFO: `/v3/users/3058449ec8824214b72208846e9a93f3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:18.736940 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7043b-9014-40f1-99b8-59586b009b01 None admin] RBAC: Authorizing `identity:get_user(user_id=3058449ec8824214b72208846e9a93f3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:18.738445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7043b-9014-40f1-99b8-59586b009b01 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:18.740114 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 45/88] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:18 2022] GET /identity/v3/users/3058449ec8824214b72208846e9a93f3 => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:18.740884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7043b-9014-40f1-99b8-59586b009b01 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:18.771822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adbbba-73b7-40a8-bd1d-bd21e845bb02 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:18.803952 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb6e3a-20f4-43de-9843-4df59d21104d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:18.804739 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb6e3a-20f4-43de-9843-4df59d21104d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:18.805021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb6e3a-20f4-43de-9843-4df59d21104d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:18.805294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb6e3a-20f4-43de-9843-4df59d21104d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:18.806443 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb6e3a-20f4-43de-9843-4df59d21104d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:18.807936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb6e3a-20f4-43de-9843-4df59d21104d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:18.809530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 44/89] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:18.810278 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb6e3a-20f4-43de-9843-4df59d21104d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:18.834543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7043b-9014-40f1-99b8-59586b009b01 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:18.866194 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745d599-c437-4f2f-8e0c-2cbb5a787848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:18.866841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745d599-c437-4f2f-8e0c-2cbb5a787848 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:18.867120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745d599-c437-4f2f-8e0c-2cbb5a787848 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:18.867394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745d599-c437-4f2f-8e0c-2cbb5a787848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:18.868243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745d599-c437-4f2f-8e0c-2cbb5a787848 None admin] RBAC: Adding query filter params (role.id=e613911293e3458c975cbab36cae354d, scope.project.id=37528046958f43e8b9cf2ffd96d3def0, user.id=3058449ec8824214b72208846e9a93f3) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:18.868581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745d599-c437-4f2f-8e0c-2cbb5a787848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:18.870011 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745d599-c437-4f2f-8e0c-2cbb5a787848 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:18.875306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 46/90] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:18 2022] GET /identity/v3/role_assignments?user.id=3058449ec8824214b72208846e9a93f3&scope.project.id=37528046958f43e8b9cf2ffd96d3def0&role.id=e613911293e3458c975cbab36cae354d => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:18.875901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745d599-c437-4f2f-8e0c-2cbb5a787848 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:18.923846 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb6e3a-20f4-43de-9843-4df59d21104d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:18.959478 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469505c2-924d-4b59-aac4-1337ec175886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:18.960404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469505c2-924d-4b59-aac4-1337ec175886 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:18.960692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469505c2-924d-4b59-aac4-1337ec175886 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:18.960970 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469505c2-924d-4b59-aac4-1337ec175886 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:18.962229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469505c2-924d-4b59-aac4-1337ec175886 None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:18.963774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469505c2-924d-4b59-aac4-1337ec175886 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:18.965554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 45/91] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:18 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:18.966348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469505c2-924d-4b59-aac4-1337ec175886 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:18.986857 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745d599-c437-4f2f-8e0c-2cbb5a787848 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:19.021515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef941b3-bf04-45f6-992c-8dab9362d288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:19.022174 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef941b3-bf04-45f6-992c-8dab9362d288 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:19.022463 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef941b3-bf04-45f6-992c-8dab9362d288 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:19.022741 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef941b3-bf04-45f6-992c-8dab9362d288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:19.023574 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef941b3-bf04-45f6-992c-8dab9362d288 None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=37528046958f43e8b9cf2ffd96d3def0, user.id=f95fdce949f547f29f3329fa96fe74ac) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:19.023916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef941b3-bf04-45f6-992c-8dab9362d288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:19.025401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef941b3-bf04-45f6-992c-8dab9362d288 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:19.031247 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 47/92] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:18 2022] GET /identity/v3/role_assignments?user.id=f95fdce949f547f29f3329fa96fe74ac&scope.project.id=37528046958f43e8b9cf2ffd96d3def0&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:19.032118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef941b3-bf04-45f6-992c-8dab9362d288 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:19.078265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469505c2-924d-4b59-aac4-1337ec175886 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:19.130643 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512cee4-4fef-4cd5-b703-a003a6c42696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:19.130643 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512cee4-4fef-4cd5-b703-a003a6c42696 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:19.133995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512cee4-4fef-4cd5-b703-a003a6c42696 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:19.134313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512cee4-4fef-4cd5-b703-a003a6c42696 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:19.156844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef941b3-bf04-45f6-992c-8dab9362d288 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:19.192934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e4e36-7770-4976-91b0-a201daa0ae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:19.193774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e4e36-7770-4976-91b0-a201daa0ae37 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:19.194178 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e4e36-7770-4976-91b0-a201daa0ae37 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:19.194527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e4e36-7770-4976-91b0-a201daa0ae37 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:19.195319 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e4e36-7770-4976-91b0-a201daa0ae37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:19.196981 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e4e36-7770-4976-91b0-a201daa0ae37 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:19.225351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512cee4-4fef-4cd5-b703-a003a6c42696 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:19.226996 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512cee4-4fef-4cd5-b703-a003a6c42696 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:19.227411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 48/93] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:56:19 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:56:19.228627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e4e36-7770-4976-91b0-a201daa0ae37 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:19.341928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e4e36-7770-4976-91b0-a201daa0ae37 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:19.379638 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d75352-349a-411b-af91-6e5d6256d086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:19.380318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d75352-349a-411b-af91-6e5d6256d086 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:19.380601 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d75352-349a-411b-af91-6e5d6256d086 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:19.380878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d75352-349a-411b-af91-6e5d6256d086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:19.381721 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d75352-349a-411b-af91-6e5d6256d086 None admin] RBAC: Adding query filter params (role.id=f47d350de184449f9ce5e84ebe7753da, scope.project.id=37528046958f43e8b9cf2ffd96d3def0, user.id=3058449ec8824214b72208846e9a93f3) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:19.382036 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d75352-349a-411b-af91-6e5d6256d086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:19.383525 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d75352-349a-411b-af91-6e5d6256d086 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:19.389879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 49/94] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:19 2022] GET /identity/v3/role_assignments?user.id=3058449ec8824214b72208846e9a93f3&scope.project.id=37528046958f43e8b9cf2ffd96d3def0&role.id=f47d350de184449f9ce5e84ebe7753da => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:19.460344 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 46/95] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:19.466403 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d75352-349a-411b-af91-6e5d6256d086 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:19.602779 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d75352-349a-411b-af91-6e5d6256d086 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:19.639641 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4729b-1d5d-4073-bd31-f388b13eb4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:19.640578 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4729b-1d5d-4073-bd31-f388b13eb4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:19.640859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4729b-1d5d-4073-bd31-f388b13eb4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:19.641133 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4729b-1d5d-4073-bd31-f388b13eb4a5 None admin] PATH_INFO: `/v3/projects/4596cdc79ecc4490b0fe4bc0e183adae` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:19.642346 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4729b-1d5d-4073-bd31-f388b13eb4a5 None admin] RBAC: Authorizing `identity:get_project(project_id=4596cdc79ecc4490b0fe4bc0e183adae)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:19.643931 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4729b-1d5d-4073-bd31-f388b13eb4a5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:19.645742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 50/96] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:19 2022] GET /identity/v3/projects/4596cdc79ecc4490b0fe4bc0e183adae => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:19.651552 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512cee4-4fef-4cd5-b703-a003a6c42696 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:19.763376 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512cee4-4fef-4cd5-b703-a003a6c42696 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:19.802441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09ed57-f689-4d62-ae6e-8909ad23db6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:19.803101 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09ed57-f689-4d62-ae6e-8909ad23db6c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:19.803383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09ed57-f689-4d62-ae6e-8909ad23db6c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:19.803688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09ed57-f689-4d62-ae6e-8909ad23db6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:19.804517 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09ed57-f689-4d62-ae6e-8909ad23db6c None admin] RBAC: Adding query filter params (role.id=e613911293e3458c975cbab36cae354d, scope.project.id=4596cdc79ecc4490b0fe4bc0e183adae, user.id=3058449ec8824214b72208846e9a93f3) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:19.804829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09ed57-f689-4d62-ae6e-8909ad23db6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:19.806277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09ed57-f689-4d62-ae6e-8909ad23db6c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:19.812361 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 47/97] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:19 2022] GET /identity/v3/role_assignments?user.id=3058449ec8824214b72208846e9a93f3&scope.project.id=4596cdc79ecc4490b0fe4bc0e183adae&role.id=e613911293e3458c975cbab36cae354d => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:21.703927 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e092a-fcf2-4ce0-90a1-3d017add2d43 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:21.704472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e092a-fcf2-4ce0-90a1-3d017add2d43 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:21.704472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e092a-fcf2-4ce0-90a1-3d017add2d43 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:21.705855 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 51/98] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:21.711271 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c07c04-4cc0-446b-87df-21441449c2d5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:21.711693 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c07c04-4cc0-446b-87df-21441449c2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:21.711864 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c07c04-4cc0-446b-87df-21441449c2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:21.731270 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b2c07c04-4cc0-446b-87df-21441449c2d5 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:21.732490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b2c07c04-4cc0-446b-87df-21441449c2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:21.800938 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691e5a1-ec9d-4bd4-9d9e-efd7f55dd36a None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:21.801257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691e5a1-ec9d-4bd4-9d9e-efd7f55dd36a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:21.801505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691e5a1-ec9d-4bd4-9d9e-efd7f55dd36a None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:21.803002 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 52/99] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:56:21.808061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e9c9-8e2c-49f4-877a-11b3cf5cafb1 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:21.808350 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e9c9-8e2c-49f4-877a-11b3cf5cafb1 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:21.808633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e9c9-8e2c-49f4-877a-11b3cf5cafb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:21.831470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e702e9c9-8e2c-49f4-877a-11b3cf5cafb1 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:21.832690 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e702e9c9-8e2c-49f4-877a-11b3cf5cafb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:21.838949 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 48/100] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:21.885153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c07c04-4cc0-446b-87df-21441449c2d5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:21.933319 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 53/101] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:21.964539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702e9c9-8e2c-49f4-877a-11b3cf5cafb1 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:22.021533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c07c04-4cc0-446b-87df-21441449c2d5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:22.059321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439648e-a750-48e8-842b-3a612945a34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:22.060537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439648e-a750-48e8-842b-3a612945a34d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:22.061619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439648e-a750-48e8-842b-3a612945a34d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:22.062101 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439648e-a750-48e8-842b-3a612945a34d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:22.088945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439648e-a750-48e8-842b-3a612945a34d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-d439648e-a750-48e8-842b-3a612945a34d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:22.098048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:22.098961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:22.099786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:22.099786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:22.099786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:22.099786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:22.099786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:22.099786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:22.099786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:22.099786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:22.099786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:22.099786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:22.099786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:22.099786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:22.099786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 49/102] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:56:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:56:22.105940 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439648e-a750-48e8-842b-3a612945a34d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:22.200818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702e9c9-8e2c-49f4-877a-11b3cf5cafb1 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:22.278124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439648e-a750-48e8-842b-3a612945a34d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:22.292328 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4331dc-4f8b-4de3-aaea-a801bdc0b931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:22.293149 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4331dc-4f8b-4de3-aaea-a801bdc0b931 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:22.293434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4331dc-4f8b-4de3-aaea-a801bdc0b931 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:22.293710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4331dc-4f8b-4de3-aaea-a801bdc0b931 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:22.320460 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4331dc-4f8b-4de3-aaea-a801bdc0b931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-bd4331dc-4f8b-4de3-aaea-a801bdc0b931 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:22.329103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:22.331442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:22.333412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:22.333412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:22.333412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:22.333412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:22.333412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:22.333412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:22.333412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:22.333412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:22.333412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:22.333412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:22.333412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:22.333412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:22.333412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 54/103] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:56:22.341028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4331dc-4f8b-4de3-aaea-a801bdc0b931 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:22.348487 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fef0be-1877-4331-bf6c-a85eb8c43c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:22.350194 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fef0be-1877-4331-bf6c-a85eb8c43c3a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:22.350482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fef0be-1877-4331-bf6c-a85eb8c43c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:22.350764 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fef0be-1877-4331-bf6c-a85eb8c43c3a None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:22.351530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fef0be-1877-4331-bf6c-a85eb8c43c3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:22.351867 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fef0be-1877-4331-bf6c-a85eb8c43c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:22.353263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fef0be-1877-4331-bf6c-a85eb8c43c3a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:22.372610 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 50/104] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:22.378370 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fef0be-1877-4331-bf6c-a85eb8c43c3a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:22.561850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4331dc-4f8b-4de3-aaea-a801bdc0b931 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:22.569808 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fef0be-1877-4331-bf6c-a85eb8c43c3a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:22.623161 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e628d-ee78-4299-a7e5-a42d6764aaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:22.624091 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e628d-ee78-4299-a7e5-a42d6764aaff None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:22.624427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e628d-ee78-4299-a7e5-a42d6764aaff None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:22.624709 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e628d-ee78-4299-a7e5-a42d6764aaff None admin] PATH_INFO: `/v3/users/f95fdce949f547f29f3329fa96fe74ac` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:22.628332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e628d-ee78-4299-a7e5-a42d6764aaff None admin] RBAC: Authorizing `identity:get_user(user_id=f95fdce949f547f29f3329fa96fe74ac)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:22.629808 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e628d-ee78-4299-a7e5-a42d6764aaff None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:22.631643 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 51/105] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:22 2022] GET /identity/v3/users/f95fdce949f547f29f3329fa96fe74ac => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:22.636564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bba00-dbf0-44cf-a1a8-3af1d8db3b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:22.636917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e628d-ee78-4299-a7e5-a42d6764aaff None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:22.637254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bba00-dbf0-44cf-a1a8-3af1d8db3b24 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:22.637532 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bba00-dbf0-44cf-a1a8-3af1d8db3b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:22.637813 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bba00-dbf0-44cf-a1a8-3af1d8db3b24 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:22.638571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14bba00-dbf0-44cf-a1a8-3af1d8db3b24 None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:22.639416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14bba00-dbf0-44cf-a1a8-3af1d8db3b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:22.640835 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14bba00-dbf0-44cf-a1a8-3af1d8db3b24 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:22.658919 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 55/106] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:22.664969 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bba00-dbf0-44cf-a1a8-3af1d8db3b24 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:22.781673 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bba00-dbf0-44cf-a1a8-3af1d8db3b24 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:22.788486 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e628d-ee78-4299-a7e5-a42d6764aaff None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:22.816601 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be19d68-31d5-4a2b-92b4-85c7a870ea81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:22.817414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19d68-31d5-4a2b-92b4-85c7a870ea81 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:22.817701 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19d68-31d5-4a2b-92b4-85c7a870ea81 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:22.817981 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19d68-31d5-4a2b-92b4-85c7a870ea81 None admin] PATH_INFO: `/v3/users/3058449ec8824214b72208846e9a93f3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:22.819212 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be19d68-31d5-4a2b-92b4-85c7a870ea81 None admin] RBAC: Authorizing `identity:get_user(user_id=3058449ec8824214b72208846e9a93f3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:22.820700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be19d68-31d5-4a2b-92b4-85c7a870ea81 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:22.822342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 56/107] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:22 2022] GET /identity/v3/users/3058449ec8824214b72208846e9a93f3 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:22.823630 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71700c5-2b7f-43f8-a04f-84efc03e9320 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:22.823920 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71700c5-2b7f-43f8-a04f-84efc03e9320 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:22.824200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71700c5-2b7f-43f8-a04f-84efc03e9320 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:22.825697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 57/108] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:22.827669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0a5bf-3633-4da9-906c-32773c72b76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:22.829116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0a5bf-3633-4da9-906c-32773c72b76f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:22.829573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0a5bf-3633-4da9-906c-32773c72b76f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:22.830002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0a5bf-3633-4da9-906c-32773c72b76f None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:22.831310 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949289c4-abb4-4566-8f66-3734cecf8584 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:22.831619 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949289c4-abb4-4566-8f66-3734cecf8584 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:22.831967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949289c4-abb4-4566-8f66-3734cecf8584 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:22.832194 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0a5bf-3633-4da9-906c-32773c72b76f None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:22.837264 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 58/109] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:22.837264 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949289c4-abb4-4566-8f66-3734cecf8584 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:22.837457 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0a5bf-3633-4da9-906c-32773c72b76f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:22.837749 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 52/110] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:22 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:22.838936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3434ff2-27e5-4413-942d-bf9bee93d2f1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:22.839673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3434ff2-27e5-4413-942d-bf9bee93d2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:22.839673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3434ff2-27e5-4413-942d-bf9bee93d2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:22.866888 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b3434ff2-27e5-4413-942d-bf9bee93d2f1 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:22.869143 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b3434ff2-27e5-4413-942d-bf9bee93d2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:22.952246 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949289c4-abb4-4566-8f66-3734cecf8584 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:22.954995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 53/111] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:22.964483 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3434ff2-27e5-4413-942d-bf9bee93d2f1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:22.990756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a15e0d-2482-46c1-9386-b7bae3e88f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:22.992339 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a15e0d-2482-46c1-9386-b7bae3e88f1f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:22.992787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a15e0d-2482-46c1-9386-b7bae3e88f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:22.993201 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a15e0d-2482-46c1-9386-b7bae3e88f1f None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:22.995051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a15e0d-2482-46c1-9386-b7bae3e88f1f None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:22.997010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a15e0d-2482-46c1-9386-b7bae3e88f1f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:23.000361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 59/112] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:22 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:23.002099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800bad8-2e54-4a9f-a29e-12feda4e2a7b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:23.002703 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800bad8-2e54-4a9f-a29e-12feda4e2a7b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:23.003138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800bad8-2e54-4a9f-a29e-12feda4e2a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:23.023940 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5800bad8-2e54-4a9f-a29e-12feda4e2a7b None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:23.025615 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5800bad8-2e54-4a9f-a29e-12feda4e2a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:23.083639 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3434ff2-27e5-4413-942d-bf9bee93d2f1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:23.111632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 60/113] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:23.111632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800bad8-2e54-4a9f-a29e-12feda4e2a7b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:23.131192 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789598e-7819-49fa-a6fd-fd4f9eb326d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:23.132447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789598e-7819-49fa-a6fd-fd4f9eb326d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:23.132870 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789598e-7819-49fa-a6fd-fd4f9eb326d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:23.133297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789598e-7819-49fa-a6fd-fd4f9eb326d0 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0/users/f95fdce949f547f29f3329fa96fe74ac/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:23.144615 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789598e-7819-49fa-a6fd-fd4f9eb326d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=37528046958f43e8b9cf2ffd96d3def0, user_id=f95fdce949f547f29f3329fa96fe74ac, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:23.146304 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789598e-7819-49fa-a6fd-fd4f9eb326d0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:23.170310 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 54/114] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:56:22 2022] PUT /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0/users/f95fdce949f547f29f3329fa96fe74ac/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:56:23.171909 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789598e-7819-49fa-a6fd-fd4f9eb326d0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:23.215966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800bad8-2e54-4a9f-a29e-12feda4e2a7b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:23.258666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce1bb7-f1a0-474d-84ef-3e01456745a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:23.259759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce1bb7-f1a0-474d-84ef-3e01456745a2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:23.260198 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce1bb7-f1a0-474d-84ef-3e01456745a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:23.260661 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce1bb7-f1a0-474d-84ef-3e01456745a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:23.272974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce1bb7-f1a0-474d-84ef-3e01456745a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-c3ce1bb7-f1a0-474d-84ef-3e01456745a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:23.282718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:23.283907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:23.284854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:23.284854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:23.284854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:23.284854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:23.284854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:23.284854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:23.284854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:23.284854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:23.284854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:23.284854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:23.284854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:23.284854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:23.286359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 61/115] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:56:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:23.287351 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce1bb7-f1a0-474d-84ef-3e01456745a2 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:23.317401 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789598e-7819-49fa-a6fd-fd4f9eb326d0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:23.365715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f702e0-b608-4987-a5d0-b78ac50f138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:23.367453 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f702e0-b608-4987-a5d0-b78ac50f138f None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:23.367912 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f702e0-b608-4987-a5d0-b78ac50f138f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:23.368708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f702e0-b608-4987-a5d0-b78ac50f138f None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0/users/3058449ec8824214b72208846e9a93f3/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:23.372257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f702e0-b608-4987-a5d0-b78ac50f138f None admin] RBAC: Authorizing `identity:create_grant(project_id=37528046958f43e8b9cf2ffd96d3def0, user_id=3058449ec8824214b72208846e9a93f3, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:23.374030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f702e0-b608-4987-a5d0-b78ac50f138f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:23.392521 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 55/116] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:56:23 2022] PUT /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0/users/3058449ec8824214b72208846e9a93f3/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:56:23.393854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f702e0-b608-4987-a5d0-b78ac50f138f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:23.443190 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce1bb7-f1a0-474d-84ef-3e01456745a2 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:23.483468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45e1da-ca30-4ac5-9d29-0e58185fe341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:23.484314 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45e1da-ca30-4ac5-9d29-0e58185fe341 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:23.484600 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45e1da-ca30-4ac5-9d29-0e58185fe341 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:23.484878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45e1da-ca30-4ac5-9d29-0e58185fe341 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:23.497500 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45e1da-ca30-4ac5-9d29-0e58185fe341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-0b45e1da-ca30-4ac5-9d29-0e58185fe341 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:23.506751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:23.507786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:23.508834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:23.508834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:23.508834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:23.508834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:23.508834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:23.508834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:23.508834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:23.508834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:23.508834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:23.508834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:23.508834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:23.508834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:23.508834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 62/117] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:23.509693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fd98d-8a01-44c5-9b27-c772bd36052d None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:23.509693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fd98d-8a01-44c5-9b27-c772bd36052d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:23.509970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fd98d-8a01-44c5-9b27-c772bd36052d None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:23.511481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 63/118] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:23.512598 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0c76b-3710-4f05-a771-a974b4ba4b2f None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:23.512811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0c76b-3710-4f05-a771-a974b4ba4b2f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:23.513159 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0c76b-3710-4f05-a771-a974b4ba4b2f None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:23.514767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 64/119] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:23.515548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0c76b-3710-4f05-a771-a974b4ba4b2f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:23.539100 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f702e0-b608-4987-a5d0-b78ac50f138f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:23.579030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b0297-4c33-4fa7-b047-18f33555b01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:23.580197 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b0297-4c33-4fa7-b047-18f33555b01e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:23.580684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b0297-4c33-4fa7-b047-18f33555b01e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:23.581206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b0297-4c33-4fa7-b047-18f33555b01e None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:23.582272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b0297-4c33-4fa7-b047-18f33555b01e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:23.582816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b0297-4c33-4fa7-b047-18f33555b01e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:23.584548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b0297-4c33-4fa7-b047-18f33555b01e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:23.595369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 56/120] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:56:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:23.597149 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7251e9-17b0-4496-901d-6cc0ca42d765 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:23.597614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7251e9-17b0-4496-901d-6cc0ca42d765 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:23.598042 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7251e9-17b0-4496-901d-6cc0ca42d765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:23.618155 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-fc7251e9-17b0-4496-901d-6cc0ca42d765 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:23.619658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fc7251e9-17b0-4496-901d-6cc0ca42d765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:23.649505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0c76b-3710-4f05-a771-a974b4ba4b2f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:23.693982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb62c1e-9363-44c1-90a4-29e046d1a39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:23.694855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 57/121] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:23.695304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb62c1e-9363-44c1-90a4-29e046d1a39d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:23.695778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb62c1e-9363-44c1-90a4-29e046d1a39d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:23.696201 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb62c1e-9363-44c1-90a4-29e046d1a39d None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:23.696335 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aefaab-0e11-46d5-8e12-acbece99cf6e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:23.703522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aefaab-0e11-46d5-8e12-acbece99cf6e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:23.703522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aefaab-0e11-46d5-8e12-acbece99cf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:23.703746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb62c1e-9363-44c1-90a4-29e046d1a39d None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:23.703746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb62c1e-9363-44c1-90a4-29e046d1a39d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:23.703746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb62c1e-9363-44c1-90a4-29e046d1a39d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:23.724328 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 65/122] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:23.725793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb62c1e-9363-44c1-90a4-29e046d1a39d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:23.727066 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f6aefaab-0e11-46d5-8e12-acbece99cf6e None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:23.728275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f6aefaab-0e11-46d5-8e12-acbece99cf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:23.804581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 58/123] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:23.805524 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aefaab-0e11-46d5-8e12-acbece99cf6e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:23.835706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb62c1e-9363-44c1-90a4-29e046d1a39d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:23.873623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91662d39-1db8-4c6c-a3a9-c848a3526b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:23.875585 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91662d39-1db8-4c6c-a3a9-c848a3526b01 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:23.876128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91662d39-1db8-4c6c-a3a9-c848a3526b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:23.876614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91662d39-1db8-4c6c-a3a9-c848a3526b01 None admin] PATH_INFO: `/v3/users/3058449ec8824214b72208846e9a93f3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:23.878055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91662d39-1db8-4c6c-a3a9-c848a3526b01 None admin] RBAC: Authorizing `identity:get_user(user_id=3058449ec8824214b72208846e9a93f3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:23.879763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91662d39-1db8-4c6c-a3a9-c848a3526b01 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:23.881727 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 66/124] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:23 2022] GET /identity/v3/users/3058449ec8824214b72208846e9a93f3 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:23.887045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91662d39-1db8-4c6c-a3a9-c848a3526b01 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:23.925691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aefaab-0e11-46d5-8e12-acbece99cf6e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:23.968751 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280fc4c-1a2c-4aea-8604-12f32a65a29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:23.969837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280fc4c-1a2c-4aea-8604-12f32a65a29b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:23.969837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280fc4c-1a2c-4aea-8604-12f32a65a29b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:23.970133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280fc4c-1a2c-4aea-8604-12f32a65a29b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:23.983425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280fc4c-1a2c-4aea-8604-12f32a65a29b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-e280fc4c-1a2c-4aea-8604-12f32a65a29b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:23.993200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:23.994073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:23.994843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:23.994843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:23.994843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:23.994843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:23.994843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:23.994843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:23.994843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:23.994843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:23.994843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:23.994843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:23.994843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:23.994843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:23.996683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91662d39-1db8-4c6c-a3a9-c848a3526b01 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:24.003186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 59/125] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:24.004384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280fc4c-1a2c-4aea-8604-12f32a65a29b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:24.039095 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffde512-13b2-42f6-8d32-26254fd1ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:24.040171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffde512-13b2-42f6-8d32-26254fd1ce44 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:24.040513 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffde512-13b2-42f6-8d32-26254fd1ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:24.040801 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffde512-13b2-42f6-8d32-26254fd1ce44 None admin] PATH_INFO: `/v3/users/3058449ec8824214b72208846e9a93f3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:24.042930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffde512-13b2-42f6-8d32-26254fd1ce44 None admin] RBAC: Authorizing `identity:get_user(user_id=3058449ec8824214b72208846e9a93f3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:24.044415 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffde512-13b2-42f6-8d32-26254fd1ce44 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:24.046335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 67/126] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:23 2022] GET /identity/v3/users/3058449ec8824214b72208846e9a93f3 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:24.047019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffde512-13b2-42f6-8d32-26254fd1ce44 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:24.115970 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280fc4c-1a2c-4aea-8604-12f32a65a29b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:24.158597 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b905440-7609-4073-b804-b7660c15e760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:24.160222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b905440-7609-4073-b804-b7660c15e760 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:24.160719 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b905440-7609-4073-b804-b7660c15e760 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:24.161462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b905440-7609-4073-b804-b7660c15e760 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:24.163339 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b905440-7609-4073-b804-b7660c15e760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:24.165623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b905440-7609-4073-b804-b7660c15e760 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:24.168232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 60/127] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:24.169741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b905440-7609-4073-b804-b7660c15e760 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:24.172712 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffde512-13b2-42f6-8d32-26254fd1ce44 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:24.215248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c287b-c8a0-40d2-90e3-5bb561901ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:24.216263 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c287b-c8a0-40d2-90e3-5bb561901ecf None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:24.216622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c287b-c8a0-40d2-90e3-5bb561901ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:24.217669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c287b-c8a0-40d2-90e3-5bb561901ecf None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:24.218982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c287b-c8a0-40d2-90e3-5bb561901ecf None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:24.220703 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c287b-c8a0-40d2-90e3-5bb561901ecf None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:24.227644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 68/128] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:24 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:24.227644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c287b-c8a0-40d2-90e3-5bb561901ecf None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:24.288489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b905440-7609-4073-b804-b7660c15e760 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:24.323922 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de53fd8-e83b-491d-a7b9-aa83aa04aedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:24.324800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de53fd8-e83b-491d-a7b9-aa83aa04aedf None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:24.324927 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de53fd8-e83b-491d-a7b9-aa83aa04aedf None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:24.325207 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de53fd8-e83b-491d-a7b9-aa83aa04aedf None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:24.325993 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de53fd8-e83b-491d-a7b9-aa83aa04aedf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:24.326909 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de53fd8-e83b-491d-a7b9-aa83aa04aedf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:24.328236 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de53fd8-e83b-491d-a7b9-aa83aa04aedf None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:24.334806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c287b-c8a0-40d2-90e3-5bb561901ecf None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:24.340907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 61/129] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:24.340907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de53fd8-e83b-491d-a7b9-aa83aa04aedf None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:24.376511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc73d53-11da-4c8b-aa34-6c4acdf48b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:24.377743 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc73d53-11da-4c8b-aa34-6c4acdf48b80 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:24.378231 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc73d53-11da-4c8b-aa34-6c4acdf48b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:24.378719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc73d53-11da-4c8b-aa34-6c4acdf48b80 None admin] PATH_INFO: `/v3/projects/4596cdc79ecc4490b0fe4bc0e183adae` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:24.380150 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc73d53-11da-4c8b-aa34-6c4acdf48b80 None admin] RBAC: Authorizing `identity:get_project(project_id=4596cdc79ecc4490b0fe4bc0e183adae)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:24.381827 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc73d53-11da-4c8b-aa34-6c4acdf48b80 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:24.384062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 69/130] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:24 2022] GET /identity/v3/projects/4596cdc79ecc4490b0fe4bc0e183adae => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:24.385215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc73d53-11da-4c8b-aa34-6c4acdf48b80 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:24.453920 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de53fd8-e83b-491d-a7b9-aa83aa04aedf None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:24.491210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db00465-7e68-4927-af4a-9e483e05f65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:24.492339 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db00465-7e68-4927-af4a-9e483e05f65e None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:24.492849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db00465-7e68-4927-af4a-9e483e05f65e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:24.493370 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db00465-7e68-4927-af4a-9e483e05f65e None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:24.494341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db00465-7e68-4927-af4a-9e483e05f65e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:24.496061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db00465-7e68-4927-af4a-9e483e05f65e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:24.506258 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc73d53-11da-4c8b-aa34-6c4acdf48b80 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:24.531653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 62/131] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 16:56:24 2022] POST /identity/v3/projects => generated 302 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:56:24.532882 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db00465-7e68-4927-af4a-9e483e05f65e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:24.544271 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334dc2bf-ead7-4649-8c52-41000d4d20e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:24.546168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dc2bf-ead7-4649-8c52-41000d4d20e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:24.547019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dc2bf-ead7-4649-8c52-41000d4d20e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:24.547376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dc2bf-ead7-4649-8c52-41000d4d20e3 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0/users/3058449ec8824214b72208846e9a93f3/roles/f47d350de184449f9ce5e84ebe7753da` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:24.550028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334dc2bf-ead7-4649-8c52-41000d4d20e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=37528046958f43e8b9cf2ffd96d3def0, user_id=3058449ec8824214b72208846e9a93f3, role_id=f47d350de184449f9ce5e84ebe7753da)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:24.552033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334dc2bf-ead7-4649-8c52-41000d4d20e3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:24.586046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 70/132] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:56:24 2022] PUT /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0/users/3058449ec8824214b72208846e9a93f3/roles/f47d350de184449f9ce5e84ebe7753da => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:56:24.586779 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334dc2bf-ead7-4649-8c52-41000d4d20e3 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:24.742047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db00465-7e68-4927-af4a-9e483e05f65e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:24.815939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991aeca1-f848-4bb5-84c2-80386dad5273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:24.816841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991aeca1-f848-4bb5-84c2-80386dad5273 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:24.817126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991aeca1-f848-4bb5-84c2-80386dad5273 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:24.817406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991aeca1-f848-4bb5-84c2-80386dad5273 None admin] PATH_INFO: `/v3/users/4d002d83065940b49455729b85f81281` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:24.825789 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334dc2bf-ead7-4649-8c52-41000d4d20e3 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:24.835394 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991aeca1-f848-4bb5-84c2-80386dad5273 None admin] RBAC: Authorizing `identity:get_user(user_id=4d002d83065940b49455729b85f81281)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:24.836992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991aeca1-f848-4bb5-84c2-80386dad5273 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:24.838752 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 63/133] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:24 2022] GET /identity/v3/users/4d002d83065940b49455729b85f81281 => generated 289 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:24.845222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991aeca1-f848-4bb5-84c2-80386dad5273 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:24.897912 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747873d-ce94-4c7e-aaed-83a943a4f995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:24.898820 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747873d-ce94-4c7e-aaed-83a943a4f995 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:24.899105 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747873d-ce94-4c7e-aaed-83a943a4f995 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:24.899387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747873d-ce94-4c7e-aaed-83a943a4f995 None admin] PATH_INFO: `/v3/projects/4596cdc79ecc4490b0fe4bc0e183adae/users/3058449ec8824214b72208846e9a93f3/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:24.902979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747873d-ce94-4c7e-aaed-83a943a4f995 None admin] RBAC: Authorizing `identity:create_grant(project_id=4596cdc79ecc4490b0fe4bc0e183adae, user_id=3058449ec8824214b72208846e9a93f3, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:24.904608 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747873d-ce94-4c7e-aaed-83a943a4f995 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:24.927417 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 71/134] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:56:24 2022] PUT /identity/v3/projects/4596cdc79ecc4490b0fe4bc0e183adae/users/3058449ec8824214b72208846e9a93f3/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:56:24.994824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991aeca1-f848-4bb5-84c2-80386dad5273 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:25.035919 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc88f64-5a4e-44fc-88ab-f8f4279cb02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:25.036651 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc88f64-5a4e-44fc-88ab-f8f4279cb02d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:25.036935 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc88f64-5a4e-44fc-88ab-f8f4279cb02d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:25.037210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc88f64-5a4e-44fc-88ab-f8f4279cb02d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:25.117229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc88f64-5a4e-44fc-88ab-f8f4279cb02d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:25.118713 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc88f64-5a4e-44fc-88ab-f8f4279cb02d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:25.221362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 64/135] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:25.226758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747873d-ce94-4c7e-aaed-83a943a4f995 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:25.354245 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747873d-ce94-4c7e-aaed-83a943a4f995 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:25.390590 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176a297-1fd2-4345-be27-854275383f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:25.391468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176a297-1fd2-4345-be27-854275383f57 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:25.391812 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176a297-1fd2-4345-be27-854275383f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:25.392095 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176a297-1fd2-4345-be27-854275383f57 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:25.393293 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176a297-1fd2-4345-be27-854275383f57 None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:25.394753 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176a297-1fd2-4345-be27-854275383f57 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:25.396479 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 72/136] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:25 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:25.405279 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc88f64-5a4e-44fc-88ab-f8f4279cb02d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:25.548657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc88f64-5a4e-44fc-88ab-f8f4279cb02d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:25.600316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1affb6-195b-44c6-9908-d4490e2b6770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:25.600979 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1affb6-195b-44c6-9908-d4490e2b6770 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:25.601261 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1affb6-195b-44c6-9908-d4490e2b6770 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:25.601540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1affb6-195b-44c6-9908-d4490e2b6770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:25.602369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1affb6-195b-44c6-9908-d4490e2b6770 None admin] RBAC: Adding query filter params (role.id=b216a326d0f24273b3cceab46bd3e208, scope.project.id=37528046958f43e8b9cf2ffd96d3def0, user.id=4d002d83065940b49455729b85f81281) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:25.602681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1affb6-195b-44c6-9908-d4490e2b6770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:25.604163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1affb6-195b-44c6-9908-d4490e2b6770 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:25.616054 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 65/137] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:25 2022] GET /identity/v3/role_assignments?user.id=4d002d83065940b49455729b85f81281&scope.project.id=37528046958f43e8b9cf2ffd96d3def0&role.id=b216a326d0f24273b3cceab46bd3e208 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:26.219191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c36310-fc5e-4300-adc1-87946ec3a2f3 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:26.219717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c36310-fc5e-4300-adc1-87946ec3a2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:26.219790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c36310-fc5e-4300-adc1-87946ec3a2f3 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:26.221158 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 73/138] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:26.222735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a60bae-5706-4dd7-b1b8-accddf63d6d1 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:26.223110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a60bae-5706-4dd7-b1b8-accddf63d6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:26.223303 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a60bae-5706-4dd7-b1b8-accddf63d6d1 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:26.224684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 66/139] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:26.229596 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3920aa2-c2a3-469f-8715-6083d09fc3e3 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:26.229886 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3920aa2-c2a3-469f-8715-6083d09fc3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:26.230169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3920aa2-c2a3-469f-8715-6083d09fc3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:26.235997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f61655-beef-41c1-bf17-0251a5f1f146 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:26.236290 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f61655-beef-41c1-bf17-0251a5f1f146 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:26.236572 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f61655-beef-41c1-bf17-0251a5f1f146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:26.260158 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f3920aa2-c2a3-469f-8715-6083d09fc3e3 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:26.261717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f3920aa2-c2a3-469f-8715-6083d09fc3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:26.273624 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-05f61655-beef-41c1-bf17-0251a5f1f146 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:26.274808 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-05f61655-beef-41c1-bf17-0251a5f1f146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:26.353181 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 74/140] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:26.392352 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3920aa2-c2a3-469f-8715-6083d09fc3e3 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:26.457260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 67/141] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:26.501151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f61655-beef-41c1-bf17-0251a5f1f146 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:26.517511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3920aa2-c2a3-469f-8715-6083d09fc3e3 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:26.563729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41fcd9-606f-4350-a66d-905f9e3fcbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:26.564870 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41fcd9-606f-4350-a66d-905f9e3fcbee None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:26.565237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41fcd9-606f-4350-a66d-905f9e3fcbee None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:26.565437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41fcd9-606f-4350-a66d-905f9e3fcbee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:26.591128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41fcd9-606f-4350-a66d-905f9e3fcbee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-9c41fcd9-606f-4350-a66d-905f9e3fcbee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:26.599468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:26.601172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:26.602696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:26.602696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:26.602696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:26.602696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:26.602696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:26.602696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:26.602696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:26.602696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:26.602696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:26.602696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:26.602696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:26.602696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:26.602696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 75/142] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:56:26.606697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41fcd9-606f-4350-a66d-905f9e3fcbee None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:26.665992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f61655-beef-41c1-bf17-0251a5f1f146 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:26.706670 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41fcd9-606f-4350-a66d-905f9e3fcbee None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:26.717516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff39443-f0bc-4dd9-a979-fa22f8b80037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:26.718329 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff39443-f0bc-4dd9-a979-fa22f8b80037 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:26.718606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff39443-f0bc-4dd9-a979-fa22f8b80037 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:26.718876 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff39443-f0bc-4dd9-a979-fa22f8b80037 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:26.747334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff39443-f0bc-4dd9-a979-fa22f8b80037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:26.755310 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9064ec7-63b1-4557-bd16-e615dfc517f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:26.756043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9064ec7-63b1-4557-bd16-e615dfc517f1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:26.756376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9064ec7-63b1-4557-bd16-e615dfc517f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:26.756656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9064ec7-63b1-4557-bd16-e615dfc517f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:26.757403 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9064ec7-63b1-4557-bd16-e615dfc517f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:26.757764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9064ec7-63b1-4557-bd16-e615dfc517f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:26.759154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9064ec7-63b1-4557-bd16-e615dfc517f1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-2ff39443-f0bc-4dd9-a979-fa22f8b80037 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:26.763733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:26.764562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:26.765406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:26.765406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:26.765406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:26.765406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:26.765406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:26.765406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:26.765406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:26.765406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:26.765406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:26.765406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:26.765406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:26.765406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:26.767997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 68/143] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:56:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:26.772970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 76/144] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:26.776730 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff39443-f0bc-4dd9-a979-fa22f8b80037 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:26.783506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9064ec7-63b1-4557-bd16-e615dfc517f1 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:26.968016 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff39443-f0bc-4dd9-a979-fa22f8b80037 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:27.030414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e064867-ca5f-463d-8bf1-21edbdb14b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:27.031045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9064ec7-63b1-4557-bd16-e615dfc517f1 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:27.031154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e064867-ca5f-463d-8bf1-21edbdb14b7e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:27.031369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e064867-ca5f-463d-8bf1-21edbdb14b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:27.031663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e064867-ca5f-463d-8bf1-21edbdb14b7e None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:27.032420 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e064867-ca5f-463d-8bf1-21edbdb14b7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:27.032889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e064867-ca5f-463d-8bf1-21edbdb14b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:27.034299 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e064867-ca5f-463d-8bf1-21edbdb14b7e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:27.052060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 69/145] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:27.058087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e064867-ca5f-463d-8bf1-21edbdb14b7e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:27.097860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebdc23-cf68-4655-995c-26e02e859cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:27.098753 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebdc23-cf68-4655-995c-26e02e859cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:27.099096 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebdc23-cf68-4655-995c-26e02e859cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:27.099382 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebdc23-cf68-4655-995c-26e02e859cd3 None admin] PATH_INFO: `/v3/users/3058449ec8824214b72208846e9a93f3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:27.104338 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebdc23-cf68-4655-995c-26e02e859cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=3058449ec8824214b72208846e9a93f3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:27.105811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebdc23-cf68-4655-995c-26e02e859cd3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:27.108058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 77/146] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:26 2022] GET /identity/v3/users/3058449ec8824214b72208846e9a93f3 => generated 275 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:27.117125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebdc23-cf68-4655-995c-26e02e859cd3 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:27.252161 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e064867-ca5f-463d-8bf1-21edbdb14b7e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:27.287572 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebdc23-cf68-4655-995c-26e02e859cd3 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:27.324843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe9653-594b-48b0-84b6-8765bcf6df37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:27.325967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe9653-594b-48b0-84b6-8765bcf6df37 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:27.326965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe9653-594b-48b0-84b6-8765bcf6df37 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:27.327379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe9653-594b-48b0-84b6-8765bcf6df37 None admin] PATH_INFO: `/v3/users/f95fdce949f547f29f3329fa96fe74ac` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:27.332320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe9653-594b-48b0-84b6-8765bcf6df37 None admin] RBAC: Authorizing `identity:get_user(user_id=f95fdce949f547f29f3329fa96fe74ac)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:27.334068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe9653-594b-48b0-84b6-8765bcf6df37 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:27.335878 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 70/147] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:27 2022] GET /identity/v3/users/f95fdce949f547f29f3329fa96fe74ac => generated 247 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:27.341419 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe9653-594b-48b0-84b6-8765bcf6df37 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:27.352370 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68a41a-6193-4981-b5d3-a9e13a6932b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:27.353037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68a41a-6193-4981-b5d3-a9e13a6932b3 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:27.353326 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68a41a-6193-4981-b5d3-a9e13a6932b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:27.353601 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68a41a-6193-4981-b5d3-a9e13a6932b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:27.473118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68a41a-6193-4981-b5d3-a9e13a6932b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:27.474614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68a41a-6193-4981-b5d3-a9e13a6932b3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:27.527269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe9653-594b-48b0-84b6-8765bcf6df37 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:27.609041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f292329-26d5-4388-ad26-37c464a8ed9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:27.609732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f292329-26d5-4388-ad26-37c464a8ed9a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:27.610024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f292329-26d5-4388-ad26-37c464a8ed9a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:27.610308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f292329-26d5-4388-ad26-37c464a8ed9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:27.684479 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 78/148] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:27.692350 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68a41a-6193-4981-b5d3-a9e13a6932b3 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:27.760874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f292329-26d5-4388-ad26-37c464a8ed9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:27.762391 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f292329-26d5-4388-ad26-37c464a8ed9a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:27.887370 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68a41a-6193-4981-b5d3-a9e13a6932b3 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:27.940588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0f6ee-7cc0-45b7-aa76-96085b79d32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:27.941460 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0f6ee-7cc0-45b7-aa76-96085b79d32c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:27.941745 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0f6ee-7cc0-45b7-aa76-96085b79d32c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:27.942025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0f6ee-7cc0-45b7-aa76-96085b79d32c None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:27.944418 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0f6ee-7cc0-45b7-aa76-96085b79d32c None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:27.945879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0f6ee-7cc0-45b7-aa76-96085b79d32c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:27.947570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 79/149] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:27 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:27.956023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e44ec-a3f7-409f-9006-018eefc919eb None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:27.956313 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e44ec-a3f7-409f-9006-018eefc919eb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:27.956595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e44ec-a3f7-409f-9006-018eefc919eb None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:27.963747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 80/150] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:27 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:27.964521 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e44ec-a3f7-409f-9006-018eefc919eb None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:27.984558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 71/151] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 16:56:27.985876 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a314178-7c63-4bac-8623-b61b0f5170cd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:27.986169 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a314178-7c63-4bac-8623-b61b0f5170cd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:27.986449 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a314178-7c63-4bac-8623-b61b0f5170cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:28.018038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8a314178-7c63-4bac-8623-b61b0f5170cd None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:28.020516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8a314178-7c63-4bac-8623-b61b0f5170cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:28.100254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e44ec-a3f7-409f-9006-018eefc919eb None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:28.108193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 72/152] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:28.109633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a314178-7c63-4bac-8623-b61b0f5170cd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:28.154624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6c73f-16a7-4c51-b6f1-022ad9efae76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:28.155393 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6c73f-16a7-4c51-b6f1-022ad9efae76 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:28.155796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6c73f-16a7-4c51-b6f1-022ad9efae76 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:28.156146 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6c73f-16a7-4c51-b6f1-022ad9efae76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:28.157062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6c73f-16a7-4c51-b6f1-022ad9efae76 None admin] RBAC: Adding query filter params (role.id=e613911293e3458c975cbab36cae354d, scope.project.id=37528046958f43e8b9cf2ffd96d3def0, user.id=3058449ec8824214b72208846e9a93f3) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:28.157464 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6c73f-16a7-4c51-b6f1-022ad9efae76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:28.159006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6c73f-16a7-4c51-b6f1-022ad9efae76 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:28.167552 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 81/153] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:27 2022] GET /identity/v3/role_assignments?user.id=3058449ec8824214b72208846e9a93f3&scope.project.id=37528046958f43e8b9cf2ffd96d3def0&role.id=e613911293e3458c975cbab36cae354d => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:28.169302 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a678909-7dea-4a29-9152-bee1e503c42b None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:28.169640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a678909-7dea-4a29-9152-bee1e503c42b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:28.169988 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a678909-7dea-4a29-9152-bee1e503c42b None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:28.171830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 82/154] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:28.172761 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a678909-7dea-4a29-9152-bee1e503c42b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:28.282216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a314178-7c63-4bac-8623-b61b0f5170cd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:28.326799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef8071-cb8b-4baf-940b-54c042a8e103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:28.327948 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef8071-cb8b-4baf-940b-54c042a8e103 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:28.328471 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef8071-cb8b-4baf-940b-54c042a8e103 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:28.328969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef8071-cb8b-4baf-940b-54c042a8e103 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:28.338037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef8071-cb8b-4baf-940b-54c042a8e103 None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:28.338456 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef8071-cb8b-4baf-940b-54c042a8e103 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:28.340426 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 73/155] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:28 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:28.342950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953b1de-7744-44db-9f97-15c3e680be15 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:28.343489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953b1de-7744-44db-9f97-15c3e680be15 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:28.344013 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953b1de-7744-44db-9f97-15c3e680be15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:28.363124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b953b1de-7744-44db-9f97-15c3e680be15 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:28.364690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b953b1de-7744-44db-9f97-15c3e680be15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:28.408474 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a678909-7dea-4a29-9152-bee1e503c42b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:28.446883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 74/156] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:28.453854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa78dd7-7a2c-489f-8dd0-5f23f8a8d977 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:28.454156 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa78dd7-7a2c-489f-8dd0-5f23f8a8d977 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:28.454447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa78dd7-7a2c-489f-8dd0-5f23f8a8d977 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:28.455995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 75/157] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:28.456628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa78dd7-7a2c-489f-8dd0-5f23f8a8d977 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:28.501548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275f9c7-17c9-4b5b-a618-55e909988b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:28.502371 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f9c7-17c9-4b5b-a618-55e909988b6d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:28.502653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f9c7-17c9-4b5b-a618-55e909988b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:28.502923 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f9c7-17c9-4b5b-a618-55e909988b6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:28.518159 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275f9c7-17c9-4b5b-a618-55e909988b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-a275f9c7-17c9-4b5b-a618-55e909988b6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:28.528443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:28.530051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:28.531151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:28.531151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:28.531151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:28.531151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:28.531151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:28.531151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:28.531151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:28.531151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:28.531151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:28.531151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:28.531151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:28.531151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:28.533245 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 83/158] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:56:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:28.535283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86570f86-aae5-42c1-9818-b43ecc71c9c6 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:28.535572 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86570f86-aae5-42c1-9818-b43ecc71c9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:28.539646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86570f86-aae5-42c1-9818-b43ecc71c9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:28.557890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-86570f86-aae5-42c1-9818-b43ecc71c9c6 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:28.559413 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-86570f86-aae5-42c1-9818-b43ecc71c9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:28.629996 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa78dd7-7a2c-489f-8dd0-5f23f8a8d977 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:28.644354 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 84/159] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:28.656743 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86570f86-aae5-42c1-9818-b43ecc71c9c6 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:28.668894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038be8a3-d3b9-4ce3-b88a-164157ce3b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:28.669840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038be8a3-d3b9-4ce3-b88a-164157ce3b88 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:28.670297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038be8a3-d3b9-4ce3-b88a-164157ce3b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:28.670804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038be8a3-d3b9-4ce3-b88a-164157ce3b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:28.671839 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038be8a3-d3b9-4ce3-b88a-164157ce3b88 None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=37528046958f43e8b9cf2ffd96d3def0, user.id=f95fdce949f547f29f3329fa96fe74ac) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:28.672353 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038be8a3-d3b9-4ce3-b88a-164157ce3b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:28.674092 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038be8a3-d3b9-4ce3-b88a-164157ce3b88 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:28.680519 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 76/160] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:28 2022] GET /identity/v3/role_assignments?user.id=f95fdce949f547f29f3329fa96fe74ac&scope.project.id=37528046958f43e8b9cf2ffd96d3def0&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:28.681490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038be8a3-d3b9-4ce3-b88a-164157ce3b88 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:28.802675 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86570f86-aae5-42c1-9818-b43ecc71c9c6 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:28.844483 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c7134-ace0-432f-ac9d-15fdd88b69db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:28.845303 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c7134-ace0-432f-ac9d-15fdd88b69db None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:28.845583 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c7134-ace0-432f-ac9d-15fdd88b69db None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:28.845859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c7134-ace0-432f-ac9d-15fdd88b69db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:28.847092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c7134-ace0-432f-ac9d-15fdd88b69db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:28.848634 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c7134-ace0-432f-ac9d-15fdd88b69db None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:28.855088 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 85/161] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:28.856155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c7134-ace0-432f-ac9d-15fdd88b69db None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:28.877596 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038be8a3-d3b9-4ce3-b88a-164157ce3b88 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:28.921831 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba6771-02bb-4ac0-9c38-fac84503b165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:28.922435 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba6771-02bb-4ac0-9c38-fac84503b165 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:28.922717 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba6771-02bb-4ac0-9c38-fac84503b165 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:28.922987 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba6771-02bb-4ac0-9c38-fac84503b165 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:28.923908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba6771-02bb-4ac0-9c38-fac84503b165 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:28.924168 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba6771-02bb-4ac0-9c38-fac84503b165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:28.925596 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba6771-02bb-4ac0-9c38-fac84503b165 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:28.939627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 77/162] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:56:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:28.939627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba6771-02bb-4ac0-9c38-fac84503b165 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:28.973465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c7134-ace0-432f-ac9d-15fdd88b69db None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:29.010974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4032311-b7de-4a85-bf04-859ed1a664f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:29.011824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4032311-b7de-4a85-bf04-859ed1a664f7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:29.012105 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4032311-b7de-4a85-bf04-859ed1a664f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:29.012374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4032311-b7de-4a85-bf04-859ed1a664f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:29.022785 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4032311-b7de-4a85-bf04-859ed1a664f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-b4032311-b7de-4a85-bf04-859ed1a664f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:29.030492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:29.031452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:29.037656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:29.037656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:29.037656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:29.037656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:29.037656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:29.037656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:29.037656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:29.037656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:29.037656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:29.037656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:29.037656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:29.037656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:29.037656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 86/163] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:29.037656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9fe19-a69f-44af-beee-c490ec6e9683 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:29.038334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9fe19-a69f-44af-beee-c490ec6e9683 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:29.038334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9fe19-a69f-44af-beee-c490ec6e9683 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:29.038334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 87/164] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:29.038334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9fe19-a69f-44af-beee-c490ec6e9683 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:29.039550 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba6771-02bb-4ac0-9c38-fac84503b165 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:29.071774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c08aa-602a-46a5-87cd-57afbf54a63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:29.072435 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c08aa-602a-46a5-87cd-57afbf54a63f None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:29.072716 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c08aa-602a-46a5-87cd-57afbf54a63f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:29.072992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c08aa-602a-46a5-87cd-57afbf54a63f None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:29.073690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c08aa-602a-46a5-87cd-57afbf54a63f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:29.075140 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c08aa-602a-46a5-87cd-57afbf54a63f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:29.097352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 78/165] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:56:28 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:56:29.098178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c08aa-602a-46a5-87cd-57afbf54a63f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:29.141562 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9fe19-a69f-44af-beee-c490ec6e9683 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:29.177088 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7d5f4-73b7-437d-8b0f-8e4a01450c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:29.178333 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7d5f4-73b7-437d-8b0f-8e4a01450c18 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:29.178679 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7d5f4-73b7-437d-8b0f-8e4a01450c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:29.179032 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7d5f4-73b7-437d-8b0f-8e4a01450c18 None admin] PATH_INFO: `/v3/users/3058449ec8824214b72208846e9a93f3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:29.180349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7d5f4-73b7-437d-8b0f-8e4a01450c18 None admin] RBAC: Authorizing `identity:get_user(user_id=3058449ec8824214b72208846e9a93f3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:29.181833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7d5f4-73b7-437d-8b0f-8e4a01450c18 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:29.183729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 88/166] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:29 2022] GET /identity/v3/users/3058449ec8824214b72208846e9a93f3 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:29.184942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42be1c3-1bd0-4d5a-9fc0-0b1cbfe77eff None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:29.185234 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42be1c3-1bd0-4d5a-9fc0-0b1cbfe77eff None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:29.186040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42be1c3-1bd0-4d5a-9fc0-0b1cbfe77eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:29.203367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a42be1c3-1bd0-4d5a-9fc0-0b1cbfe77eff None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:29.204721 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a42be1c3-1bd0-4d5a-9fc0-0b1cbfe77eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:29.215827 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c08aa-602a-46a5-87cd-57afbf54a63f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:29.253577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d1e15-0730-493c-9372-27d534432303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:29.254256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d1e15-0730-493c-9372-27d534432303 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:29.254538 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d1e15-0730-493c-9372-27d534432303 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:29.254812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d1e15-0730-493c-9372-27d534432303 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:29.255568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d1e15-0730-493c-9372-27d534432303 None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:29.255895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d1e15-0730-493c-9372-27d534432303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:29.257306 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d1e15-0730-493c-9372-27d534432303 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:29.268186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 79/167] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:29.268186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d1e15-0730-493c-9372-27d534432303 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:29.289306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 89/168] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:29.289663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42be1c3-1bd0-4d5a-9fc0-0b1cbfe77eff None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:29.388567 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d1e15-0730-493c-9372-27d534432303 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:29.400588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42be1c3-1bd0-4d5a-9fc0-0b1cbfe77eff None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:29.438928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e9ce3-65b2-45a2-9d06-9df6b770ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:29.439793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9ce3-65b2-45a2-9d06-9df6b770ef6b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:29.440074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9ce3-65b2-45a2-9d06-9df6b770ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:29.440413 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9ce3-65b2-45a2-9d06-9df6b770ef6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:29.441578 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf40d1-1ea3-49b1-8865-4189a0129faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:29.442448 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf40d1-1ea3-49b1-8865-4189a0129faa None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:29.442808 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf40d1-1ea3-49b1-8865-4189a0129faa None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:29.443262 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf40d1-1ea3-49b1-8865-4189a0129faa None admin] PATH_INFO: `/v3/users/3058449ec8824214b72208846e9a93f3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:29.446594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf40d1-1ea3-49b1-8865-4189a0129faa None admin] RBAC: Authorizing `identity:get_user(user_id=3058449ec8824214b72208846e9a93f3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:29.446726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf40d1-1ea3-49b1-8865-4189a0129faa None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:29.448742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 90/169] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:29 2022] GET /identity/v3/users/3058449ec8824214b72208846e9a93f3 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:29.449536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf40d1-1ea3-49b1-8865-4189a0129faa None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:29.522039 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e9ce3-65b2-45a2-9d06-9df6b770ef6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:29.523514 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e9ce3-65b2-45a2-9d06-9df6b770ef6b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:29.559570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf40d1-1ea3-49b1-8865-4189a0129faa None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:29.605877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc235b-2080-41c7-a845-23776e064c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:29.606930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc235b-2080-41c7-a845-23776e064c45 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:29.607949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc235b-2080-41c7-a845-23776e064c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:29.608381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc235b-2080-41c7-a845-23776e064c45 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:29.625408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc235b-2080-41c7-a845-23776e064c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:29.634140 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 80/170] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:29.635128 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e9ce3-65b2-45a2-9d06-9df6b770ef6b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-5ddc235b-2080-41c7-a845-23776e064c45 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:29.635594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:29.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:29.637589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:29.637589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:29.637589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:29.637589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:29.637589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:29.637589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:29.637589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:29.637589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:29.637589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:29.637589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:29.637589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:29.637589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:29.645183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 91/171] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:29.645183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc235b-2080-41c7-a845-23776e064c45 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:29.744782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc235b-2080-41c7-a845-23776e064c45 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:29.761424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e9ce3-65b2-45a2-9d06-9df6b770ef6b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:29.781558 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d05c6-9138-400f-9a80-b61f27c92669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:29.782746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d05c6-9138-400f-9a80-b61f27c92669 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:29.783205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d05c6-9138-400f-9a80-b61f27c92669 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:29.783681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d05c6-9138-400f-9a80-b61f27c92669 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:29.785063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d05c6-9138-400f-9a80-b61f27c92669 None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:29.786764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d05c6-9138-400f-9a80-b61f27c92669 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:29.788687 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 92/172] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:29 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:29.789765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d05c6-9138-400f-9a80-b61f27c92669 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:29.797823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed825c-608b-4473-8820-6b3cf347c94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:29.798489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed825c-608b-4473-8820-6b3cf347c94b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:29.798770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed825c-608b-4473-8820-6b3cf347c94b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:29.799040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed825c-608b-4473-8820-6b3cf347c94b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:29.869452 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed825c-608b-4473-8820-6b3cf347c94b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:29.870988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed825c-608b-4473-8820-6b3cf347c94b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:29.894686 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d05c6-9138-400f-9a80-b61f27c92669 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:29.928892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a0756-5d7e-4a90-b2f2-4bf85af529a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:29.929924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a0756-5d7e-4a90-b2f2-4bf85af529a9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:29.930406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a0756-5d7e-4a90-b2f2-4bf85af529a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:29.930889 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a0756-5d7e-4a90-b2f2-4bf85af529a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:29.931881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a0756-5d7e-4a90-b2f2-4bf85af529a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:29.932389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a0756-5d7e-4a90-b2f2-4bf85af529a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:29.934009 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a0756-5d7e-4a90-b2f2-4bf85af529a9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:29.943421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 93/173] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:29.948801 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a0756-5d7e-4a90-b2f2-4bf85af529a9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:29.978385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 81/174] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:29.978385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed825c-608b-4473-8820-6b3cf347c94b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:30.055769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a0756-5d7e-4a90-b2f2-4bf85af529a9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:30.095068 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51bf12-4395-46c1-93c5-cd87ea9d8def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:30.096047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed825c-608b-4473-8820-6b3cf347c94b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:30.096332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51bf12-4395-46c1-93c5-cd87ea9d8def None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:30.096811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51bf12-4395-46c1-93c5-cd87ea9d8def None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:30.097298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51bf12-4395-46c1-93c5-cd87ea9d8def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:30.098334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51bf12-4395-46c1-93c5-cd87ea9d8def None admin] RBAC: Adding query filter params (role.id=f47d350de184449f9ce5e84ebe7753da, scope.project.id=37528046958f43e8b9cf2ffd96d3def0, user.id=3058449ec8824214b72208846e9a93f3) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:30.098865 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51bf12-4395-46c1-93c5-cd87ea9d8def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:30.100548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51bf12-4395-46c1-93c5-cd87ea9d8def None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:30.107094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 94/175] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:29 2022] GET /identity/v3/role_assignments?user.id=3058449ec8824214b72208846e9a93f3&scope.project.id=37528046958f43e8b9cf2ffd96d3def0&role.id=f47d350de184449f9ce5e84ebe7753da => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:30.108769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51bf12-4395-46c1-93c5-cd87ea9d8def None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:30.184470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608bb23-cc6e-4b99-a39c-b03c491f3b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:30.186512 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608bb23-cc6e-4b99-a39c-b03c491f3b21 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:30.186741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608bb23-cc6e-4b99-a39c-b03c491f3b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:30.186959 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608bb23-cc6e-4b99-a39c-b03c491f3b21 None admin] PATH_INFO: `/v3/users/4d002d83065940b49455729b85f81281` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:30.188401 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608bb23-cc6e-4b99-a39c-b03c491f3b21 None admin] RBAC: Authorizing `identity:get_user(user_id=4d002d83065940b49455729b85f81281)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:30.190169 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608bb23-cc6e-4b99-a39c-b03c491f3b21 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:30.191930 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 82/176] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:29 2022] GET /identity/v3/users/4d002d83065940b49455729b85f81281 => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:30.198055 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608bb23-cc6e-4b99-a39c-b03c491f3b21 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:30.221066 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51bf12-4395-46c1-93c5-cd87ea9d8def None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:30.257152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbf05a-9a3c-43e5-8dd8-cd72cd3c4401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:30.258425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbf05a-9a3c-43e5-8dd8-cd72cd3c4401 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:30.258968 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbf05a-9a3c-43e5-8dd8-cd72cd3c4401 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:30.259456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbf05a-9a3c-43e5-8dd8-cd72cd3c4401 None admin] PATH_INFO: `/v3/projects/4596cdc79ecc4490b0fe4bc0e183adae` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:30.261038 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbf05a-9a3c-43e5-8dd8-cd72cd3c4401 None admin] RBAC: Authorizing `identity:get_project(project_id=4596cdc79ecc4490b0fe4bc0e183adae)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:30.262755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbf05a-9a3c-43e5-8dd8-cd72cd3c4401 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:30.265496 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 95/177] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:30 2022] GET /identity/v3/projects/4596cdc79ecc4490b0fe4bc0e183adae => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:30.271707 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbf05a-9a3c-43e5-8dd8-cd72cd3c4401 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:30.371636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608bb23-cc6e-4b99-a39c-b03c491f3b21 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:30.377070 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbf05a-9a3c-43e5-8dd8-cd72cd3c4401 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:30.416763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228fdbf-0863-45d3-839d-136fd58425f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:30.417641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228fdbf-0863-45d3-839d-136fd58425f4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:30.417891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228fdbf-0863-45d3-839d-136fd58425f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:30.418163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228fdbf-0863-45d3-839d-136fd58425f4 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:30.419341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228fdbf-0863-45d3-839d-136fd58425f4 None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:30.420935 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228fdbf-0863-45d3-839d-136fd58425f4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:30.422693 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 83/178] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:30 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:30.428465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228fdbf-0863-45d3-839d-136fd58425f4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:30.437979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ad464-ce47-4620-95d2-233679e80cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:30.438979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ad464-ce47-4620-95d2-233679e80cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:30.439748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ad464-ce47-4620-95d2-233679e80cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:30.440324 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ad464-ce47-4620-95d2-233679e80cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:30.441348 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ad464-ce47-4620-95d2-233679e80cb7 None admin] RBAC: Adding query filter params (role.id=e613911293e3458c975cbab36cae354d, scope.project.id=4596cdc79ecc4490b0fe4bc0e183adae, user.id=3058449ec8824214b72208846e9a93f3) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:30.441860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ad464-ce47-4620-95d2-233679e80cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:30.443984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ad464-ce47-4620-95d2-233679e80cb7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:30.457679 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 96/179] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:30 2022] GET /identity/v3/role_assignments?user.id=3058449ec8824214b72208846e9a93f3&scope.project.id=4596cdc79ecc4490b0fe4bc0e183adae&role.id=e613911293e3458c975cbab36cae354d => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:30.539916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228fdbf-0863-45d3-839d-136fd58425f4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:30.577893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45846e3e-f1c2-46f2-bcbe-df8b2c0ee365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:30.578804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45846e3e-f1c2-46f2-bcbe-df8b2c0ee365 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:30.579081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45846e3e-f1c2-46f2-bcbe-df8b2c0ee365 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:30.579352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45846e3e-f1c2-46f2-bcbe-df8b2c0ee365 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0/users/4d002d83065940b49455729b85f81281/roles/b216a326d0f24273b3cceab46bd3e208` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:30.581429 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45846e3e-f1c2-46f2-bcbe-df8b2c0ee365 None admin] RBAC: Authorizing `identity:create_grant(project_id=37528046958f43e8b9cf2ffd96d3def0, user_id=4d002d83065940b49455729b85f81281, role_id=b216a326d0f24273b3cceab46bd3e208)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:30.582916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45846e3e-f1c2-46f2-bcbe-df8b2c0ee365 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:30.605009 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 84/180] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:56:30 2022] PUT /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0/users/4d002d83065940b49455729b85f81281/roles/b216a326d0f24273b3cceab46bd3e208 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:56:31.884780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5784-7b94-4117-adb8-ac86a21eca3e None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:31.885832 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5784-7b94-4117-adb8-ac86a21eca3e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:31.886317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5784-7b94-4117-adb8-ac86a21eca3e None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:31.887945 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 97/181] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:31.893153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b1bca-608d-4857-ae49-24d7734d6647 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:31.893994 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b1bca-608d-4857-ae49-24d7734d6647 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:31.894493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b1bca-608d-4857-ae49-24d7734d6647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:31.912033 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b48b1bca-608d-4857-ae49-24d7734d6647 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:31.913538 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b48b1bca-608d-4857-ae49-24d7734d6647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:31.985411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 85/182] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:32.009170 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f5784-7b94-4117-adb8-ac86a21eca3e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:32.124492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f5784-7b94-4117-adb8-ac86a21eca3e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:32.144684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b53c6-19e2-42f5-bca1-10943ea70ff0 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:32.145277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b53c6-19e2-42f5-bca1-10943ea70ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:32.145757 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b53c6-19e2-42f5-bca1-10943ea70ff0 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:32.147328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 86/183] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:32.152474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08688b-4029-4cd9-abaa-11705adb782d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:32.152972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08688b-4029-4cd9-abaa-11705adb782d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:32.153451 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08688b-4029-4cd9-abaa-11705adb782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:32.158635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870e213-f19c-43a8-80b3-3c673f274618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:32.159433 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870e213-f19c-43a8-80b3-3c673f274618 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:32.159743 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870e213-f19c-43a8-80b3-3c673f274618 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:32.160020 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870e213-f19c-43a8-80b3-3c673f274618 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:32.170501 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870e213-f19c-43a8-80b3-3c673f274618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:32.173105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6f08688b-4029-4cd9-abaa-11705adb782d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:32.174470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6f08688b-4029-4cd9-abaa-11705adb782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-e870e213-f19c-43a8-80b3-3c673f274618 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:32.178207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:32.179076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:32.179901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:32.179901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:32.179901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:32.179901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:32.179901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:32.179901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:32.179901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:32.179901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:32.179901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:32.179901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:32.179901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:32.179901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:32.179901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 98/184] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:56:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:32.187459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870e213-f19c-43a8-80b3-3c673f274618 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:32.257540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 87/185] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:32.265672 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b50f6-84f6-4aa9-85b3-5935a5119d55 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:32.265967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b50f6-84f6-4aa9-85b3-5935a5119d55 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:32.266242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b50f6-84f6-4aa9-85b3-5935a5119d55 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:32.267727 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 88/186] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:32.272793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5203ed-1e3e-414b-a262-17ea6b6e04e5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:32.273290 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5203ed-1e3e-414b-a262-17ea6b6e04e5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:32.273743 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5203ed-1e3e-414b-a262-17ea6b6e04e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:32.290899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bc5203ed-1e3e-414b-a262-17ea6b6e04e5 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:32.292111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bc5203ed-1e3e-414b-a262-17ea6b6e04e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:32.299888 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870e213-f19c-43a8-80b3-3c673f274618 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:32.338421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325dc64-755f-4aa1-b872-3fed8e7f2105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:32.339095 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325dc64-755f-4aa1-b872-3fed8e7f2105 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:32.339390 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325dc64-755f-4aa1-b872-3fed8e7f2105 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:32.339679 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325dc64-755f-4aa1-b872-3fed8e7f2105 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:32.340423 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325dc64-755f-4aa1-b872-3fed8e7f2105 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:32.340728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325dc64-755f-4aa1-b872-3fed8e7f2105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:32.342979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325dc64-755f-4aa1-b872-3fed8e7f2105 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:32.350812 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 99/187] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:32.352497 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325dc64-755f-4aa1-b872-3fed8e7f2105 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:32.358432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 89/188] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:32.359529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5203ed-1e3e-414b-a262-17ea6b6e04e5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:32.452748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325dc64-755f-4aa1-b872-3fed8e7f2105 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:32.475783 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5203ed-1e3e-414b-a262-17ea6b6e04e5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:32.487000 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d14c0a-3f75-42f6-b41c-e98b87bea993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:32.487824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14c0a-3f75-42f6-b41c-e98b87bea993 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:32.488104 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14c0a-3f75-42f6-b41c-e98b87bea993 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:32.488378 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14c0a-3f75-42f6-b41c-e98b87bea993 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:32.489540 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d14c0a-3f75-42f6-b41c-e98b87bea993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:32.490965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d14c0a-3f75-42f6-b41c-e98b87bea993 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:32.492754 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 100/189] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:32.496506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d14c0a-3f75-42f6-b41c-e98b87bea993 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:32.513827 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5996081-edd7-4a11-bb81-e2a6870ec8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:32.514696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5996081-edd7-4a11-bb81-e2a6870ec8bb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:32.514978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5996081-edd7-4a11-bb81-e2a6870ec8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:32.515248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5996081-edd7-4a11-bb81-e2a6870ec8bb None admin] PATH_INFO: `/v3/users/a5fc5afa208140d99c9651b6b86d1c8c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:32.528610 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5996081-edd7-4a11-bb81-e2a6870ec8bb None admin] RBAC: Authorizing `identity:get_user(user_id=a5fc5afa208140d99c9651b6b86d1c8c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:32.530111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5996081-edd7-4a11-bb81-e2a6870ec8bb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:32.532001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 90/190] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:32 2022] GET /identity/v3/users/a5fc5afa208140d99c9651b6b86d1c8c => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:32.537024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5996081-edd7-4a11-bb81-e2a6870ec8bb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:32.594057 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d14c0a-3f75-42f6-b41c-e98b87bea993 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:32.627070 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068f45f-c002-44e4-b3fc-4f000187191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:32.628188 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068f45f-c002-44e4-b3fc-4f000187191d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:32.628464 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068f45f-c002-44e4-b3fc-4f000187191d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:32.628745 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068f45f-c002-44e4-b3fc-4f000187191d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:32.634204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5996081-edd7-4a11-bb81-e2a6870ec8bb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:32.639774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068f45f-c002-44e4-b3fc-4f000187191d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d068f45f-c002-44e4-b3fc-4f000187191d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:32.648082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:32.648965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:32.649726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:32.649726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:32.649726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:32.649726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:32.649726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:32.649726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:32.649726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:32.649726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:32.649726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:32.649726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:32.649726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:32.649726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:32.649726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 101/191] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:56:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:32.650367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068f45f-c002-44e4-b3fc-4f000187191d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:32.673889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fb6f9-be6b-4b8a-9750-513e2dc09fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:32.674584 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb6f9-be6b-4b8a-9750-513e2dc09fa6 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:32.674871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb6f9-be6b-4b8a-9750-513e2dc09fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:32.675148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb6f9-be6b-4b8a-9750-513e2dc09fa6 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:32.675880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fb6f9-be6b-4b8a-9750-513e2dc09fa6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:32.677336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fb6f9-be6b-4b8a-9750-513e2dc09fa6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:32.699156 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 91/192] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:56:32 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:56:32.700084 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fb6f9-be6b-4b8a-9750-513e2dc09fa6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:32.786860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068f45f-c002-44e4-b3fc-4f000187191d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:32.814685 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fb6f9-be6b-4b8a-9750-513e2dc09fa6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:32.839380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a4a25-8084-420a-bf2d-4a16140a0348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:32.840606 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a4a25-8084-420a-bf2d-4a16140a0348 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:32.841646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a4a25-8084-420a-bf2d-4a16140a0348 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:32.842580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a4a25-8084-420a-bf2d-4a16140a0348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:32.853000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f3415-76a1-4a84-b6c5-48af337e350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:32.853753 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f3415-76a1-4a84-b6c5-48af337e350d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:32.854088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f3415-76a1-4a84-b6c5-48af337e350d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:32.854371 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f3415-76a1-4a84-b6c5-48af337e350d None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:32.855139 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f3415-76a1-4a84-b6c5-48af337e350d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:32.855447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f3415-76a1-4a84-b6c5-48af337e350d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:32.856970 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f3415-76a1-4a84-b6c5-48af337e350d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:32.876409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 92/193] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:56:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:32.877725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f3415-76a1-4a84-b6c5-48af337e350d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:32.929027 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a4a25-8084-420a-bf2d-4a16140a0348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:32.930516 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a4a25-8084-420a-bf2d-4a16140a0348 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:32.985635 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f3415-76a1-4a84-b6c5-48af337e350d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:33.029928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c15fd-8feb-46db-9c55-c05fe269c752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:33.030927 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c15fd-8feb-46db-9c55-c05fe269c752 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:33.031210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c15fd-8feb-46db-9c55-c05fe269c752 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:33.031484 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c15fd-8feb-46db-9c55-c05fe269c752 None admin] PATH_INFO: `/v3/users/a5fc5afa208140d99c9651b6b86d1c8c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:33.032833 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c15fd-8feb-46db-9c55-c05fe269c752 None admin] RBAC: Authorizing `identity:get_user(user_id=a5fc5afa208140d99c9651b6b86d1c8c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:33.034292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c15fd-8feb-46db-9c55-c05fe269c752 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:33.035982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 102/194] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:33.037962 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e33a72-a507-4d1d-9e4a-7d9a946708ea None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:33.038283 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 93/195] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:32 2022] GET /identity/v3/users/a5fc5afa208140d99c9651b6b86d1c8c => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:33.038700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e33a72-a507-4d1d-9e4a-7d9a946708ea None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:33.038980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e33a72-a507-4d1d-9e4a-7d9a946708ea None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:33.040557 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 103/196] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:33.046612 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af961c8c-4c2b-4a43-bf09-cb91d52c86ae None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:33.046900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af961c8c-4c2b-4a43-bf09-cb91d52c86ae None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:33.047181 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af961c8c-4c2b-4a43-bf09-cb91d52c86ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:33.051278 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e33a72-a507-4d1d-9e4a-7d9a946708ea None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:33.065809 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-af961c8c-4c2b-4a43-bf09-cb91d52c86ae None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:33.066981 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-af961c8c-4c2b-4a43-bf09-cb91d52c86ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:33.144398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 94/197] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:33.145569 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af961c8c-4c2b-4a43-bf09-cb91d52c86ae None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:33.177238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e33a72-a507-4d1d-9e4a-7d9a946708ea None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:33.212783 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8aaefa-4d31-4adc-8482-aa6dcc6dd17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:33.213876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8aaefa-4d31-4adc-8482-aa6dcc6dd17f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:33.214277 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8aaefa-4d31-4adc-8482-aa6dcc6dd17f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:33.214696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8aaefa-4d31-4adc-8482-aa6dcc6dd17f None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:33.216018 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8aaefa-4d31-4adc-8482-aa6dcc6dd17f None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:33.217692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8aaefa-4d31-4adc-8482-aa6dcc6dd17f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:33.219622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 104/198] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:33 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:33.220481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8aaefa-4d31-4adc-8482-aa6dcc6dd17f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:33.266663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af961c8c-4c2b-4a43-bf09-cb91d52c86ae None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:33.301880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463a8fe-9d39-4865-b7b8-dfbba152d6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:33.302836 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463a8fe-9d39-4865-b7b8-dfbba152d6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:33.303127 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463a8fe-9d39-4865-b7b8-dfbba152d6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:33.303559 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463a8fe-9d39-4865-b7b8-dfbba152d6d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:33.324771 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8aaefa-4d31-4adc-8482-aa6dcc6dd17f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:33.366190 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d31ede-b752-479d-abe8-b156419b1046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:33.366995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d31ede-b752-479d-abe8-b156419b1046 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:33.367272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d31ede-b752-479d-abe8-b156419b1046 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:33.367543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d31ede-b752-479d-abe8-b156419b1046 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:33.386726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d31ede-b752-479d-abe8-b156419b1046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:33.390365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463a8fe-9d39-4865-b7b8-dfbba152d6d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:33.391948 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463a8fe-9d39-4865-b7b8-dfbba152d6d7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-23d31ede-b752-479d-abe8-b156419b1046 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:33.396519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:33.397362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:33.398142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:33.398142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:33.398142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:33.398142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:33.398142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:33.398142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:33.398142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:33.398142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:33.398142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:33.398142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:33.398142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:33.398142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:33.402893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 105/199] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:33.403765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d31ede-b752-479d-abe8-b156419b1046 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:33.504445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 95/200] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:33.505674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463a8fe-9d39-4865-b7b8-dfbba152d6d7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:33.525057 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d31ede-b752-479d-abe8-b156419b1046 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:33.569283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181bf4-6eea-4ee2-beb6-64ce29e53b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:33.570146 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181bf4-6eea-4ee2-beb6-64ce29e53b1f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:33.570431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181bf4-6eea-4ee2-beb6-64ce29e53b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:33.570867 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181bf4-6eea-4ee2-beb6-64ce29e53b1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:33.572045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181bf4-6eea-4ee2-beb6-64ce29e53b1f None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=5597d4acc0664c3e805bd547a6173ed0, user.id=a5fc5afa208140d99c9651b6b86d1c8c) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:33.572650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181bf4-6eea-4ee2-beb6-64ce29e53b1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:33.574597 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181bf4-6eea-4ee2-beb6-64ce29e53b1f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:33.581721 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 106/201] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:33 2022] GET /identity/v3/role_assignments?user.id=a5fc5afa208140d99c9651b6b86d1c8c&scope.project.id=5597d4acc0664c3e805bd547a6173ed0&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:33.582638 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181bf4-6eea-4ee2-beb6-64ce29e53b1f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:33.661830 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463a8fe-9d39-4865-b7b8-dfbba152d6d7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:33.708374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181bf4-6eea-4ee2-beb6-64ce29e53b1f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:33.748916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d720efc-23af-4ae2-9b0c-78f08f7108bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:33.749899 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d720efc-23af-4ae2-9b0c-78f08f7108bc None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:33.750186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d720efc-23af-4ae2-9b0c-78f08f7108bc None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:33.750459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d720efc-23af-4ae2-9b0c-78f08f7108bc None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:33.751737 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d720efc-23af-4ae2-9b0c-78f08f7108bc None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:33.753433 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d720efc-23af-4ae2-9b0c-78f08f7108bc None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:33.755047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c07c9e-4958-4f27-8968-c302aeda2add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:33.755292 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 107/202] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:33 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:33.756105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c07c9e-4958-4f27-8968-c302aeda2add None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:33.756446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c07c9e-4958-4f27-8968-c302aeda2add None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:33.756728 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c07c9e-4958-4f27-8968-c302aeda2add None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:33.757488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c07c9e-4958-4f27-8968-c302aeda2add None admin] RBAC: Adding query filter params (name=reader) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:33.757796 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c07c9e-4958-4f27-8968-c302aeda2add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:33.759190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c07c9e-4958-4f27-8968-c302aeda2add None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:33.772683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d720efc-23af-4ae2-9b0c-78f08f7108bc None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:33.777833 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 96/203] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:33.788695 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c07c9e-4958-4f27-8968-c302aeda2add None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:33.899028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d720efc-23af-4ae2-9b0c-78f08f7108bc None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:33.940407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f6a6a-2c67-4217-8602-47c6ba739dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:33.941342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f6a6a-2c67-4217-8602-47c6ba739dec None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:33.941791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f6a6a-2c67-4217-8602-47c6ba739dec None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:33.942302 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f6a6a-2c67-4217-8602-47c6ba739dec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:33.943306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f6a6a-2c67-4217-8602-47c6ba739dec None admin] RBAC: Adding query filter params (role.id=f47d350de184449f9ce5e84ebe7753da, scope.project.id=5597d4acc0664c3e805bd547a6173ed0, user.id=a5fc5afa208140d99c9651b6b86d1c8c) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:33.943790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f6a6a-2c67-4217-8602-47c6ba739dec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:33.945859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f6a6a-2c67-4217-8602-47c6ba739dec None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:33.952623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 108/204] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:33 2022] GET /identity/v3/role_assignments?user.id=a5fc5afa208140d99c9651b6b86d1c8c&scope.project.id=5597d4acc0664c3e805bd547a6173ed0&role.id=f47d350de184449f9ce5e84ebe7753da => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:33.965802 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c07c9e-4958-4f27-8968-c302aeda2add None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:34.010972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a692478-b1c6-45c1-8686-2a6f13326be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:34.012715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a692478-b1c6-45c1-8686-2a6f13326be7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:34.013202 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a692478-b1c6-45c1-8686-2a6f13326be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:34.014311 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a692478-b1c6-45c1-8686-2a6f13326be7 None admin] PATH_INFO: `/v3/users/4d002d83065940b49455729b85f81281` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:34.020519 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a692478-b1c6-45c1-8686-2a6f13326be7 None admin] RBAC: Authorizing `identity:get_user(user_id=4d002d83065940b49455729b85f81281)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:34.022341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a692478-b1c6-45c1-8686-2a6f13326be7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:34.024324 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 97/205] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:33 2022] GET /identity/v3/users/4d002d83065940b49455729b85f81281 => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:34.030836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f6a6a-2c67-4217-8602-47c6ba739dec None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:34.168373 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f6a6a-2c67-4217-8602-47c6ba739dec None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:34.209226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496510d6-0823-4825-ba4f-6ba0d6f13c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:34.209895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496510d6-0823-4825-ba4f-6ba0d6f13c79 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:34.210176 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496510d6-0823-4825-ba4f-6ba0d6f13c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:34.210453 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496510d6-0823-4825-ba4f-6ba0d6f13c79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:34.280824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496510d6-0823-4825-ba4f-6ba0d6f13c79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:34.282283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496510d6-0823-4825-ba4f-6ba0d6f13c79 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:34.401508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 109/206] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:34.407697 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a692478-b1c6-45c1-8686-2a6f13326be7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:34.514240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a692478-b1c6-45c1-8686-2a6f13326be7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:34.548756 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273c13e-a530-4e10-a679-83a9a3de5882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:34.549631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273c13e-a530-4e10-a679-83a9a3de5882 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:34.549913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273c13e-a530-4e10-a679-83a9a3de5882 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:34.550185 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273c13e-a530-4e10-a679-83a9a3de5882 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:34.551384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273c13e-a530-4e10-a679-83a9a3de5882 None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:34.552871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273c13e-a530-4e10-a679-83a9a3de5882 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:34.554883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 98/207] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:34 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:34.560823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496510d6-0823-4825-ba4f-6ba0d6f13c79 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:34.661401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496510d6-0823-4825-ba4f-6ba0d6f13c79 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:34.696112 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca461e-fa4a-4be2-87e1-440d6eb283da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:34.696774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca461e-fa4a-4be2-87e1-440d6eb283da None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:34.697058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca461e-fa4a-4be2-87e1-440d6eb283da None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:34.697335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca461e-fa4a-4be2-87e1-440d6eb283da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:34.698175 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca461e-fa4a-4be2-87e1-440d6eb283da None admin] RBAC: Adding query filter params (role.id=b216a326d0f24273b3cceab46bd3e208, scope.project.id=37528046958f43e8b9cf2ffd96d3def0, user.id=4d002d83065940b49455729b85f81281) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:34.698488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca461e-fa4a-4be2-87e1-440d6eb283da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:34.699963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca461e-fa4a-4be2-87e1-440d6eb283da None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:34.706675 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 110/208] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:34 2022] GET /identity/v3/role_assignments?user.id=4d002d83065940b49455729b85f81281&scope.project.id=37528046958f43e8b9cf2ffd96d3def0&role.id=b216a326d0f24273b3cceab46bd3e208 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:35.226182 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe8e69-a97b-4a97-bf19-3757d779e1b6 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:35.227214 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe8e69-a97b-4a97-bf19-3757d779e1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:35.227766 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe8e69-a97b-4a97-bf19-3757d779e1b6 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:35.230047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 99/209] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:35.237036 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3f117-255e-46c9-831f-093078f5602e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:35.237982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3f117-255e-46c9-831f-093078f5602e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:35.238492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3f117-255e-46c9-831f-093078f5602e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:35.256462 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f5d3f117-255e-46c9-831f-093078f5602e None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:35.257947 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f5d3f117-255e-46c9-831f-093078f5602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:35.332549 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 111/210] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:35.356198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe8e69-a97b-4a97-bf19-3757d779e1b6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:35.465299 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe8e69-a97b-4a97-bf19-3757d779e1b6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:35.499895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c348700-9b31-49b0-959d-9ac1bc817361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:35.500703 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c348700-9b31-49b0-959d-9ac1bc817361 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:35.500986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c348700-9b31-49b0-959d-9ac1bc817361 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:35.501260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c348700-9b31-49b0-959d-9ac1bc817361 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:35.511647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c348700-9b31-49b0-959d-9ac1bc817361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8c348700-9b31-49b0-959d-9ac1bc817361 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:35.519923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:35.520792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:35.521591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:35.521591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:35.521591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:35.521591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:35.521591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:35.521591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:35.521591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:35.521591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:35.521591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:35.521591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:35.521591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:35.521591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:35.521591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 100/211] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:35.526954 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3f117-255e-46c9-831f-093078f5602e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:35.574012 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a140da-ce29-4ee9-8402-5830d1a4c908 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:35.574356 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a140da-ce29-4ee9-8402-5830d1a4c908 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:35.574759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a140da-ce29-4ee9-8402-5830d1a4c908 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:35.577646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 101/212] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:56:35.582749 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4703400-6cc6-4fb0-b937-b1d3ee085871 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:35.583281 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4703400-6cc6-4fb0-b937-b1d3ee085871 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:35.583796 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4703400-6cc6-4fb0-b937-b1d3ee085871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:35.601619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a4703400-6cc6-4fb0-b937-b1d3ee085871 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:35.603104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a4703400-6cc6-4fb0-b937-b1d3ee085871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:35.630010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3f117-255e-46c9-831f-093078f5602e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:35.664208 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75b663-2280-474e-8adc-0109c84c1bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:35.664876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75b663-2280-474e-8adc-0109c84c1bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:35.665148 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75b663-2280-474e-8adc-0109c84c1bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:35.665610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75b663-2280-474e-8adc-0109c84c1bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:35.666482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75b663-2280-474e-8adc-0109c84c1bd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:35.667211 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75b663-2280-474e-8adc-0109c84c1bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:35.668762 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75b663-2280-474e-8adc-0109c84c1bd6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:35.672032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 102/213] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:35.677798 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 112/214] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:35.684877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4703400-6cc6-4fb0-b937-b1d3ee085871 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:35.698883 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75b663-2280-474e-8adc-0109c84c1bd6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:35.786450 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4703400-6cc6-4fb0-b937-b1d3ee085871 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:35.798597 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75b663-2280-474e-8adc-0109c84c1bd6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:35.822271 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e783e94-39c0-4cf1-a757-729da11eab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:35.822902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e783e94-39c0-4cf1-a757-729da11eab32 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:35.823184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e783e94-39c0-4cf1-a757-729da11eab32 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:35.823457 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e783e94-39c0-4cf1-a757-729da11eab32 None admin] PATH_INFO: `/v3/users/0d56d01bbc68443a9a1e59998ad77866` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:35.834361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856657d2-ef09-41e5-9cb0-674ae7ac301b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:35.835469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856657d2-ef09-41e5-9cb0-674ae7ac301b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:35.835975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856657d2-ef09-41e5-9cb0-674ae7ac301b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:35.836459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856657d2-ef09-41e5-9cb0-674ae7ac301b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:35.838091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856657d2-ef09-41e5-9cb0-674ae7ac301b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:35.838706 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e783e94-39c0-4cf1-a757-729da11eab32 None admin] RBAC: Authorizing `identity:get_user(user_id=0d56d01bbc68443a9a1e59998ad77866)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:35.839983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856657d2-ef09-41e5-9cb0-674ae7ac301b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:35.840256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e783e94-39c0-4cf1-a757-729da11eab32 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:35.842306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 113/216] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:35.846987 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 103/216] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:35 2022] GET /identity/v3/users/0d56d01bbc68443a9a1e59998ad77866 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:35.847997 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856657d2-ef09-41e5-9cb0-674ae7ac301b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:35.848104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e783e94-39c0-4cf1-a757-729da11eab32 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:35.981778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856657d2-ef09-41e5-9cb0-674ae7ac301b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:35.984235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e783e94-39c0-4cf1-a757-729da11eab32 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:36.017969 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7c45e-c3c4-4285-bbaa-eb169c950cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:36.018974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7c45e-c3c4-4285-bbaa-eb169c950cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:36.019462 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7c45e-c3c4-4285-bbaa-eb169c950cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:36.019950 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7c45e-c3c4-4285-bbaa-eb169c950cd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:36.021228 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187df152-f8b9-420e-adcd-be3ba97f0dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:36.022004 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187df152-f8b9-420e-adcd-be3ba97f0dbf None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:36.022391 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187df152-f8b9-420e-adcd-be3ba97f0dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:36.022788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187df152-f8b9-420e-adcd-be3ba97f0dbf None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:36.023699 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187df152-f8b9-420e-adcd-be3ba97f0dbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:36.025217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187df152-f8b9-420e-adcd-be3ba97f0dbf None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:36.048319 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 104/217] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:56:35 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:56:36.104605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7c45e-c3c4-4285-bbaa-eb169c950cd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:36.106500 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7c45e-c3c4-4285-bbaa-eb169c950cd7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:36.223762 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 114/218] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:36.233347 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187df152-f8b9-420e-adcd-be3ba97f0dbf None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:36.356562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187df152-f8b9-420e-adcd-be3ba97f0dbf None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:36.371653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99345d32-4261-4658-9911-4289e9c60ba4 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:36.371653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99345d32-4261-4658-9911-4289e9c60ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:36.371653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99345d32-4261-4658-9911-4289e9c60ba4 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:36.374037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 115/219] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:36.380926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c868230-9a7e-4bae-aeac-20555d6d2a7b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:36.381206 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c868230-9a7e-4bae-aeac-20555d6d2a7b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:36.381482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c868230-9a7e-4bae-aeac-20555d6d2a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:36.401249 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-8c868230-9a7e-4bae-aeac-20555d6d2a7b None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:36.402468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8c868230-9a7e-4bae-aeac-20555d6d2a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:36.407772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2d53b-82af-4ab6-ad6a-80062cefd52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:36.409026 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2d53b-82af-4ab6-ad6a-80062cefd52c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:36.409474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2d53b-82af-4ab6-ad6a-80062cefd52c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:36.409925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2d53b-82af-4ab6-ad6a-80062cefd52c None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:36.411469 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2d53b-82af-4ab6-ad6a-80062cefd52c None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:36.413169 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2d53b-82af-4ab6-ad6a-80062cefd52c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:36.415404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 105/220] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:36 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:36.421860 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2d53b-82af-4ab6-ad6a-80062cefd52c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:36.492367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 116/221] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:36.538531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c868230-9a7e-4bae-aeac-20555d6d2a7b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:36.564270 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2d53b-82af-4ab6-ad6a-80062cefd52c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:36.618010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f830fa-26e2-4030-8898-38d5278b3455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:36.618824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f830fa-26e2-4030-8898-38d5278b3455 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:36.619295 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f830fa-26e2-4030-8898-38d5278b3455 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:36.619795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f830fa-26e2-4030-8898-38d5278b3455 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:36.621585 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f830fa-26e2-4030-8898-38d5278b3455 None admin] RBAC: Adding query filter params (role.id=e613911293e3458c975cbab36cae354d, scope.project.id=5597d4acc0664c3e805bd547a6173ed0, user.id=0d56d01bbc68443a9a1e59998ad77866) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:36.621903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f830fa-26e2-4030-8898-38d5278b3455 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:36.625480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f830fa-26e2-4030-8898-38d5278b3455 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:36.634605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 106/222] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:36 2022] GET /identity/v3/role_assignments?user.id=0d56d01bbc68443a9a1e59998ad77866&scope.project.id=5597d4acc0664c3e805bd547a6173ed0&role.id=e613911293e3458c975cbab36cae354d => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:36.654444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dea9b-8966-49e5-a931-6657e2a76fc5 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:36.654444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dea9b-8966-49e5-a931-6657e2a76fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:36.654444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dea9b-8966-49e5-a931-6657e2a76fc5 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:36.654444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 107/223] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:36.673257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a086d-298f-4e4b-ae2f-43b459960201 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:36.673448 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a086d-298f-4e4b-ae2f-43b459960201 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:36.673681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a086d-298f-4e4b-ae2f-43b459960201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:36.710400 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7b0a086d-298f-4e4b-ae2f-43b459960201 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:36.711620 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7b0a086d-298f-4e4b-ae2f-43b459960201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:36.713205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c868230-9a7e-4bae-aeac-20555d6d2a7b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:36.761987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5abfac-41ca-4080-996e-7a5d2f400edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:36.762736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5abfac-41ca-4080-996e-7a5d2f400edd None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:36.763019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5abfac-41ca-4080-996e-7a5d2f400edd None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:36.763312 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5abfac-41ca-4080-996e-7a5d2f400edd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:36.776528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5abfac-41ca-4080-996e-7a5d2f400edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-fc5abfac-41ca-4080-996e-7a5d2f400edd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:36.786852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:36.787815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:36.788609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:36.788609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:36.788609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:36.788609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:36.788609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:36.788609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:36.788609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:36.788609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:36.788609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:36.788609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:36.788609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:36.788609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:36.789204 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 117/224] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:56:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:36.796991 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5abfac-41ca-4080-996e-7a5d2f400edd None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:36.849124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 108/225] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:36.876696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a086d-298f-4e4b-ae2f-43b459960201 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:36.957868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5abfac-41ca-4080-996e-7a5d2f400edd None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:36.994478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa287f3-cdc3-4446-998f-5416f0e5c2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:36.995385 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa287f3-cdc3-4446-998f-5416f0e5c2bc None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:36.995989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa287f3-cdc3-4446-998f-5416f0e5c2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:36.996517 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa287f3-cdc3-4446-998f-5416f0e5c2bc None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:36.997766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa287f3-cdc3-4446-998f-5416f0e5c2bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:36.998255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa287f3-cdc3-4446-998f-5416f0e5c2bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:36.999896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa287f3-cdc3-4446-998f-5416f0e5c2bc None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:37.010297 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 118/226] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:37.017131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa287f3-cdc3-4446-998f-5416f0e5c2bc None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:37.102461 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a086d-298f-4e4b-ae2f-43b459960201 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:37.126658 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa287f3-cdc3-4446-998f-5416f0e5c2bc None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:37.163237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46c851-bcb1-4bb5-b849-bb3c4e5fbc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:37.164415 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46c851-bcb1-4bb5-b849-bb3c4e5fbc3c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:37.164837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46c851-bcb1-4bb5-b849-bb3c4e5fbc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:37.165252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46c851-bcb1-4bb5-b849-bb3c4e5fbc3c None admin] PATH_INFO: `/v3/users/a5fc5afa208140d99c9651b6b86d1c8c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:37.166600 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46c851-bcb1-4bb5-b849-bb3c4e5fbc3c None admin] RBAC: Authorizing `identity:get_user(user_id=a5fc5afa208140d99c9651b6b86d1c8c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:37.168251 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46c851-bcb1-4bb5-b849-bb3c4e5fbc3c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:37.170583 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 119/227] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:37 2022] GET /identity/v3/users/a5fc5afa208140d99c9651b6b86d1c8c => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:37.176058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46c851-bcb1-4bb5-b849-bb3c4e5fbc3c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:37.208352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48b45c-192c-4319-b419-e3691836d0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:37.209248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48b45c-192c-4319-b419-e3691836d0ab None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:37.209472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48b45c-192c-4319-b419-e3691836d0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:37.209800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48b45c-192c-4319-b419-e3691836d0ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:37.234493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48b45c-192c-4319-b419-e3691836d0ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-1b48b45c-192c-4319-b419-e3691836d0ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:37.252579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:37.253526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:37.254291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:37.254291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:37.254291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:37.254291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:37.254291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:37.254291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:37.254291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:37.254291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:37.254291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:37.254291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:37.254291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:37.254291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:37.254291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 109/228] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:56:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:56:37.260301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48b45c-192c-4319-b419-e3691836d0ab None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:37.290220 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46c851-bcb1-4bb5-b849-bb3c4e5fbc3c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:37.327822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ae43f-9d1d-4b32-834c-4c5a191a3313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:37.328928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ae43f-9d1d-4b32-834c-4c5a191a3313 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:37.329358 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ae43f-9d1d-4b32-834c-4c5a191a3313 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:37.329838 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ae43f-9d1d-4b32-834c-4c5a191a3313 None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:37.331194 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ae43f-9d1d-4b32-834c-4c5a191a3313 None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:37.332962 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ae43f-9d1d-4b32-834c-4c5a191a3313 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:37.334830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 120/229] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:37 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:37.342847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ae43f-9d1d-4b32-834c-4c5a191a3313 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:37.447676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ae43f-9d1d-4b32-834c-4c5a191a3313 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:37.482676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af7695-23b5-4ef1-9474-ac839ebdca16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:37.483929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af7695-23b5-4ef1-9474-ac839ebdca16 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:37.484416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af7695-23b5-4ef1-9474-ac839ebdca16 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:37.484891 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af7695-23b5-4ef1-9474-ac839ebdca16 None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0/users/a5fc5afa208140d99c9651b6b86d1c8c/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:37.487111 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af7695-23b5-4ef1-9474-ac839ebdca16 None admin] RBAC: Authorizing `identity:create_grant(project_id=5597d4acc0664c3e805bd547a6173ed0, user_id=a5fc5afa208140d99c9651b6b86d1c8c, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:37.488812 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af7695-23b5-4ef1-9474-ac839ebdca16 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:37.499964 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48b45c-192c-4319-b419-e3691836d0ab None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:37.505786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 121/230] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:56:37 2022] PUT /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0/users/a5fc5afa208140d99c9651b6b86d1c8c/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:56:37.576372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7ece3-6bc2-413c-9f33-0b1f729e55a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:37.577167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7ece3-6bc2-413c-9f33-0b1f729e55a5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:37.577448 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7ece3-6bc2-413c-9f33-0b1f729e55a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:37.577720 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7ece3-6bc2-413c-9f33-0b1f729e55a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:37.578483 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7ece3-6bc2-413c-9f33-0b1f729e55a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:37.578817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7ece3-6bc2-413c-9f33-0b1f729e55a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:37.580257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7ece3-6bc2-413c-9f33-0b1f729e55a5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:37.595743 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 110/231] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:56:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:37.601881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af7695-23b5-4ef1-9474-ac839ebdca16 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:37.715730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af7695-23b5-4ef1-9474-ac839ebdca16 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:37.752330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313e4a2-3bdc-4298-a916-98ab7ff000d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:37.753657 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313e4a2-3bdc-4298-a916-98ab7ff000d4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:37.754238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313e4a2-3bdc-4298-a916-98ab7ff000d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:37.754712 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313e4a2-3bdc-4298-a916-98ab7ff000d4 None admin] PATH_INFO: `/v3/users/a5fc5afa208140d99c9651b6b86d1c8c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:37.756378 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313e4a2-3bdc-4298-a916-98ab7ff000d4 None admin] RBAC: Authorizing `identity:get_user(user_id=a5fc5afa208140d99c9651b6b86d1c8c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:37.757849 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313e4a2-3bdc-4298-a916-98ab7ff000d4 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:37.759727 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 122/232] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:37 2022] GET /identity/v3/users/a5fc5afa208140d99c9651b6b86d1c8c => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:37.766374 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7ece3-6bc2-413c-9f33-0b1f729e55a5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:37.889107 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7ece3-6bc2-413c-9f33-0b1f729e55a5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:37.939984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469afad9-edc9-431a-845b-72bbe7d3c9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:37.940855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469afad9-edc9-431a-845b-72bbe7d3c9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:37.941135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469afad9-edc9-431a-845b-72bbe7d3c9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:37.941407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469afad9-edc9-431a-845b-72bbe7d3c9b0 None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:37.943627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469afad9-edc9-431a-845b-72bbe7d3c9b0 None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:37.945075 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469afad9-edc9-431a-845b-72bbe7d3c9b0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:37.946764 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 111/233] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:37 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:37.953248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313e4a2-3bdc-4298-a916-98ab7ff000d4 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:38.117299 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313e4a2-3bdc-4298-a916-98ab7ff000d4 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:38.175199 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed566c-6c30-4125-b4ab-15f4670ffa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:38.176054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed566c-6c30-4125-b4ab-15f4670ffa1f None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:38.176391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed566c-6c30-4125-b4ab-15f4670ffa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:38.176669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed566c-6c30-4125-b4ab-15f4670ffa1f None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0/users/a5fc5afa208140d99c9651b6b86d1c8c/roles/f47d350de184449f9ce5e84ebe7753da` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:38.179763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed566c-6c30-4125-b4ab-15f4670ffa1f None admin] RBAC: Authorizing `identity:create_grant(project_id=5597d4acc0664c3e805bd547a6173ed0, user_id=a5fc5afa208140d99c9651b6b86d1c8c, role_id=f47d350de184449f9ce5e84ebe7753da)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:38.181221 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed566c-6c30-4125-b4ab-15f4670ffa1f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:38.208831 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 123/234] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:56:37 2022] PUT /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0/users/a5fc5afa208140d99c9651b6b86d1c8c/roles/f47d350de184449f9ce5e84ebe7753da => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:56:39.004965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde7fd4-a5a3-4226-8d92-229da0503771 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:39.005476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde7fd4-a5a3-4226-8d92-229da0503771 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:39.005550 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde7fd4-a5a3-4226-8d92-229da0503771 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:39.006865 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 112/235] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:39.018543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46cd48-2676-4a50-aaca-2ae546b11441 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:39.018974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46cd48-2676-4a50-aaca-2ae546b11441 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:39.019151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46cd48-2676-4a50-aaca-2ae546b11441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:39.045269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-bf46cd48-2676-4a50-aaca-2ae546b11441 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:39.046562 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-bf46cd48-2676-4a50-aaca-2ae546b11441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:39.062137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca73966-b4c2-4a07-b786-080af404fcb3 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:39.062434 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca73966-b4c2-4a07-b786-080af404fcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:39.062692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca73966-b4c2-4a07-b786-080af404fcb3 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:39.064492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 113/236] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:56:39.073798 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdb6b8-a1a0-4abc-a838-bf907f420673 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:39.074085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdb6b8-a1a0-4abc-a838-bf907f420673 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:39.074364 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdb6b8-a1a0-4abc-a838-bf907f420673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:39.119465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b5fdb6b8-a1a0-4abc-a838-bf907f420673 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:39.123590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b5fdb6b8-a1a0-4abc-a838-bf907f420673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:39.186075 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 124/237] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:39.229940 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 114/238] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:39.253585 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46cd48-2676-4a50-aaca-2ae546b11441 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:39.261703 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdb6b8-a1a0-4abc-a838-bf907f420673 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:39.363444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdb6b8-a1a0-4abc-a838-bf907f420673 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:39.375724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46cd48-2676-4a50-aaca-2ae546b11441 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:39.398447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be3d66-9bdb-44f5-ad67-c01063c077f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:39.399251 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be3d66-9bdb-44f5-ad67-c01063c077f4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:39.399533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be3d66-9bdb-44f5-ad67-c01063c077f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:39.399837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be3d66-9bdb-44f5-ad67-c01063c077f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:39.400998 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be3d66-9bdb-44f5-ad67-c01063c077f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:39.402443 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be3d66-9bdb-44f5-ad67-c01063c077f4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:39.410177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 115/239] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:39.410308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d07c1-6626-46b9-9a41-eecd03a46a6c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:39.410566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d07c1-6626-46b9-9a41-eecd03a46a6c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:39.410999 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d07c1-6626-46b9-9a41-eecd03a46a6c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:39.412435 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 116/240] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:39.413490 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ef2a0-4279-41d8-9595-bfedceaac344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:39.413831 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d07c1-6626-46b9-9a41-eecd03a46a6c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:39.414702 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ef2a0-4279-41d8-9595-bfedceaac344 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:39.415124 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ef2a0-4279-41d8-9595-bfedceaac344 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:39.415561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ef2a0-4279-41d8-9595-bfedceaac344 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:39.426083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ef2a0-4279-41d8-9595-bfedceaac344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-ab9ef2a0-4279-41d8-9595-bfedceaac344 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:39.433992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:39.435627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:39.436427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:39.436427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:39.436427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:39.436427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:39.436427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:39.436427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:39.436427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:39.436427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:39.436427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:39.436427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:39.436427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:39.436427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:39.442083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 125/241] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:39.442083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b73e7-3de7-4832-9e8e-4ea5938d3beb None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:39.442602 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b73e7-3de7-4832-9e8e-4ea5938d3beb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:39.443096 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b73e7-3de7-4832-9e8e-4ea5938d3beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:39.460336 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-508b73e7-3de7-4832-9e8e-4ea5938d3beb None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:39.461745 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-508b73e7-3de7-4832-9e8e-4ea5938d3beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:39.517968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d07c1-6626-46b9-9a41-eecd03a46a6c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:39.526905 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 126/242] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:39.528074 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b73e7-3de7-4832-9e8e-4ea5938d3beb None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:39.553038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcd6be-4529-4054-8f44-a59620249ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:39.553984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcd6be-4529-4054-8f44-a59620249ba9 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:39.554494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcd6be-4529-4054-8f44-a59620249ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:39.554968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcd6be-4529-4054-8f44-a59620249ba9 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:39.555904 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcd6be-4529-4054-8f44-a59620249ba9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:39.557553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcd6be-4529-4054-8f44-a59620249ba9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:39.581874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 117/243] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:56:39 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:56:39.582933 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcd6be-4529-4054-8f44-a59620249ba9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:39.683490 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b73e7-3de7-4832-9e8e-4ea5938d3beb None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:39.726053 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb92a5-fd2c-4a70-b633-8b69c5cc5e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:39.726972 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb92a5-fd2c-4a70-b633-8b69c5cc5e3e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:39.727392 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb92a5-fd2c-4a70-b633-8b69c5cc5e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:39.727851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb92a5-fd2c-4a70-b633-8b69c5cc5e3e None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:39.735630 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb92a5-fd2c-4a70-b633-8b69c5cc5e3e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:39.736388 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb92a5-fd2c-4a70-b633-8b69c5cc5e3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:39.737993 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb92a5-fd2c-4a70-b633-8b69c5cc5e3e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:39.746813 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 127/244] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:39.752819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb92a5-fd2c-4a70-b633-8b69c5cc5e3e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:39.755969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcd6be-4529-4054-8f44-a59620249ba9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:39.791727 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd16299-9161-4161-be38-56cfc256422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:39.792888 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd16299-9161-4161-be38-56cfc256422e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:39.793378 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd16299-9161-4161-be38-56cfc256422e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:39.793878 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd16299-9161-4161-be38-56cfc256422e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:39.805565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd16299-9161-4161-be38-56cfc256422e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5fd16299-9161-4161-be38-56cfc256422e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:39.814330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:39.815210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:39.816010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:39.816010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:39.816010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:39.816010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:39.816010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:39.816010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:39.816010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:39.816010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:39.816010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:39.816010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:39.816010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:39.816010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:39.818772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 118/245] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:39.829031 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd16299-9161-4161-be38-56cfc256422e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:39.878360 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb92a5-fd2c-4a70-b633-8b69c5cc5e3e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:39.912317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baa2f5-c869-40b3-89c4-e52af3566622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:39.913198 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baa2f5-c869-40b3-89c4-e52af3566622 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:39.913476 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baa2f5-c869-40b3-89c4-e52af3566622 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:39.914163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baa2f5-c869-40b3-89c4-e52af3566622 None admin] PATH_INFO: `/v3/users/b896827ba90d4bd18614b802668f08d5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:39.929832 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baa2f5-c869-40b3-89c4-e52af3566622 None admin] RBAC: Authorizing `identity:get_user(user_id=b896827ba90d4bd18614b802668f08d5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:39.931324 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baa2f5-c869-40b3-89c4-e52af3566622 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:39.933058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 128/246] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:39 2022] GET /identity/v3/users/b896827ba90d4bd18614b802668f08d5 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:39.938647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baa2f5-c869-40b3-89c4-e52af3566622 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:39.949761 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd16299-9161-4161-be38-56cfc256422e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:39.985080 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f1263-f4b7-49ff-9ed1-5d152d773afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:39.986098 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f1263-f4b7-49ff-9ed1-5d152d773afc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:39.986578 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f1263-f4b7-49ff-9ed1-5d152d773afc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:39.987072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f1263-f4b7-49ff-9ed1-5d152d773afc None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:39.988058 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f1263-f4b7-49ff-9ed1-5d152d773afc None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:39.988565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f1263-f4b7-49ff-9ed1-5d152d773afc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:39.990217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f1263-f4b7-49ff-9ed1-5d152d773afc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:39.999683 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 119/247] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:40.004641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f1263-f4b7-49ff-9ed1-5d152d773afc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:40.045740 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baa2f5-c869-40b3-89c4-e52af3566622 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:40.080494 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6cafa-9dc1-4e71-9dc9-72d7205b221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:40.081142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6cafa-9dc1-4e71-9dc9-72d7205b221f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:40.081422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6cafa-9dc1-4e71-9dc9-72d7205b221f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:40.081697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6cafa-9dc1-4e71-9dc9-72d7205b221f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:40.114613 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f1263-f4b7-49ff-9ed1-5d152d773afc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:40.157143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6cafa-9dc1-4e71-9dc9-72d7205b221f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:40.159507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6cafa-9dc1-4e71-9dc9-72d7205b221f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:40.165359 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263182f8-e544-430b-b8d2-5ae282dd1790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:40.166725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263182f8-e544-430b-b8d2-5ae282dd1790 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:40.167241 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263182f8-e544-430b-b8d2-5ae282dd1790 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:40.167751 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263182f8-e544-430b-b8d2-5ae282dd1790 None admin] PATH_INFO: `/v3/users/0d56d01bbc68443a9a1e59998ad77866` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:40.169459 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263182f8-e544-430b-b8d2-5ae282dd1790 None admin] RBAC: Authorizing `identity:get_user(user_id=0d56d01bbc68443a9a1e59998ad77866)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:40.172027 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263182f8-e544-430b-b8d2-5ae282dd1790 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:40.175457 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 120/248] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:40 2022] GET /identity/v3/users/0d56d01bbc68443a9a1e59998ad77866 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:40.182984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263182f8-e544-430b-b8d2-5ae282dd1790 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:40.271651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 129/249] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 16:56:40.277060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6cafa-9dc1-4e71-9dc9-72d7205b221f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:40.296689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263182f8-e544-430b-b8d2-5ae282dd1790 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:40.335129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7984d56-1dc6-46d4-b215-1525a73a7ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:40.336056 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7984d56-1dc6-46d4-b215-1525a73a7ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:40.336335 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7984d56-1dc6-46d4-b215-1525a73a7ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:40.336608 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7984d56-1dc6-46d4-b215-1525a73a7ab1 None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:40.337943 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7984d56-1dc6-46d4-b215-1525a73a7ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:40.339572 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7984d56-1dc6-46d4-b215-1525a73a7ab1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:40.342855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 121/250] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:40 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:40.348408 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7984d56-1dc6-46d4-b215-1525a73a7ab1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:40.383837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6cafa-9dc1-4e71-9dc9-72d7205b221f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:40.422001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93673dc-f8a2-4ca2-afd7-c7c78befa9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:40.422885 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93673dc-f8a2-4ca2-afd7-c7c78befa9ae None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:40.423169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93673dc-f8a2-4ca2-afd7-c7c78befa9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:40.423443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93673dc-f8a2-4ca2-afd7-c7c78befa9ae None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:40.425506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93673dc-f8a2-4ca2-afd7-c7c78befa9ae None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:40.426966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93673dc-f8a2-4ca2-afd7-c7c78befa9ae None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:40.429050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 130/251] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:40 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:40.430073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab51f0-e4f9-4bcb-814f-22fe7e51adc3 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:40.430364 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab51f0-e4f9-4bcb-814f-22fe7e51adc3 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:40.431533 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab51f0-e4f9-4bcb-814f-22fe7e51adc3 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:40.432858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 131/252] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:40.435673 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab51f0-e4f9-4bcb-814f-22fe7e51adc3 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:40.463772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7984d56-1dc6-46d4-b215-1525a73a7ab1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:40.505634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b0f4b-8b69-496e-ad6b-f4de30a7f5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:40.506531 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b0f4b-8b69-496e-ad6b-f4de30a7f5b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:40.506806 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b0f4b-8b69-496e-ad6b-f4de30a7f5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:40.507080 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b0f4b-8b69-496e-ad6b-f4de30a7f5b9 None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0/users/0d56d01bbc68443a9a1e59998ad77866/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:40.509099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b0f4b-8b69-496e-ad6b-f4de30a7f5b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5597d4acc0664c3e805bd547a6173ed0, user_id=0d56d01bbc68443a9a1e59998ad77866, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:40.510553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b0f4b-8b69-496e-ad6b-f4de30a7f5b9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:40.528427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 122/253] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:56:40 2022] PUT /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0/users/0d56d01bbc68443a9a1e59998ad77866/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:56:40.530623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a806f-e24b-4f4c-b168-43bec5717bee None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:40.530909 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a806f-e24b-4f4c-b168-43bec5717bee None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:40.531186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a806f-e24b-4f4c-b168-43bec5717bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:40.563715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e74a806f-e24b-4f4c-b168-43bec5717bee None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:40.567132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e74a806f-e24b-4f4c-b168-43bec5717bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:40.612272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab51f0-e4f9-4bcb-814f-22fe7e51adc3 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:40.663441 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e455-415f-4f8f-86e3-00c259c46ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:40.664219 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e455-415f-4f8f-86e3-00c259c46ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:40.664471 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e455-415f-4f8f-86e3-00c259c46ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:40.664738 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e455-415f-4f8f-86e3-00c259c46ad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:40.665629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108e455-415f-4f8f-86e3-00c259c46ad9 None admin] RBAC: Adding query filter params (role.id=b216a326d0f24273b3cceab46bd3e208, scope.project.id=5597d4acc0664c3e805bd547a6173ed0, user.id=b896827ba90d4bd18614b802668f08d5) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:40.665938 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108e455-415f-4f8f-86e3-00c259c46ad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:40.667465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108e455-415f-4f8f-86e3-00c259c46ad9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:40.680222 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 132/254] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:40 2022] GET /identity/v3/role_assignments?user.id=b896827ba90d4bd18614b802668f08d5&scope.project.id=5597d4acc0664c3e805bd547a6173ed0&role.id=b216a326d0f24273b3cceab46bd3e208 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:40.687784 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 123/255] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:40.727078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e455-415f-4f8f-86e3-00c259c46ad9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:40.855356 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e455-415f-4f8f-86e3-00c259c46ad9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:40.892537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855d6d7-6d59-4db7-ba0c-3e926103b409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:40.893355 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855d6d7-6d59-4db7-ba0c-3e926103b409 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:40.893631 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855d6d7-6d59-4db7-ba0c-3e926103b409 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:40.893898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855d6d7-6d59-4db7-ba0c-3e926103b409 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:40.912160 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855d6d7-6d59-4db7-ba0c-3e926103b409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-7855d6d7-6d59-4db7-ba0c-3e926103b409 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:40.920040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:40.921054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:40.921818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:40.921818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:40.921818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:40.921818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:40.921818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:40.921818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:40.921818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:40.921818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:40.921818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:40.921818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:40.921818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:40.921818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:40.921818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 133/256] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:56:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:40.929294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a806f-e24b-4f4c-b168-43bec5717bee None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:41.065629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a806f-e24b-4f4c-b168-43bec5717bee None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:41.106710 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc167050-7733-4d84-af22-096e30458d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:41.108118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc167050-7733-4d84-af22-096e30458d7f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:41.108403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc167050-7733-4d84-af22-096e30458d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:41.108682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc167050-7733-4d84-af22-096e30458d7f None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:41.109443 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc167050-7733-4d84-af22-096e30458d7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:41.109749 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc167050-7733-4d84-af22-096e30458d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:41.111147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc167050-7733-4d84-af22-096e30458d7f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:41.119805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 124/257] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:41.126441 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855d6d7-6d59-4db7-ba0c-3e926103b409 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:41.138348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f197adc-d43b-4bd9-b3e6-8805f4aef7ee None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:41.138687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f197adc-d43b-4bd9-b3e6-8805f4aef7ee None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:41.138898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f197adc-d43b-4bd9-b3e6-8805f4aef7ee None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:41.140288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 125/258] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:41.145303 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d437da-8b1c-4cf7-ab30-0e74a112a9e8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:41.145589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d437da-8b1c-4cf7-ab30-0e74a112a9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:41.145864 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d437da-8b1c-4cf7-ab30-0e74a112a9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:41.172626 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-10d437da-8b1c-4cf7-ab30-0e74a112a9e8 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:41.173837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-10d437da-8b1c-4cf7-ab30-0e74a112a9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:41.276985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 126/259] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:41.316501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d437da-8b1c-4cf7-ab30-0e74a112a9e8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:41.320065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855d6d7-6d59-4db7-ba0c-3e926103b409 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:41.381766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa28942-9b6a-4223-ac76-9c446641c4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:41.382565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa28942-9b6a-4223-ac76-9c446641c4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:41.382842 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa28942-9b6a-4223-ac76-9c446641c4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:41.383113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa28942-9b6a-4223-ac76-9c446641c4e3 None admin] PATH_INFO: `/v3/users/a5fc5afa208140d99c9651b6b86d1c8c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:41.384684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa28942-9b6a-4223-ac76-9c446641c4e3 None admin] RBAC: Authorizing `identity:get_user(user_id=a5fc5afa208140d99c9651b6b86d1c8c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:41.386124 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa28942-9b6a-4223-ac76-9c446641c4e3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:41.387757 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 134/260] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:41 2022] GET /identity/v3/users/a5fc5afa208140d99c9651b6b86d1c8c => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:41.396506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa28942-9b6a-4223-ac76-9c446641c4e3 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:41.505445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d437da-8b1c-4cf7-ab30-0e74a112a9e8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:41.572458 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f106f6a-aeee-470a-9796-daba7e1d4be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:41.573273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f106f6a-aeee-470a-9796-daba7e1d4be2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:41.573547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f106f6a-aeee-470a-9796-daba7e1d4be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:41.573813 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f106f6a-aeee-470a-9796-daba7e1d4be2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:41.576791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa28942-9b6a-4223-ac76-9c446641c4e3 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:41.600631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f106f6a-aeee-470a-9796-daba7e1d4be2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-0f106f6a-aeee-470a-9796-daba7e1d4be2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:41.613002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:41.615257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:41.617325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:41.617325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:41.617325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:41.617325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:41.617325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:41.617325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:41.617325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:41.617325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:41.617325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:41.617325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:41.617325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:41.617325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:41.622233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 127/261] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:56:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:56:41.624162 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f106f6a-aeee-470a-9796-daba7e1d4be2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:41.639061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd16a37-419f-44dd-8cce-c92e435080a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:41.639774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd16a37-419f-44dd-8cce-c92e435080a4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:41.640052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd16a37-419f-44dd-8cce-c92e435080a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:41.640375 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd16a37-419f-44dd-8cce-c92e435080a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:41.760855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f106f6a-aeee-470a-9796-daba7e1d4be2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:41.782051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd16a37-419f-44dd-8cce-c92e435080a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:41.783551 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd16a37-419f-44dd-8cce-c92e435080a4 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:41.800372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d328c-ca04-40c7-91a6-8b9f5f1e73ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:41.801060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d328c-ca04-40c7-91a6-8b9f5f1e73ef None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:41.801338 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d328c-ca04-40c7-91a6-8b9f5f1e73ef None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:41.801609 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d328c-ca04-40c7-91a6-8b9f5f1e73ef None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:41.802367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d328c-ca04-40c7-91a6-8b9f5f1e73ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:41.802675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d328c-ca04-40c7-91a6-8b9f5f1e73ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:41.805858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d328c-ca04-40c7-91a6-8b9f5f1e73ef None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:41.815089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 128/262] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:56:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:41.820319 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d328c-ca04-40c7-91a6-8b9f5f1e73ef None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:41.930263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d328c-ca04-40c7-91a6-8b9f5f1e73ef None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:41.968915 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896bb22-4e7f-483e-903e-fc54c24c02cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:41.969793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896bb22-4e7f-483e-903e-fc54c24c02cc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:41.970516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896bb22-4e7f-483e-903e-fc54c24c02cc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:41.970800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896bb22-4e7f-483e-903e-fc54c24c02cc None admin] PATH_INFO: `/v3/users/a5fc5afa208140d99c9651b6b86d1c8c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:41.972036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896bb22-4e7f-483e-903e-fc54c24c02cc None admin] RBAC: Authorizing `identity:get_user(user_id=a5fc5afa208140d99c9651b6b86d1c8c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:41.973492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896bb22-4e7f-483e-903e-fc54c24c02cc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:41.975204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 129/263] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:41 2022] GET /identity/v3/users/a5fc5afa208140d99c9651b6b86d1c8c => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:41.980665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896bb22-4e7f-483e-903e-fc54c24c02cc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:42.038682 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 135/264] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:42.044166 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd16a37-419f-44dd-8cce-c92e435080a4 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:42.094548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896bb22-4e7f-483e-903e-fc54c24c02cc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:42.133998 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e16f0f-0175-4ddf-bf37-682265e68f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:42.134615 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16f0f-0175-4ddf-bf37-682265e68f17 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:42.134615 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16f0f-0175-4ddf-bf37-682265e68f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:42.134934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16f0f-0175-4ddf-bf37-682265e68f17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:42.208037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e16f0f-0175-4ddf-bf37-682265e68f17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:42.209494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e16f0f-0175-4ddf-bf37-682265e68f17 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:42.251710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd16a37-419f-44dd-8cce-c92e435080a4 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:42.311559 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 130/265] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:42.317048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e16f0f-0175-4ddf-bf37-682265e68f17 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:42.330246 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c8eb9-63d8-4b8b-93a9-a0d9eba200d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:42.331104 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c8eb9-63d8-4b8b-93a9-a0d9eba200d6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:42.331380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c8eb9-63d8-4b8b-93a9-a0d9eba200d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:42.331668 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c8eb9-63d8-4b8b-93a9-a0d9eba200d6 None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:42.336333 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c8eb9-63d8-4b8b-93a9-a0d9eba200d6 None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:42.337784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c8eb9-63d8-4b8b-93a9-a0d9eba200d6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:42.339723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 136/266] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:42 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:42.345897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c8eb9-63d8-4b8b-93a9-a0d9eba200d6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:42.414732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e16f0f-0175-4ddf-bf37-682265e68f17 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:42.448793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86726e1-fb2d-4948-bfb8-06f7e8262931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:42.449701 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86726e1-fb2d-4948-bfb8-06f7e8262931 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:42.449980 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86726e1-fb2d-4948-bfb8-06f7e8262931 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:42.450265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86726e1-fb2d-4948-bfb8-06f7e8262931 None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:42.451863 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86726e1-fb2d-4948-bfb8-06f7e8262931 None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:42.453316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86726e1-fb2d-4948-bfb8-06f7e8262931 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:42.459439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 131/267] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:42 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:42.460502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86726e1-fb2d-4948-bfb8-06f7e8262931 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:42.518320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c8eb9-63d8-4b8b-93a9-a0d9eba200d6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:42.558070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86726e1-fb2d-4948-bfb8-06f7e8262931 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:42.574617 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3a982-c30c-47b5-8835-a73b0e4d14bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:42.575613 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3a982-c30c-47b5-8835-a73b0e4d14bb None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:42.576122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3a982-c30c-47b5-8835-a73b0e4d14bb None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:42.576599 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3a982-c30c-47b5-8835-a73b0e4d14bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:42.577650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3a982-c30c-47b5-8835-a73b0e4d14bb None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=5597d4acc0664c3e805bd547a6173ed0, user.id=a5fc5afa208140d99c9651b6b86d1c8c) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:42.578165 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3a982-c30c-47b5-8835-a73b0e4d14bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:42.579833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3a982-c30c-47b5-8835-a73b0e4d14bb None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:42.586396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 137/268] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:42 2022] GET /identity/v3/role_assignments?user.id=a5fc5afa208140d99c9651b6b86d1c8c&scope.project.id=5597d4acc0664c3e805bd547a6173ed0&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:42.594984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4918b6-6611-46f8-8b89-2dedde415727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:42.595693 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4918b6-6611-46f8-8b89-2dedde415727 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:42.595977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4918b6-6611-46f8-8b89-2dedde415727 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:42.596250 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4918b6-6611-46f8-8b89-2dedde415727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:42.597101 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4918b6-6611-46f8-8b89-2dedde415727 None admin] RBAC: Adding query filter params (role.id=f47d350de184449f9ce5e84ebe7753da, scope.project.id=5597d4acc0664c3e805bd547a6173ed0, user.id=a5fc5afa208140d99c9651b6b86d1c8c) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:42.597413 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4918b6-6611-46f8-8b89-2dedde415727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:42.599032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4918b6-6611-46f8-8b89-2dedde415727 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:42.606173 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 132/269] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:42 2022] GET /identity/v3/role_assignments?user.id=a5fc5afa208140d99c9651b6b86d1c8c&scope.project.id=5597d4acc0664c3e805bd547a6173ed0&role.id=f47d350de184449f9ce5e84ebe7753da => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:43.464175 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28b1a3-8b49-4807-a8ee-97a653d12cbc None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:43.464670 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28b1a3-8b49-4807-a8ee-97a653d12cbc None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:43.464670 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28b1a3-8b49-4807-a8ee-97a653d12cbc None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:43.466081 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 138/270] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:43.471589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab94214-e2e6-45c7-a7f0-39e4f6c78190 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:43.472040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab94214-e2e6-45c7-a7f0-39e4f6c78190 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:43.472213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab94214-e2e6-45c7-a7f0-39e4f6c78190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:43.488895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9ab94214-e2e6-45c7-a7f0-39e4f6c78190 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:43.490060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9ab94214-e2e6-45c7-a7f0-39e4f6c78190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:43.534816 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cff505-885f-48cd-8ecd-f108be62dab7 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:43.535117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cff505-885f-48cd-8ecd-f108be62dab7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:43.535380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cff505-885f-48cd-8ecd-f108be62dab7 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:43.536930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 139/271] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:56:43.541637 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b10b1-5264-4852-be73-2351729e0d07 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:43.541926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b10b1-5264-4852-be73-2351729e0d07 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:43.542207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b10b1-5264-4852-be73-2351729e0d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:43.559374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c74b10b1-5264-4852-be73-2351729e0d07 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:43.559885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 133/272] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:43.560613 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c74b10b1-5264-4852-be73-2351729e0d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:43.586287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab94214-e2e6-45c7-a7f0-39e4f6c78190 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:43.641173 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 140/273] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:43.642630 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23c1e1-2619-4502-9844-2c1fa2cdb0bf None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:43.642920 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23c1e1-2619-4502-9844-2c1fa2cdb0bf None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:43.643196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23c1e1-2619-4502-9844-2c1fa2cdb0bf None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:43.644610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 141/274] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:43.650050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0bbf7-a4b7-4bc5-9b39-184ee31ff0d7 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:43.650335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0bbf7-a4b7-4bc5-9b39-184ee31ff0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:43.650913 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0bbf7-a4b7-4bc5-9b39-184ee31ff0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:43.670174 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0ce0bbf7-a4b7-4bc5-9b39-184ee31ff0d7 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:43.671466 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0ce0bbf7-a4b7-4bc5-9b39-184ee31ff0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:43.688148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab94214-e2e6-45c7-a7f0-39e4f6c78190 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:43.721897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca24a67-1232-4e30-939b-6b174d2fab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:43.722627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca24a67-1232-4e30-939b-6b174d2fab2a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:43.722910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca24a67-1232-4e30-939b-6b174d2fab2a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:43.723215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca24a67-1232-4e30-939b-6b174d2fab2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:43.724387 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca24a67-1232-4e30-939b-6b174d2fab2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:43.725848 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca24a67-1232-4e30-939b-6b174d2fab2a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:43.727627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 134/275] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:43.728334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca24a67-1232-4e30-939b-6b174d2fab2a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:43.740855 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 142/276] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:43.741560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0bbf7-a4b7-4bc5-9b39-184ee31ff0d7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:43.842451 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca24a67-1232-4e30-939b-6b174d2fab2a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:43.849672 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0bbf7-a4b7-4bc5-9b39-184ee31ff0d7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:43.882263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c0f6d-6def-4727-b75b-f78732d449cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:43.883063 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c0f6d-6def-4727-b75b-f78732d449cc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:43.883344 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c0f6d-6def-4727-b75b-f78732d449cc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:43.883643 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c0f6d-6def-4727-b75b-f78732d449cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:43.889410 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4beffc-36ed-486d-968b-3dc77574eecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:43.890076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4beffc-36ed-486d-968b-3dc77574eecc None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:43.890359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4beffc-36ed-486d-968b-3dc77574eecc None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:43.890635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4beffc-36ed-486d-968b-3dc77574eecc None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:43.891356 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4beffc-36ed-486d-968b-3dc77574eecc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:43.892826 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4beffc-36ed-486d-968b-3dc77574eecc None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:43.894721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c0f6d-6def-4727-b75b-f78732d449cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-891c0f6d-6def-4727-b75b-f78732d449cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:43.902372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:43.903263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:43.905166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:43.905166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:43.905166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:43.905166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:43.905166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:43.905166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:43.905166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:43.905166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:43.905166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:43.905166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:43.905166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:43.905166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:43.905166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 135/277] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:43.905166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c0f6d-6def-4727-b75b-f78732d449cc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:43.927995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 143/278] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:56:43 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:56:43.927995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4beffc-36ed-486d-968b-3dc77574eecc None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:44.025621 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c0f6d-6def-4727-b75b-f78732d449cc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:44.064319 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b6905-7b78-444c-b555-627f989c4c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:44.065128 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b6905-7b78-444c-b555-627f989c4c73 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:44.065411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b6905-7b78-444c-b555-627f989c4c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:44.065686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b6905-7b78-444c-b555-627f989c4c73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:44.070549 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4beffc-36ed-486d-968b-3dc77574eecc None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:44.077890 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b6905-7b78-444c-b555-627f989c4c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-be0b6905-7b78-444c-b555-627f989c4c73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:44.085824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:44.086785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:44.087557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:44.087557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:44.087557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:44.087557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:44.087557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:44.087557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:44.087557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:44.087557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:44.087557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:44.087557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:44.087557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:44.087557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:44.092363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 136/279] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:44.093867 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a115e27-af11-4216-b80c-4e4b0e041a74 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:44.094154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a115e27-af11-4216-b80c-4e4b0e041a74 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:44.094431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a115e27-af11-4216-b80c-4e4b0e041a74 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:44.096431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 137/280] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:44.100516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a115e27-af11-4216-b80c-4e4b0e041a74 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:44.111238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e86efe-2778-4221-973b-4f55d7cac20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:44.111973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e86efe-2778-4221-973b-4f55d7cac20b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:44.112251 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e86efe-2778-4221-973b-4f55d7cac20b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:44.112525 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e86efe-2778-4221-973b-4f55d7cac20b None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:44.113440 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e86efe-2778-4221-973b-4f55d7cac20b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:44.113748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e86efe-2778-4221-973b-4f55d7cac20b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:44.115195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e86efe-2778-4221-973b-4f55d7cac20b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:44.128872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 144/281] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:44.128872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e41eb5-c92d-4c63-8dbe-d9ff86ba6749 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:44.128872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e41eb5-c92d-4c63-8dbe-d9ff86ba6749 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:44.128872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e41eb5-c92d-4c63-8dbe-d9ff86ba6749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:44.143513 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a2e41eb5-c92d-4c63-8dbe-d9ff86ba6749 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:44.144711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a2e41eb5-c92d-4c63-8dbe-d9ff86ba6749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:44.219718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 145/282] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:44.223829 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e41eb5-c92d-4c63-8dbe-d9ff86ba6749 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:44.224596 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a115e27-af11-4216-b80c-4e4b0e041a74 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:44.280240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadeb05-456f-4854-ba98-120c8ca863ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:44.280883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadeb05-456f-4854-ba98-120c8ca863ce None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:44.281131 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadeb05-456f-4854-ba98-120c8ca863ce None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:44.281394 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadeb05-456f-4854-ba98-120c8ca863ce None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:44.282140 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadeb05-456f-4854-ba98-120c8ca863ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:44.282447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadeb05-456f-4854-ba98-120c8ca863ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:44.283875 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadeb05-456f-4854-ba98-120c8ca863ce None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:44.293992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 138/283] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:44.296111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadeb05-456f-4854-ba98-120c8ca863ce None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:44.335428 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e41eb5-c92d-4c63-8dbe-d9ff86ba6749 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:44.376646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60a39b-e2aa-4ae4-aa9c-43dc5a193e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:44.377526 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60a39b-e2aa-4ae4-aa9c-43dc5a193e04 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:44.377804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60a39b-e2aa-4ae4-aa9c-43dc5a193e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:44.378074 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60a39b-e2aa-4ae4-aa9c-43dc5a193e04 None admin] PATH_INFO: `/v3/users/b896827ba90d4bd18614b802668f08d5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:44.379282 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60a39b-e2aa-4ae4-aa9c-43dc5a193e04 None admin] RBAC: Authorizing `identity:get_user(user_id=b896827ba90d4bd18614b802668f08d5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:44.380874 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60a39b-e2aa-4ae4-aa9c-43dc5a193e04 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:44.382811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 146/284] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:44 2022] GET /identity/v3/users/b896827ba90d4bd18614b802668f08d5 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:44.383586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60a39b-e2aa-4ae4-aa9c-43dc5a193e04 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:44.416789 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadeb05-456f-4854-ba98-120c8ca863ce None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:44.460218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a0f76-4a0b-4620-b718-8094b62ab80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:44.461461 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a0f76-4a0b-4620-b718-8094b62ab80f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:44.461748 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a0f76-4a0b-4620-b718-8094b62ab80f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:44.462024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a0f76-4a0b-4620-b718-8094b62ab80f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:44.473864 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a0f76-4a0b-4620-b718-8094b62ab80f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-1a2a0f76-4a0b-4620-b718-8094b62ab80f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:44.481826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:44.482687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:44.484163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:44.484163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:44.484163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:44.484163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:44.484163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:44.484163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:44.484163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:44.484163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:44.484163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:44.484163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:44.484163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:44.484163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:44.484163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 139/285] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:44.484163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a0f76-4a0b-4620-b718-8094b62ab80f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:44.486769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60a39b-e2aa-4ae4-aa9c-43dc5a193e04 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:44.522277 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0885208-00c5-4faa-90f2-de0be77eeabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:44.523168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0885208-00c5-4faa-90f2-de0be77eeabd None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:44.523447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0885208-00c5-4faa-90f2-de0be77eeabd None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:44.523767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0885208-00c5-4faa-90f2-de0be77eeabd None admin] PATH_INFO: `/v3/users/53bdbe36cc144dcfae8cf0df88d77f93` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:44.539377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0885208-00c5-4faa-90f2-de0be77eeabd None admin] RBAC: Authorizing `identity:get_user(user_id=53bdbe36cc144dcfae8cf0df88d77f93)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:44.540789 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0885208-00c5-4faa-90f2-de0be77eeabd None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:44.543069 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 147/286] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:44 2022] GET /identity/v3/users/53bdbe36cc144dcfae8cf0df88d77f93 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:44.548528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0885208-00c5-4faa-90f2-de0be77eeabd None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:44.588561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a0f76-4a0b-4620-b718-8094b62ab80f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:44.632501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a0ce2-1341-4986-8421-2af2ba1c5ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:44.633951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a0ce2-1341-4986-8421-2af2ba1c5ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:44.634720 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a0ce2-1341-4986-8421-2af2ba1c5ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:44.635269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a0ce2-1341-4986-8421-2af2ba1c5ce4 None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:44.636796 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a0ce2-1341-4986-8421-2af2ba1c5ce4 None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:44.639696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a0ce2-1341-4986-8421-2af2ba1c5ce4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:44.642441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 140/287] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:44 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:44.643439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a0ce2-1341-4986-8421-2af2ba1c5ce4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:44.658227 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0885208-00c5-4faa-90f2-de0be77eeabd None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:44.693823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029bebb-afa7-4241-abc8-8d953d64941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:44.694668 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029bebb-afa7-4241-abc8-8d953d64941e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:44.695048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029bebb-afa7-4241-abc8-8d953d64941e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:44.695450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029bebb-afa7-4241-abc8-8d953d64941e None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:44.696332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029bebb-afa7-4241-abc8-8d953d64941e None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:44.696742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029bebb-afa7-4241-abc8-8d953d64941e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:44.698337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029bebb-afa7-4241-abc8-8d953d64941e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:44.710362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 148/288] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:44.711504 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029bebb-afa7-4241-abc8-8d953d64941e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:44.768108 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a0ce2-1341-4986-8421-2af2ba1c5ce4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:44.808191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dddaa4-16f9-45a0-bf34-bb639fb0b0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:44.809081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dddaa4-16f9-45a0-bf34-bb639fb0b0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:44.809528 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dddaa4-16f9-45a0-bf34-bb639fb0b0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:44.810010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dddaa4-16f9-45a0-bf34-bb639fb0b0e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:44.810979 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dddaa4-16f9-45a0-bf34-bb639fb0b0e1 None admin] RBAC: Adding query filter params (role.id=e613911293e3458c975cbab36cae354d, user.id=53bdbe36cc144dcfae8cf0df88d77f93, scope.system=all) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:44.811443 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dddaa4-16f9-45a0-bf34-bb639fb0b0e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:44.813049 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dddaa4-16f9-45a0-bf34-bb639fb0b0e1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:44.818653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 141/289] 10.222.0.48 () {56 vars in 1308 bytes} [Tue May 17 16:56:44 2022] GET /identity/v3/role_assignments?user.id=53bdbe36cc144dcfae8cf0df88d77f93&scope.system=all&role.id=e613911293e3458c975cbab36cae354d => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:44.819664 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dddaa4-16f9-45a0-bf34-bb639fb0b0e1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:44.824686 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029bebb-afa7-4241-abc8-8d953d64941e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:44.862207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4766b6-b6e2-45d5-920e-1f850883afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:44.863376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4766b6-b6e2-45d5-920e-1f850883afb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:44.863376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4766b6-b6e2-45d5-920e-1f850883afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:44.863712 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4766b6-b6e2-45d5-920e-1f850883afb9 None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0/users/b896827ba90d4bd18614b802668f08d5/roles/b216a326d0f24273b3cceab46bd3e208` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:44.865821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4766b6-b6e2-45d5-920e-1f850883afb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5597d4acc0664c3e805bd547a6173ed0, user_id=b896827ba90d4bd18614b802668f08d5, role_id=b216a326d0f24273b3cceab46bd3e208)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:44.867342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4766b6-b6e2-45d5-920e-1f850883afb9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:44.885172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 149/290] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:56:44 2022] PUT /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0/users/b896827ba90d4bd18614b802668f08d5/roles/b216a326d0f24273b3cceab46bd3e208 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:56:44.939949 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dddaa4-16f9-45a0-bf34-bb639fb0b0e1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:44.982507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be3f0f-91ff-47a0-a947-5f4ef0db0327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:44.983871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be3f0f-91ff-47a0-a947-5f4ef0db0327 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:44.984293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be3f0f-91ff-47a0-a947-5f4ef0db0327 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:44.984734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be3f0f-91ff-47a0-a947-5f4ef0db0327 None admin] PATH_INFO: `/v3/users/0d56d01bbc68443a9a1e59998ad77866` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:44.986258 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be3f0f-91ff-47a0-a947-5f4ef0db0327 None admin] RBAC: Authorizing `identity:get_user(user_id=0d56d01bbc68443a9a1e59998ad77866)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:44.987998 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be3f0f-91ff-47a0-a947-5f4ef0db0327 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:44.990084 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 142/291] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:44 2022] GET /identity/v3/users/0d56d01bbc68443a9a1e59998ad77866 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:44.996304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4766b6-b6e2-45d5-920e-1f850883afb9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:45.108534 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4766b6-b6e2-45d5-920e-1f850883afb9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:45.147137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc9786-291b-41c1-b21c-8ad93c9c7762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:45.147833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc9786-291b-41c1-b21c-8ad93c9c7762 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:45.148113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc9786-291b-41c1-b21c-8ad93c9c7762 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:45.148384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc9786-291b-41c1-b21c-8ad93c9c7762 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:45.231443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc9786-291b-41c1-b21c-8ad93c9c7762 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:45.233042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc9786-291b-41c1-b21c-8ad93c9c7762 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:45.335062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 150/292] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:45.340637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be3f0f-91ff-47a0-a947-5f4ef0db0327 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:45.441809 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be3f0f-91ff-47a0-a947-5f4ef0db0327 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:45.479180 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9321d48-b974-4c9d-9ab4-30c53b5a065a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:45.480067 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9321d48-b974-4c9d-9ab4-30c53b5a065a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:45.480346 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9321d48-b974-4c9d-9ab4-30c53b5a065a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:45.480614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9321d48-b974-4c9d-9ab4-30c53b5a065a None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:45.484336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9321d48-b974-4c9d-9ab4-30c53b5a065a None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:45.485868 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9321d48-b974-4c9d-9ab4-30c53b5a065a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:45.487923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 143/293] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:45 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:45.493538 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc9786-291b-41c1-b21c-8ad93c9c7762 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:45.600005 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc9786-291b-41c1-b21c-8ad93c9c7762 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:45.634107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec65b1-6483-4007-89da-edd07ef64012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:45.634764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec65b1-6483-4007-89da-edd07ef64012 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:45.635043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec65b1-6483-4007-89da-edd07ef64012 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:45.635316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec65b1-6483-4007-89da-edd07ef64012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:45.636406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec65b1-6483-4007-89da-edd07ef64012 None admin] RBAC: Adding query filter params (role.id=e613911293e3458c975cbab36cae354d, scope.project.id=5597d4acc0664c3e805bd547a6173ed0, user.id=0d56d01bbc68443a9a1e59998ad77866) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:45.636719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec65b1-6483-4007-89da-edd07ef64012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:45.638750 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec65b1-6483-4007-89da-edd07ef64012 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:45.645493 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 151/294] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:45 2022] GET /identity/v3/role_assignments?user.id=0d56d01bbc68443a9a1e59998ad77866&scope.project.id=5597d4acc0664c3e805bd547a6173ed0&role.id=e613911293e3458c975cbab36cae354d => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:46.671385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aec043-5267-445a-ae71-e5bdc7b3cecc None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:46.671931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aec043-5267-445a-ae71-e5bdc7b3cecc None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:46.671931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aec043-5267-445a-ae71-e5bdc7b3cecc None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:46.673535 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 144/295] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:46.678928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85fc6e-1b21-4136-b734-2459fb0658db None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:46.679321 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85fc6e-1b21-4136-b734-2459fb0658db None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:46.679485 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85fc6e-1b21-4136-b734-2459fb0658db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:46.696588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ee85fc6e-1b21-4136-b734-2459fb0658db None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:46.697740 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ee85fc6e-1b21-4136-b734-2459fb0658db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:46.758731 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3bb4a-7614-40bc-8880-401685e38c29 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:46.759034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3bb4a-7614-40bc-8880-401685e38c29 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:46.759287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3bb4a-7614-40bc-8880-401685e38c29 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:46.760834 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 145/296] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:46.766287 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 152/297] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:46.766501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1fd2b-2949-49a8-8011-8b6e20d360f8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:46.766744 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1fd2b-2949-49a8-8011-8b6e20d360f8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:46.767092 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1fd2b-2949-49a8-8011-8b6e20d360f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:46.784363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ade1fd2b-2949-49a8-8011-8b6e20d360f8 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:46.785549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ade1fd2b-2949-49a8-8011-8b6e20d360f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:46.795288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85fc6e-1b21-4136-b734-2459fb0658db None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:46.852846 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 146/298] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:46.876847 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1fd2b-2949-49a8-8011-8b6e20d360f8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:46.900768 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85fc6e-1b21-4136-b734-2459fb0658db None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:46.935936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa767e0-5220-4436-b48d-240245590f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:46.936652 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa767e0-5220-4436-b48d-240245590f4c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:46.936925 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa767e0-5220-4436-b48d-240245590f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:46.937192 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa767e0-5220-4436-b48d-240245590f4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:46.947854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa767e0-5220-4436-b48d-240245590f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-7aa767e0-5220-4436-b48d-240245590f4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:46.956374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:46.957266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:46.958045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:46.958045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:46.958045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:46.958045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:46.958045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:46.958045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:46.958045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:46.958045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:46.958045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:46.958045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:46.958045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:46.958045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:46.958045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 153/299] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:56:46.963376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa767e0-5220-4436-b48d-240245590f4c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:46.977740 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1fd2b-2949-49a8-8011-8b6e20d360f8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:47.012597 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740026f9-79de-4e7c-8bd8-985acdcff806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:47.013483 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740026f9-79de-4e7c-8bd8-985acdcff806 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:47.013824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740026f9-79de-4e7c-8bd8-985acdcff806 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:47.014102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740026f9-79de-4e7c-8bd8-985acdcff806 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:47.015318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740026f9-79de-4e7c-8bd8-985acdcff806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:47.016816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740026f9-79de-4e7c-8bd8-985acdcff806 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:47.018606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 147/300] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:47.024166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740026f9-79de-4e7c-8bd8-985acdcff806 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:47.062412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa767e0-5220-4436-b48d-240245590f4c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:47.099343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338b14e-0550-490a-89a0-dc99c95cc4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:47.100130 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338b14e-0550-490a-89a0-dc99c95cc4ba None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:47.100412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338b14e-0550-490a-89a0-dc99c95cc4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:47.100734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338b14e-0550-490a-89a0-dc99c95cc4ba None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:47.101996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338b14e-0550-490a-89a0-dc99c95cc4ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:47.102302 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338b14e-0550-490a-89a0-dc99c95cc4ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:47.104073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338b14e-0550-490a-89a0-dc99c95cc4ba None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:47.119692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 154/301] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:47.125241 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338b14e-0550-490a-89a0-dc99c95cc4ba None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:47.138855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740026f9-79de-4e7c-8bd8-985acdcff806 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:47.182901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd246e67-236c-44a6-b672-0fa8380d1fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:47.183766 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246e67-236c-44a6-b672-0fa8380d1fa1 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:47.184144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246e67-236c-44a6-b672-0fa8380d1fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:47.185426 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246e67-236c-44a6-b672-0fa8380d1fa1 None admin] PATH_INFO: `/v3/groups` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:47.186636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd246e67-236c-44a6-b672-0fa8380d1fa1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:47.188706 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd246e67-236c-44a6-b672-0fa8380d1fa1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:47.209089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 148/302] 10.222.0.48 () {60 vars in 1134 bytes} [Tue May 17 16:56:47 2022] POST /identity/v3/groups => generated 229 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:56:47.239795 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338b14e-0550-490a-89a0-dc99c95cc4ba None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:47.279226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e87f5a-aeff-4151-8e8a-222886074d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:47.280177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87f5a-aeff-4151-8e8a-222886074d47 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:47.280505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87f5a-aeff-4151-8e8a-222886074d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:47.280810 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87f5a-aeff-4151-8e8a-222886074d47 None admin] PATH_INFO: `/v3/users/6734057813d94904abc67e8711020a99` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:47.298102 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e87f5a-aeff-4151-8e8a-222886074d47 None admin] RBAC: Authorizing `identity:get_user(user_id=6734057813d94904abc67e8711020a99)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:47.299648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e87f5a-aeff-4151-8e8a-222886074d47 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:47.301987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 155/303] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:47 2022] GET /identity/v3/users/6734057813d94904abc67e8711020a99 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:47.307400 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd246e67-236c-44a6-b672-0fa8380d1fa1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:47.332539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c16f8-0a17-4adf-816f-9a19cca2c1e0 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:47.332822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c16f8-0a17-4adf-816f-9a19cca2c1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:47.333099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c16f8-0a17-4adf-816f-9a19cca2c1e0 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:47.334481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 156/304] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:56:47.340355 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7296409-ae24-446f-9fe4-79f7266d477b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:47.340636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7296409-ae24-446f-9fe4-79f7266d477b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:47.340980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7296409-ae24-446f-9fe4-79f7266d477b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:47.358874 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f7296409-ae24-446f-9fe4-79f7266d477b None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:47.360190 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f7296409-ae24-446f-9fe4-79f7266d477b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:47.421450 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd246e67-236c-44a6-b672-0fa8380d1fa1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:47.447091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 157/305] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:47.470086 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737c47d-f2fa-40da-a1e2-c6406634de90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:47.470743 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7296409-ae24-446f-9fe4-79f7266d477b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:47.470874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737c47d-f2fa-40da-a1e2-c6406634de90 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:47.471034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737c47d-f2fa-40da-a1e2-c6406634de90 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:47.471304 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737c47d-f2fa-40da-a1e2-c6406634de90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:47.472187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737c47d-f2fa-40da-a1e2-c6406634de90 None admin] RBAC: Adding query filter params (role.id=b216a326d0f24273b3cceab46bd3e208, user.id=6734057813d94904abc67e8711020a99, scope.system=all) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:47.472570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737c47d-f2fa-40da-a1e2-c6406634de90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:47.474045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737c47d-f2fa-40da-a1e2-c6406634de90 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:47.479707 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 149/306] 10.222.0.48 () {56 vars in 1308 bytes} [Tue May 17 16:56:47 2022] GET /identity/v3/role_assignments?user.id=6734057813d94904abc67e8711020a99&scope.system=all&role.id=b216a326d0f24273b3cceab46bd3e208 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:47.580637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8c781-a9df-43b4-9b73-be646eb4258e None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:47.580965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8c781-a9df-43b4-9b73-be646eb4258e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:47.581201 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8c781-a9df-43b4-9b73-be646eb4258e None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:47.582920 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 150/307] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:56:47.585024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7296409-ae24-446f-9fe4-79f7266d477b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:47.588944 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53276c16-4b57-4079-9b14-7675946c8bd9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:47.589222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53276c16-4b57-4079-9b14-7675946c8bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:47.589501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53276c16-4b57-4079-9b14-7675946c8bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:47.608259 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-53276c16-4b57-4079-9b14-7675946c8bd9 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:47.609484 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-53276c16-4b57-4079-9b14-7675946c8bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:47.636466 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd38614-8b29-47ae-a635-67907a400544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:47.637474 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd38614-8b29-47ae-a635-67907a400544 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:47.637958 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd38614-8b29-47ae-a635-67907a400544 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:47.638238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd38614-8b29-47ae-a635-67907a400544 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:47.653184 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd38614-8b29-47ae-a635-67907a400544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-5cd38614-8b29-47ae-a635-67907a400544 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:47.664180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:47.665137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:47.665910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:47.665910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:47.665910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:47.665910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:47.665910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:47.665910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:47.665910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:47.665910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:47.665910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:47.665910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:47.665910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:47.665910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:47.666497 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 158/308] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:56:47.672009 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd38614-8b29-47ae-a635-67907a400544 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:47.682140 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 151/309] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:47.706478 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53276c16-4b57-4079-9b14-7675946c8bd9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:47.776141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd38614-8b29-47ae-a635-67907a400544 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:47.808074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53276c16-4b57-4079-9b14-7675946c8bd9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:47.812000 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6256d4-67f4-4991-ac03-d1773c92e0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:47.812668 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6256d4-67f4-4991-ac03-d1773c92e0ac None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:47.812988 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6256d4-67f4-4991-ac03-d1773c92e0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:47.813269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6256d4-67f4-4991-ac03-d1773c92e0ac None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:47.814323 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6256d4-67f4-4991-ac03-d1773c92e0ac None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:47.814628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6256d4-67f4-4991-ac03-d1773c92e0ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:47.816058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6256d4-67f4-4991-ac03-d1773c92e0ac None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:47.827860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 159/310] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:47.830114 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6256d4-67f4-4991-ac03-d1773c92e0ac None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:47.844811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6a43c-19dc-4f54-9a86-54cecc9da5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:47.845652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6a43c-19dc-4f54-9a86-54cecc9da5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:47.845937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6a43c-19dc-4f54-9a86-54cecc9da5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:47.846212 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6a43c-19dc-4f54-9a86-54cecc9da5d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:47.858827 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6a43c-19dc-4f54-9a86-54cecc9da5d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-dbe6a43c-19dc-4f54-9a86-54cecc9da5d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:47.869768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:47.870640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:47.871424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:47.871424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:47.871424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:47.871424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:47.871424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:47.871424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:47.871424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:47.871424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:47.871424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:47.871424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:47.871424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:47.871424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:47.871424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 152/311] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:56:47.877616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6a43c-19dc-4f54-9a86-54cecc9da5d0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:47.936999 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6256d4-67f4-4991-ac03-d1773c92e0ac None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:47.971093 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f987c3-8814-4af8-bca0-c7996735cfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:47.971939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f987c3-8814-4af8-bca0-c7996735cfab None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:47.972194 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f987c3-8814-4af8-bca0-c7996735cfab None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:47.972464 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f987c3-8814-4af8-bca0-c7996735cfab None admin] PATH_INFO: `/v3/users/53bdbe36cc144dcfae8cf0df88d77f93` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:47.973664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f987c3-8814-4af8-bca0-c7996735cfab None admin] RBAC: Authorizing `identity:get_user(user_id=53bdbe36cc144dcfae8cf0df88d77f93)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:47.975067 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f987c3-8814-4af8-bca0-c7996735cfab None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:47.976854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 160/312] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:47 2022] GET /identity/v3/users/53bdbe36cc144dcfae8cf0df88d77f93 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:47.977675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6a43c-19dc-4f54-9a86-54cecc9da5d0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:47.982266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f987c3-8814-4af8-bca0-c7996735cfab None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:48.024021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c6db1-13ab-4585-a659-f1188312fc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:48.024696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c6db1-13ab-4585-a659-f1188312fc17 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:48.024973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c6db1-13ab-4585-a659-f1188312fc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:48.025242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c6db1-13ab-4585-a659-f1188312fc17 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:48.026051 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c6db1-13ab-4585-a659-f1188312fc17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:48.026359 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c6db1-13ab-4585-a659-f1188312fc17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:48.027831 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c6db1-13ab-4585-a659-f1188312fc17 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:48.041877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 153/313] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:48.043866 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c6db1-13ab-4585-a659-f1188312fc17 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:48.107767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f987c3-8814-4af8-bca0-c7996735cfab None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:48.149514 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791fe37-b6bd-454c-a726-a9b52d6626fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:48.150910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791fe37-b6bd-454c-a726-a9b52d6626fd None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:48.151334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791fe37-b6bd-454c-a726-a9b52d6626fd None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:48.151790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791fe37-b6bd-454c-a726-a9b52d6626fd None admin] PATH_INFO: `/v3/system/users/53bdbe36cc144dcfae8cf0df88d77f93/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:48.152441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c6db1-13ab-4585-a659-f1188312fc17 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:48.154174 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791fe37-b6bd-454c-a726-a9b52d6626fd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=53bdbe36cc144dcfae8cf0df88d77f93, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:48.156580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791fe37-b6bd-454c-a726-a9b52d6626fd None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:48.170186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 161/314] 10.222.0.48 () {58 vars in 1334 bytes} [Tue May 17 16:56:47 2022] PUT /identity/v3/system/users/53bdbe36cc144dcfae8cf0df88d77f93/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 16:56:48.194778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87161034-92e6-4bbd-a423-c55f12bd064a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:48.196184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87161034-92e6-4bbd-a423-c55f12bd064a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:48.196665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87161034-92e6-4bbd-a423-c55f12bd064a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:48.197230 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87161034-92e6-4bbd-a423-c55f12bd064a None admin] PATH_INFO: `/v3/users/b896827ba90d4bd18614b802668f08d5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:48.199133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87161034-92e6-4bbd-a423-c55f12bd064a None admin] RBAC: Authorizing `identity:get_user(user_id=b896827ba90d4bd18614b802668f08d5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:48.201531 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87161034-92e6-4bbd-a423-c55f12bd064a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:48.207917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 154/315] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:48 2022] GET /identity/v3/users/b896827ba90d4bd18614b802668f08d5 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:48.210096 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791fe37-b6bd-454c-a726-a9b52d6626fd None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:48.328059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791fe37-b6bd-454c-a726-a9b52d6626fd None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:48.368627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab329d-ed28-4931-9c75-c6a33f4808e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:48.369339 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab329d-ed28-4931-9c75-c6a33f4808e8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:48.369622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab329d-ed28-4931-9c75-c6a33f4808e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:48.369893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab329d-ed28-4931-9c75-c6a33f4808e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:48.439165 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab329d-ed28-4931-9c75-c6a33f4808e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:48.440665 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab329d-ed28-4931-9c75-c6a33f4808e8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:48.547628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 162/316] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:48.550243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87161034-92e6-4bbd-a423-c55f12bd064a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:48.655470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87161034-92e6-4bbd-a423-c55f12bd064a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:48.690129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4300bf-e4b5-4d7b-87f6-408385672f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:48.691729 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4300bf-e4b5-4d7b-87f6-408385672f94 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:48.692159 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4300bf-e4b5-4d7b-87f6-408385672f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:48.692579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4300bf-e4b5-4d7b-87f6-408385672f94 None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:48.693947 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4300bf-e4b5-4d7b-87f6-408385672f94 None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:48.695532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4300bf-e4b5-4d7b-87f6-408385672f94 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:48.697440 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 155/317] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:48 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:48.704331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab329d-ed28-4931-9c75-c6a33f4808e8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:48.803950 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab329d-ed28-4931-9c75-c6a33f4808e8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:48.838604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be09320-e674-4265-8d17-7cb3d29a2a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:48.839259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be09320-e674-4265-8d17-7cb3d29a2a92 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:48.839538 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be09320-e674-4265-8d17-7cb3d29a2a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:48.839838 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be09320-e674-4265-8d17-7cb3d29a2a92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:48.840662 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be09320-e674-4265-8d17-7cb3d29a2a92 None admin] RBAC: Adding query filter params (role.id=b216a326d0f24273b3cceab46bd3e208, scope.project.id=5597d4acc0664c3e805bd547a6173ed0, user.id=b896827ba90d4bd18614b802668f08d5) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:48.841527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be09320-e674-4265-8d17-7cb3d29a2a92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:48.842980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be09320-e674-4265-8d17-7cb3d29a2a92 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:48.855753 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 163/318] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:56:48 2022] GET /identity/v3/role_assignments?user.id=b896827ba90d4bd18614b802668f08d5&scope.project.id=5597d4acc0664c3e805bd547a6173ed0&role.id=b216a326d0f24273b3cceab46bd3e208 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:49.591676 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db312a-1ba4-4ba2-9e99-7fb4e63789d5 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:49.592017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db312a-1ba4-4ba2-9e99-7fb4e63789d5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:49.592292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db312a-1ba4-4ba2-9e99-7fb4e63789d5 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:49.593648 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 156/319] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:49.599540 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca44f0-c500-4f36-a2af-236e2f01035e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:49.599973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca44f0-c500-4f36-a2af-236e2f01035e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:49.600152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca44f0-c500-4f36-a2af-236e2f01035e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:49.617018 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0dca44f0-c500-4f36-a2af-236e2f01035e None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:49.618184 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0dca44f0-c500-4f36-a2af-236e2f01035e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:49.681528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 164/320] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:49.704427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db312a-1ba4-4ba2-9e99-7fb4e63789d5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:49.764375 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75a1a-d437-44f5-bb3f-092653299209 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:49.764672 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75a1a-d437-44f5-bb3f-092653299209 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:49.764947 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75a1a-d437-44f5-bb3f-092653299209 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:49.766327 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 165/321] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:56:49.771371 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3dc05-8beb-44d1-a291-ca0ffb79edc0 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:49.771695 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3dc05-8beb-44d1-a291-ca0ffb79edc0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:49.771968 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3dc05-8beb-44d1-a291-ca0ffb79edc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:49.789436 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d9f3dc05-8beb-44d1-a291-ca0ffb79edc0 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:49.790595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d9f3dc05-8beb-44d1-a291-ca0ffb79edc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:49.806000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db312a-1ba4-4ba2-9e99-7fb4e63789d5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:49.839284 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab0c37-fc86-4d19-9352-3e37577fec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:49.840105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab0c37-fc86-4d19-9352-3e37577fec99 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:49.840383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab0c37-fc86-4d19-9352-3e37577fec99 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:49.840650 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab0c37-fc86-4d19-9352-3e37577fec99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:49.842273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab0c37-fc86-4d19-9352-3e37577fec99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:49.843671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab0c37-fc86-4d19-9352-3e37577fec99 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:49.849791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 157/322] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:56:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:49.850707 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab0c37-fc86-4d19-9352-3e37577fec99 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:49.860534 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 166/323] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:49.881853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3dc05-8beb-44d1-a291-ca0ffb79edc0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:49.948006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab0c37-fc86-4d19-9352-3e37577fec99 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:49.978151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3dc05-8beb-44d1-a291-ca0ffb79edc0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:49.981809 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70594fa-04c3-4020-aa8c-71a18f307a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:49.982479 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70594fa-04c3-4020-aa8c-71a18f307a03 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:49.982766 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70594fa-04c3-4020-aa8c-71a18f307a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:49.983041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70594fa-04c3-4020-aa8c-71a18f307a03 None admin] PATH_INFO: `/v3/groups` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:49.983766 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70594fa-04c3-4020-aa8c-71a18f307a03 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:49.985214 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70594fa-04c3-4020-aa8c-71a18f307a03 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:50.000239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 158/324] 10.222.0.48 () {60 vars in 1134 bytes} [Tue May 17 16:56:49 2022] POST /identity/v3/groups => generated 226 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:56:50.015651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21173a80-70b0-4866-91fe-a4de9c184968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:50.016472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21173a80-70b0-4866-91fe-a4de9c184968 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:50.016749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21173a80-70b0-4866-91fe-a4de9c184968 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:50.017017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21173a80-70b0-4866-91fe-a4de9c184968 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:50.029306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21173a80-70b0-4866-91fe-a4de9c184968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-21173a80-70b0-4866-91fe-a4de9c184968 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:50.037261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:50.038267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:50.039054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:50.039054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:50.039054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:50.039054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:50.039054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:50.039054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:50.039054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:50.039054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:50.039054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:50.039054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:50.039054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:50.039054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:50.043512 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 167/325] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:56:50.047640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70594fa-04c3-4020-aa8c-71a18f307a03 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:50.154207 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70594fa-04c3-4020-aa8c-71a18f307a03 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:50.190868 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01614a71-ff91-437e-a5b0-934ef6f0416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:50.191542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01614a71-ff91-437e-a5b0-934ef6f0416a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:50.191850 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01614a71-ff91-437e-a5b0-934ef6f0416a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:50.192126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01614a71-ff91-437e-a5b0-934ef6f0416a None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:50.192873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01614a71-ff91-437e-a5b0-934ef6f0416a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:50.193178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01614a71-ff91-437e-a5b0-934ef6f0416a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:50.194574 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01614a71-ff91-437e-a5b0-934ef6f0416a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:50.207542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 159/326] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:50.208856 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21173a80-70b0-4866-91fe-a4de9c184968 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:50.322143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21173a80-70b0-4866-91fe-a4de9c184968 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:50.358688 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41886385-e354-497c-8f17-164f95bc6882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:50.359886 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41886385-e354-497c-8f17-164f95bc6882 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:50.360305 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41886385-e354-497c-8f17-164f95bc6882 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:50.360733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41886385-e354-497c-8f17-164f95bc6882 None admin] PATH_INFO: `/v3/users/6734057813d94904abc67e8711020a99` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:50.362082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41886385-e354-497c-8f17-164f95bc6882 None admin] RBAC: Authorizing `identity:get_user(user_id=6734057813d94904abc67e8711020a99)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:50.363536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41886385-e354-497c-8f17-164f95bc6882 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:50.365345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 168/327] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:50 2022] GET /identity/v3/users/6734057813d94904abc67e8711020a99 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:50.370714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01614a71-ff91-437e-a5b0-934ef6f0416a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:50.475055 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01614a71-ff91-437e-a5b0-934ef6f0416a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:50.498727 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09472f-4a4a-4819-990f-11ecb9920a6b None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:50.499066 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09472f-4a4a-4819-990f-11ecb9920a6b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:50.499270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09472f-4a4a-4819-990f-11ecb9920a6b None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:50.500653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 169/328] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:56:50.506918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0f8e5-2c3c-4b58-b153-f0d2cf558c11 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:50.507200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0f8e5-2c3c-4b58-b153-f0d2cf558c11 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:50.507475 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0f8e5-2c3c-4b58-b153-f0d2cf558c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:50.515147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be66a3-68e6-4802-afff-07fb671c5a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:50.516364 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be66a3-68e6-4802-afff-07fb671c5a54 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:50.516871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be66a3-68e6-4802-afff-07fb671c5a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:50.517149 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be66a3-68e6-4802-afff-07fb671c5a54 None admin] PATH_INFO: `/v3/system/users/6734057813d94904abc67e8711020a99/roles/b216a326d0f24273b3cceab46bd3e208` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:50.518687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be66a3-68e6-4802-afff-07fb671c5a54 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6734057813d94904abc67e8711020a99, role_id=b216a326d0f24273b3cceab46bd3e208)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:50.520156 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be66a3-68e6-4802-afff-07fb671c5a54 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:50.529916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e1a0f8e5-2c3c-4b58-b153-f0d2cf558c11 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:50.531690 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e1a0f8e5-2c3c-4b58-b153-f0d2cf558c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:50.533051 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 160/329] 10.222.0.48 () {58 vars in 1334 bytes} [Tue May 17 16:56:50 2022] PUT /identity/v3/system/users/6734057813d94904abc67e8711020a99/roles/b216a326d0f24273b3cceab46bd3e208 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:56:50.623749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 170/330] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:50.654965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be66a3-68e6-4802-afff-07fb671c5a54 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:50.774661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be66a3-68e6-4802-afff-07fb671c5a54 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:50.812679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6923a6-1d91-42ee-b4e5-3920ebbc97dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:50.813485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6923a6-1d91-42ee-b4e5-3920ebbc97dc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:50.814032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6923a6-1d91-42ee-b4e5-3920ebbc97dc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:50.814304 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6923a6-1d91-42ee-b4e5-3920ebbc97dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:50.829987 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6923a6-1d91-42ee-b4e5-3920ebbc97dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-7c6923a6-1d91-42ee-b4e5-3920ebbc97dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:50.838357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:50.839349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:50.840844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:50.840844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:50.840844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:50.840844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:50.840844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:50.840844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:50.840844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:50.840844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:50.840844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:50.840844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:50.840844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:50.840844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:50.840844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 161/331] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:50.847977 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0f8e5-2c3c-4b58-b153-f0d2cf558c11 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:50.952726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0f8e5-2c3c-4b58-b153-f0d2cf558c11 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:50.993682 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dede8f-7229-4e58-afd6-957f637568ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:50.994365 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dede8f-7229-4e58-afd6-957f637568ca None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:50.994645 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dede8f-7229-4e58-afd6-957f637568ca None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:50.994914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dede8f-7229-4e58-afd6-957f637568ca None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:50.995679 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dede8f-7229-4e58-afd6-957f637568ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:50.995983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dede8f-7229-4e58-afd6-957f637568ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:50.997939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dede8f-7229-4e58-afd6-957f637568ca None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:51.010042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 171/332] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:51.015704 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6923a6-1d91-42ee-b4e5-3920ebbc97dc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:51.167394 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6923a6-1d91-42ee-b4e5-3920ebbc97dc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:51.211586 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43483c2-f729-4bc9-8e38-3083a38ef5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:51.212410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43483c2-f729-4bc9-8e38-3083a38ef5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:51.212693 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43483c2-f729-4bc9-8e38-3083a38ef5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:51.212967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43483c2-f729-4bc9-8e38-3083a38ef5b1 None admin] PATH_INFO: `/v3/users/53bdbe36cc144dcfae8cf0df88d77f93` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:51.220364 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43483c2-f729-4bc9-8e38-3083a38ef5b1 None admin] RBAC: Authorizing `identity:get_user(user_id=53bdbe36cc144dcfae8cf0df88d77f93)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:51.221840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43483c2-f729-4bc9-8e38-3083a38ef5b1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:51.223707 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 162/333] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:51 2022] GET /identity/v3/users/53bdbe36cc144dcfae8cf0df88d77f93 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:51.229924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dede8f-7229-4e58-afd6-957f637568ca None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:51.354385 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dede8f-7229-4e58-afd6-957f637568ca None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:51.410739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31883e2-c80a-4c4f-b151-7f5c0fc26bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:51.411887 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31883e2-c80a-4c4f-b151-7f5c0fc26bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:51.412400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31883e2-c80a-4c4f-b151-7f5c0fc26bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:51.412940 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31883e2-c80a-4c4f-b151-7f5c0fc26bf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:51.414011 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31883e2-c80a-4c4f-b151-7f5c0fc26bf2 None admin] RBAC: Adding query filter params (role.id=e613911293e3458c975cbab36cae354d, user.id=53bdbe36cc144dcfae8cf0df88d77f93, scope.system=all) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:51.414578 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31883e2-c80a-4c4f-b151-7f5c0fc26bf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:51.416345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31883e2-c80a-4c4f-b151-7f5c0fc26bf2 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:51.435935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 172/334] 10.222.0.48 () {56 vars in 1308 bytes} [Tue May 17 16:56:51 2022] GET /identity/v3/role_assignments?user.id=53bdbe36cc144dcfae8cf0df88d77f93&scope.system=all&role.id=e613911293e3458c975cbab36cae354d => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:52.941200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594854-5038-482a-8517-8f356305a359 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:52.941737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594854-5038-482a-8517-8f356305a359 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:52.941737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594854-5038-482a-8517-8f356305a359 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:52.943394 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 163/335] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:52.948572 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da03766-56bb-4ba1-9791-091b199aa5a3 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:52.948984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da03766-56bb-4ba1-9791-091b199aa5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:52.949157 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da03766-56bb-4ba1-9791-091b199aa5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:52.976591 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0da03766-56bb-4ba1-9791-091b199aa5a3 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:52.977778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0da03766-56bb-4ba1-9791-091b199aa5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:53.057742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 173/336] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:53.082059 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c594854-5038-482a-8517-8f356305a359 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:53.204692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c594854-5038-482a-8517-8f356305a359 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:53.253010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605691d-9d61-4db7-a2ab-c4258df7c6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:53.253833 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605691d-9d61-4db7-a2ab-c4258df7c6eb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:53.254111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605691d-9d61-4db7-a2ab-c4258df7c6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:53.254382 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605691d-9d61-4db7-a2ab-c4258df7c6eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:53.269841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605691d-9d61-4db7-a2ab-c4258df7c6eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-7605691d-9d61-4db7-a2ab-c4258df7c6eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:53.278874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:53.279780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:53.280566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:53.280566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:53.280566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:53.280566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:53.280566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:53.280566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:53.280566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:53.280566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:53.280566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:53.280566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:53.280566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:53.280566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:53.280566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 164/337] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:56:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:53.286016 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da03766-56bb-4ba1-9791-091b199aa5a3 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:53.340202 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ce2c5-66b3-4383-a2f5-803379f9db34 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:53.340541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ce2c5-66b3-4383-a2f5-803379f9db34 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:53.341378 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ce2c5-66b3-4383-a2f5-803379f9db34 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:53.343374 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 165/338] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:56:53.352748 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342f872-463d-480d-8ea7-9dde7c429700 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:53.353303 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342f872-463d-480d-8ea7-9dde7c429700 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:53.353760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342f872-463d-480d-8ea7-9dde7c429700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:53.384678 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c342f872-463d-480d-8ea7-9dde7c429700 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:53.386175 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c342f872-463d-480d-8ea7-9dde7c429700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:53.424448 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da03766-56bb-4ba1-9791-091b199aa5a3 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:53.484377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c4c73-e87e-4e6d-ba42-f2a90cd41a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:53.485347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c4c73-e87e-4e6d-ba42-f2a90cd41a9f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:53.485823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c4c73-e87e-4e6d-ba42-f2a90cd41a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:53.486268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c4c73-e87e-4e6d-ba42-f2a90cd41a9f None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:53.487190 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c4c73-e87e-4e6d-ba42-f2a90cd41a9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:53.487701 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c4c73-e87e-4e6d-ba42-f2a90cd41a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:53.489361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c4c73-e87e-4e6d-ba42-f2a90cd41a9f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:53.495703 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 166/339] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:53.498187 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 174/340] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:56:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:53.503565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342f872-463d-480d-8ea7-9dde7c429700 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:53.545527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c4c73-e87e-4e6d-ba42-f2a90cd41a9f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:53.613616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342f872-463d-480d-8ea7-9dde7c429700 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:53.658557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5882237-7d37-464b-ba7d-6a2cb5f91a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:53.659224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5882237-7d37-464b-ba7d-6a2cb5f91a4d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:53.659503 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5882237-7d37-464b-ba7d-6a2cb5f91a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:53.659801 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5882237-7d37-464b-ba7d-6a2cb5f91a4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:53.721484 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c4c73-e87e-4e6d-ba42-f2a90cd41a9f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:53.797297 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62723301-b28c-423a-a926-682cee8da090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:53.798484 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62723301-b28c-423a-a926-682cee8da090 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:53.798981 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62723301-b28c-423a-a926-682cee8da090 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:53.799456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62723301-b28c-423a-a926-682cee8da090 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:53.800641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5882237-7d37-464b-ba7d-6a2cb5f91a4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:53.802124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5882237-7d37-464b-ba7d-6a2cb5f91a4d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:53.824468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62723301-b28c-423a-a926-682cee8da090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-62723301-b28c-423a-a926-682cee8da090 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:53.832766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:53.833655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:53.834422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:53.834422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:53.834422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:53.834422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:53.834422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:53.834422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:53.834422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:53.834422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:53.834422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:53.834422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:53.834422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:53.834422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:53.837149 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 175/341] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:56:53.843165 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62723301-b28c-423a-a926-682cee8da090 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:53.983358 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62723301-b28c-423a-a926-682cee8da090 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:53.997728 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 167/342] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:53.999130 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d4881-9423-4134-bf46-7c15fad79358 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:53.999373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d4881-9423-4134-bf46-7c15fad79358 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:53.999675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d4881-9423-4134-bf46-7c15fad79358 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:54.001206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 168/343] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:54.004310 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d4881-9423-4134-bf46-7c15fad79358 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:54.030232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868799a2-1966-49ac-aa56-2876e968acaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:54.030916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868799a2-1966-49ac-aa56-2876e968acaf None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:54.031193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868799a2-1966-49ac-aa56-2876e968acaf None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:54.031462 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868799a2-1966-49ac-aa56-2876e968acaf None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:54.032247 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868799a2-1966-49ac-aa56-2876e968acaf None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:54.032551 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868799a2-1966-49ac-aa56-2876e968acaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:54.035138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868799a2-1966-49ac-aa56-2876e968acaf None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:54.045290 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 176/344] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:54.046618 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b0b06-43a0-4e66-ba0a-1d4bbb42135c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:54.046901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b0b06-43a0-4e66-ba0a-1d4bbb42135c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:54.047172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b0b06-43a0-4e66-ba0a-1d4bbb42135c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:54.084753 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0b9b0b06-43a0-4e66-ba0a-1d4bbb42135c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:54.085873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0b9b0b06-43a0-4e66-ba0a-1d4bbb42135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:54.148665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d4881-9423-4134-bf46-7c15fad79358 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:54.216972 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 177/345] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:54.217831 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b0b06-43a0-4e66-ba0a-1d4bbb42135c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:54.221085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54022512-ac32-48b2-ab33-788db99d70d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:54.222004 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54022512-ac32-48b2-ab33-788db99d70d8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:54.222283 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54022512-ac32-48b2-ab33-788db99d70d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:54.222551 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54022512-ac32-48b2-ab33-788db99d70d8 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:54.224549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54022512-ac32-48b2-ab33-788db99d70d8 None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:54.226048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54022512-ac32-48b2-ab33-788db99d70d8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:54.227864 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 169/346] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:54 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:54.233469 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54022512-ac32-48b2-ab33-788db99d70d8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:54.354855 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b0b06-43a0-4e66-ba0a-1d4bbb42135c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:54.358660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54022512-ac32-48b2-ab33-788db99d70d8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:54.394369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98662bec-e0a7-4b3b-ba30-20aa8a1b0331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:54.394975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fd558-acee-4ae2-948c-751bcbda3b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:54.395765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98662bec-e0a7-4b3b-ba30-20aa8a1b0331 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:54.395885 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fd558-acee-4ae2-948c-751bcbda3b77 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:54.396130 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fd558-acee-4ae2-948c-751bcbda3b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:54.396447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98662bec-e0a7-4b3b-ba30-20aa8a1b0331 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:54.396724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fd558-acee-4ae2-948c-751bcbda3b77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:54.396893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98662bec-e0a7-4b3b-ba30-20aa8a1b0331 None admin] PATH_INFO: `/v3/groups/f0709b5b2fe74ee4af654f97d9878a86` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:54.404090 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98662bec-e0a7-4b3b-ba30-20aa8a1b0331 None admin] RBAC: Authorizing `identity:get_group(group_id=f0709b5b2fe74ee4af654f97d9878a86)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:54.405676 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98662bec-e0a7-4b3b-ba30-20aa8a1b0331 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:54.407781 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 170/347] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 16:56:54 2022] GET /identity/v3/groups/f0709b5b2fe74ee4af654f97d9878a86 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:54.408662 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98662bec-e0a7-4b3b-ba30-20aa8a1b0331 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:54.467344 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fd558-acee-4ae2-948c-751bcbda3b77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:54.469075 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fd558-acee-4ae2-948c-751bcbda3b77 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:54.514689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98662bec-e0a7-4b3b-ba30-20aa8a1b0331 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:54.549070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabd9ae-e827-4870-949c-a8121f839883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:54.550212 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabd9ae-e827-4870-949c-a8121f839883 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:54.550706 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabd9ae-e827-4870-949c-a8121f839883 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:54.551175 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabd9ae-e827-4870-949c-a8121f839883 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:54.562618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabd9ae-e827-4870-949c-a8121f839883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:54.568382 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 178/348] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:54.569908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644f5b1-d7c2-4d0f-84f6-2947f9d2e249 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:54.570370 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644f5b1-d7c2-4d0f-84f6-2947f9d2e249 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:54.570826 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644f5b1-d7c2-4d0f-84f6-2947f9d2e249 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-0cabd9ae-e827-4870-949c-a8121f839883 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:54.571581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:54.572467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:54.573276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:54.573276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:54.573276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:54.573276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:54.573276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:54.573276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:54.573276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:54.573276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:54.573276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:54.573276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:54.573276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 16:56:54.573276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:54.573276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 171/349] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:54.573956 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabd9ae-e827-4870-949c-a8121f839883 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:54.575784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 179/350] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:54.576772 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644f5b1-d7c2-4d0f-84f6-2947f9d2e249 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:54.682504 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabd9ae-e827-4870-949c-a8121f839883 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:54.683355 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644f5b1-d7c2-4d0f-84f6-2947f9d2e249 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:54.720105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7892b9-9562-4ff1-982c-b390989fe8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:54.720925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7892b9-9562-4ff1-982c-b390989fe8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:54.721128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d643dcf-22d5-4a93-a2ed-5c6295b917be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:54.721395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7892b9-9562-4ff1-982c-b390989fe8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:54.721765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7892b9-9562-4ff1-982c-b390989fe8e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:54.722452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d643dcf-22d5-4a93-a2ed-5c6295b917be None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:54.722779 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7892b9-9562-4ff1-982c-b390989fe8e0 None admin] RBAC: Adding query filter params (group.id=f0709b5b2fe74ee4af654f97d9878a86, role.id=f47d350de184449f9ce5e84ebe7753da, scope.project.id=37528046958f43e8b9cf2ffd96d3def0) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:54.723021 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d643dcf-22d5-4a93-a2ed-5c6295b917be None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:54.723290 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7892b9-9562-4ff1-982c-b390989fe8e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:54.723573 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d643dcf-22d5-4a93-a2ed-5c6295b917be None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:54.724950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7892b9-9562-4ff1-982c-b390989fe8e0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:54.725072 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d643dcf-22d5-4a93-a2ed-5c6295b917be None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:54.726605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d643dcf-22d5-4a93-a2ed-5c6295b917be None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:54.728461 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 180/351] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:54 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:54.729390 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d643dcf-22d5-4a93-a2ed-5c6295b917be None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:54.731699 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 172/352] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 16:56:54 2022] GET /identity/v3/role_assignments?group.id=f0709b5b2fe74ee4af654f97d9878a86&scope.project.id=37528046958f43e8b9cf2ffd96d3def0&role.id=f47d350de184449f9ce5e84ebe7753da => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:54.733068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fde3d7-256c-40d0-a410-aa8b14df0308 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:54.734237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fde3d7-256c-40d0-a410-aa8b14df0308 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:54.734237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fde3d7-256c-40d0-a410-aa8b14df0308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:54.773182 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-18fde3d7-256c-40d0-a410-aa8b14df0308 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:54.774099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-18fde3d7-256c-40d0-a410-aa8b14df0308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:54.876355 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 173/353] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:54.878830 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fde3d7-256c-40d0-a410-aa8b14df0308 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:54.892555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d643dcf-22d5-4a93-a2ed-5c6295b917be None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:54.950612 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c697f-d7b7-430c-9ffe-a1c775d36a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:54.951224 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c697f-d7b7-430c-9ffe-a1c775d36a3d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:54.951505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c697f-d7b7-430c-9ffe-a1c775d36a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:54.951831 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c697f-d7b7-430c-9ffe-a1c775d36a3d None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:54.952613 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c697f-d7b7-430c-9ffe-a1c775d36a3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:54.952922 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c697f-d7b7-430c-9ffe-a1c775d36a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:54.954366 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c697f-d7b7-430c-9ffe-a1c775d36a3d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:54.966686 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 181/354] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:54.967870 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c697f-d7b7-430c-9ffe-a1c775d36a3d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:55.047843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fde3d7-256c-40d0-a410-aa8b14df0308 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:55.100919 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b7d14-beee-44bb-85e1-7d2f8fcd4e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:55.102464 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b7d14-beee-44bb-85e1-7d2f8fcd4e68 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:55.102464 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b7d14-beee-44bb-85e1-7d2f8fcd4e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:55.102464 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b7d14-beee-44bb-85e1-7d2f8fcd4e68 None admin] PATH_INFO: `/v3/groups/f0709b5b2fe74ee4af654f97d9878a86` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:55.104763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b7d14-beee-44bb-85e1-7d2f8fcd4e68 None admin] RBAC: Authorizing `identity:get_group(group_id=f0709b5b2fe74ee4af654f97d9878a86)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:55.106981 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b7d14-beee-44bb-85e1-7d2f8fcd4e68 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:55.108667 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 174/355] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 16:56:54 2022] GET /identity/v3/groups/f0709b5b2fe74ee4af654f97d9878a86 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:55.109937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25ddc1-d46c-4a6d-bd9d-a2065849c00f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:55.110230 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25ddc1-d46c-4a6d-bd9d-a2065849c00f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:55.110691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25ddc1-d46c-4a6d-bd9d-a2065849c00f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:55.111850 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 175/356] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:55.112409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25ddc1-d46c-4a6d-bd9d-a2065849c00f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:55.121066 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c697f-d7b7-430c-9ffe-a1c775d36a3d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:55.176071 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee12ef-fa2a-44a7-b77b-7125858b3424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:55.176880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee12ef-fa2a-44a7-b77b-7125858b3424 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:55.177162 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee12ef-fa2a-44a7-b77b-7125858b3424 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:55.177440 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee12ef-fa2a-44a7-b77b-7125858b3424 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:55.188219 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee12ef-fa2a-44a7-b77b-7125858b3424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-40ee12ef-fa2a-44a7-b77b-7125858b3424 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:55.196243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:55.197113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:55.197914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:55.197914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:55.197914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:55.197914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:55.197914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:55.197914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:55.197914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:55.197914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:55.197914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:55.197914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:55.197914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:55.197914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:55.197914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 182/357] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:55.199229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee12ef-fa2a-44a7-b77b-7125858b3424 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:55.241109 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25ddc1-d46c-4a6d-bd9d-a2065849c00f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:55.285275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42a39a-c3bc-4f3a-982a-3daf17e129de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:55.286488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42a39a-c3bc-4f3a-982a-3daf17e129de None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:55.286985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42a39a-c3bc-4f3a-982a-3daf17e129de None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:55.287501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42a39a-c3bc-4f3a-982a-3daf17e129de None admin] PATH_INFO: `/v3/users/6734057813d94904abc67e8711020a99` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:55.288983 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42a39a-c3bc-4f3a-982a-3daf17e129de None admin] RBAC: Authorizing `identity:get_user(user_id=6734057813d94904abc67e8711020a99)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:55.290549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42a39a-c3bc-4f3a-982a-3daf17e129de None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:55.293327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 176/358] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:56:55 2022] GET /identity/v3/users/6734057813d94904abc67e8711020a99 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:55.295022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5487e-1193-4bb8-9ee9-504b33aff28b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:55.295304 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5487e-1193-4bb8-9ee9-504b33aff28b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:55.295576 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5487e-1193-4bb8-9ee9-504b33aff28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:55.315287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-50b5487e-1193-4bb8-9ee9-504b33aff28b None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:55.316489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-50b5487e-1193-4bb8-9ee9-504b33aff28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:55.318546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee12ef-fa2a-44a7-b77b-7125858b3424 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:55.364959 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f96a09-abeb-4960-8742-581e76605614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:55.365989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96a09-abeb-4960-8742-581e76605614 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:55.366494 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96a09-abeb-4960-8742-581e76605614 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:55.366973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f96a09-abeb-4960-8742-581e76605614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:55.368071 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f96a09-abeb-4960-8742-581e76605614 None admin] RBAC: Adding query filter params (group.id=f0709b5b2fe74ee4af654f97d9878a86, role.id=e613911293e3458c975cbab36cae354d, scope.project.id=37528046958f43e8b9cf2ffd96d3def0) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:55.368389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f96a09-abeb-4960-8742-581e76605614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:55.369895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f96a09-abeb-4960-8742-581e76605614 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:55.376913 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 183/359] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 16:56:55 2022] GET /identity/v3/role_assignments?group.id=f0709b5b2fe74ee4af654f97d9878a86&scope.project.id=37528046958f43e8b9cf2ffd96d3def0&role.id=e613911293e3458c975cbab36cae354d => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:55.378307 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb92ba-fc4c-44a0-8a9d-dde1618cfe93 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:55.378602 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb92ba-fc4c-44a0-8a9d-dde1618cfe93 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:55.379195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb92ba-fc4c-44a0-8a9d-dde1618cfe93 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:55.384968 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 184/360] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:55.385946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb92ba-fc4c-44a0-8a9d-dde1618cfe93 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:55.409866 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 177/361] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:55.411215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5487e-1193-4bb8-9ee9-504b33aff28b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:55.503469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb92ba-fc4c-44a0-8a9d-dde1618cfe93 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:55.540505 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5487e-1193-4bb8-9ee9-504b33aff28b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:55.541544 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5c2e3-cf49-4c49-b8f3-fde5e4468230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:55.542316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5c2e3-cf49-4c49-b8f3-fde5e4468230 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:55.542603 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5c2e3-cf49-4c49-b8f3-fde5e4468230 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:55.542874 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5c2e3-cf49-4c49-b8f3-fde5e4468230 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:55.543937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5c2e3-cf49-4c49-b8f3-fde5e4468230 None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:55.544253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5c2e3-cf49-4c49-b8f3-fde5e4468230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:55.545801 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5c2e3-cf49-4c49-b8f3-fde5e4468230 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:55.555520 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 185/362] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:55.558510 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718086f-7e1c-42ba-8787-79982b9c030a None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:55.558510 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718086f-7e1c-42ba-8787-79982b9c030a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:55.558709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718086f-7e1c-42ba-8787-79982b9c030a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:55.578410 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2718086f-7e1c-42ba-8787-79982b9c030a None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:55.579587 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2718086f-7e1c-42ba-8787-79982b9c030a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:55.581337 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73eded-1e4c-4b09-a291-deb8d269ba36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:55.582219 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73eded-1e4c-4b09-a291-deb8d269ba36 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:55.582712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73eded-1e4c-4b09-a291-deb8d269ba36 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:55.583179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73eded-1e4c-4b09-a291-deb8d269ba36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:55.584273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73eded-1e4c-4b09-a291-deb8d269ba36 None admin] RBAC: Adding query filter params (role.id=b216a326d0f24273b3cceab46bd3e208, user.id=6734057813d94904abc67e8711020a99, scope.system=all) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:55.584784 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73eded-1e4c-4b09-a291-deb8d269ba36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:55.586449 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73eded-1e4c-4b09-a291-deb8d269ba36 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:55.599050 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 178/363] 10.222.0.48 () {56 vars in 1308 bytes} [Tue May 17 16:56:55 2022] GET /identity/v3/role_assignments?user.id=6734057813d94904abc67e8711020a99&scope.system=all&role.id=b216a326d0f24273b3cceab46bd3e208 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:55.600243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73eded-1e4c-4b09-a291-deb8d269ba36 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:55.656955 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 186/364] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:55.657813 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718086f-7e1c-42ba-8787-79982b9c030a None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:55.710732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73eded-1e4c-4b09-a291-deb8d269ba36 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:55.746333 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1259d9-379e-4e92-9f9b-30dc7898e81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:55.748342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1259d9-379e-4e92-9f9b-30dc7898e81b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:55.748852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1259d9-379e-4e92-9f9b-30dc7898e81b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:55.749320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1259d9-379e-4e92-9f9b-30dc7898e81b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:55.761285 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1259d9-379e-4e92-9f9b-30dc7898e81b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:55.765507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718086f-7e1c-42ba-8787-79982b9c030a None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-0c1259d9-379e-4e92-9f9b-30dc7898e81b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:55.770218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:55.771129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:55.771966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:55.771966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:55.771966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:55.771966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:55.771966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:55.771966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:55.771966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:55.771966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:55.771966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:55.771966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:55.771966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:55.771966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:55.774459 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 179/365] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:56:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:55.775525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1259d9-379e-4e92-9f9b-30dc7898e81b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:55.801790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f54c0-7429-4ba0-ae14-16dd359e674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:55.802661 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f54c0-7429-4ba0-ae14-16dd359e674f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:55.802840 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f54c0-7429-4ba0-ae14-16dd359e674f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:55.803083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f54c0-7429-4ba0-ae14-16dd359e674f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:55.876123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f54c0-7429-4ba0-ae14-16dd359e674f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:55.877606 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f54c0-7429-4ba0-ae14-16dd359e674f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:55.881797 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1259d9-379e-4e92-9f9b-30dc7898e81b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:55.916756 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad1710-d862-40c9-9f5a-188131359c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:55.917931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad1710-d862-40c9-9f5a-188131359c40 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:55.918411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad1710-d862-40c9-9f5a-188131359c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:55.918943 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad1710-d862-40c9-9f5a-188131359c40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:55.930077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad1710-d862-40c9-9f5a-188131359c40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b4ad1710-d862-40c9-9f5a-188131359c40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:55.939077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:55.940048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:55.940811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:55.940811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:55.940811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:55.940811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:55.940811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:55.940811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:55.940811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:55.940811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:55.940811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:55.940811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:55.940811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:56:55.940811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:55.943311 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 180/366] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:56:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:55.944312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad1710-d862-40c9-9f5a-188131359c40 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:55.985537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 187/367] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:55.986351 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f54c0-7429-4ba0-ae14-16dd359e674f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:56.051248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad1710-d862-40c9-9f5a-188131359c40 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:56.086939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be436278-291f-42ec-b263-e78a32678bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:56.093644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f54c0-7429-4ba0-ae14-16dd359e674f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:56.094096 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be436278-291f-42ec-b263-e78a32678bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:56.094596 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be436278-291f-42ec-b263-e78a32678bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:56.095064 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be436278-291f-42ec-b263-e78a32678bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:56.096057 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be436278-291f-42ec-b263-e78a32678bc7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:56.096588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be436278-291f-42ec-b263-e78a32678bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:56.098184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be436278-291f-42ec-b263-e78a32678bc7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:56.107271 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 181/368] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:56:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:56.108448 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be436278-291f-42ec-b263-e78a32678bc7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:56.134624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81102aad-33bb-4647-8ae1-abd9b508da32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:56.134624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81102aad-33bb-4647-8ae1-abd9b508da32 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:56.134624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81102aad-33bb-4647-8ae1-abd9b508da32 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:56.134624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81102aad-33bb-4647-8ae1-abd9b508da32 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:56.135762 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81102aad-33bb-4647-8ae1-abd9b508da32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:56.136005 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81102aad-33bb-4647-8ae1-abd9b508da32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:56.138066 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81102aad-33bb-4647-8ae1-abd9b508da32 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:56.156948 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 188/369] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:56.158171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81102aad-33bb-4647-8ae1-abd9b508da32 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:56.255984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be436278-291f-42ec-b263-e78a32678bc7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:56.289425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81102aad-33bb-4647-8ae1-abd9b508da32 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:56.311449 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b4098-58ef-4221-9d5b-764bffd7c152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:56.312410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b4098-58ef-4221-9d5b-764bffd7c152 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:56.312699 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b4098-58ef-4221-9d5b-764bffd7c152 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:56.312970 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b4098-58ef-4221-9d5b-764bffd7c152 None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:56.314552 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b4098-58ef-4221-9d5b-764bffd7c152 None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:56.316053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b4098-58ef-4221-9d5b-764bffd7c152 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:56.317780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 182/370] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:56 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:56.318760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b4098-58ef-4221-9d5b-764bffd7c152 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:56.340115 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b56f2-0aa9-4344-ae66-5dff310bf83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:56.342853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b56f2-0aa9-4344-ae66-5dff310bf83f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:56.343488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b56f2-0aa9-4344-ae66-5dff310bf83f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:56.344069 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b56f2-0aa9-4344-ae66-5dff310bf83f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:56.421037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b56f2-0aa9-4344-ae66-5dff310bf83f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:56.422727 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b56f2-0aa9-4344-ae66-5dff310bf83f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:56.432223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b4098-58ef-4221-9d5b-764bffd7c152 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:56.470122 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae5221-d884-4834-8e85-6acae75928b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:56.470939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae5221-d884-4834-8e85-6acae75928b6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:56.471325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae5221-d884-4834-8e85-6acae75928b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:56.471792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae5221-d884-4834-8e85-6acae75928b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:56.523039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 189/371] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:56.524213 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b56f2-0aa9-4344-ae66-5dff310bf83f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:56.542777 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae5221-d884-4834-8e85-6acae75928b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:56.544959 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae5221-d884-4834-8e85-6acae75928b6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:56.625357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b56f2-0aa9-4344-ae66-5dff310bf83f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:56.649590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 183/372] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:56:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:56:56.650573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae5221-d884-4834-8e85-6acae75928b6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:56.665581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d9c8b-cff7-420b-8f99-b67c3ba57655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:56.666658 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d9c8b-cff7-420b-8f99-b67c3ba57655 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:56.667079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d9c8b-cff7-420b-8f99-b67c3ba57655 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:56.667507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d9c8b-cff7-420b-8f99-b67c3ba57655 None admin] PATH_INFO: `/v3/groups/f0709b5b2fe74ee4af654f97d9878a86` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:56.668868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d9c8b-cff7-420b-8f99-b67c3ba57655 None admin] RBAC: Authorizing `identity:get_group(group_id=f0709b5b2fe74ee4af654f97d9878a86)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:56.670433 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d9c8b-cff7-420b-8f99-b67c3ba57655 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:56.672495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 190/373] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 16:56:56 2022] GET /identity/v3/groups/f0709b5b2fe74ee4af654f97d9878a86 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:56.673394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d9c8b-cff7-420b-8f99-b67c3ba57655 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:56.750709 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae5221-d884-4834-8e85-6acae75928b6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:56.772007 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d9c8b-cff7-420b-8f99-b67c3ba57655 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:56.785591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a36763-0483-43cc-bf81-6c5e837dd52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:56.786539 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a36763-0483-43cc-bf81-6c5e837dd52b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:56.786886 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a36763-0483-43cc-bf81-6c5e837dd52b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:56.787224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a36763-0483-43cc-bf81-6c5e837dd52b None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:56.788518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a36763-0483-43cc-bf81-6c5e837dd52b None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:56.789982 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a36763-0483-43cc-bf81-6c5e837dd52b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:56.791944 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 184/374] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:56 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:56.792647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a36763-0483-43cc-bf81-6c5e837dd52b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:56.809117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232b14e-0d45-4ed2-a9a5-55411767ff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:56.811216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232b14e-0d45-4ed2-a9a5-55411767ff63 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:56.811713 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232b14e-0d45-4ed2-a9a5-55411767ff63 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:56.812208 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232b14e-0d45-4ed2-a9a5-55411767ff63 None admin] PATH_INFO: `/v3/projects/3a3ee3f323ac4b12815e2057e52b4ed6` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:56.813611 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232b14e-0d45-4ed2-a9a5-55411767ff63 None admin] RBAC: Authorizing `identity:get_project(project_id=3a3ee3f323ac4b12815e2057e52b4ed6)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:56.815508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232b14e-0d45-4ed2-a9a5-55411767ff63 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:56.817688 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 191/375] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:56 2022] GET /identity/v3/projects/3a3ee3f323ac4b12815e2057e52b4ed6 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:56.818638 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232b14e-0d45-4ed2-a9a5-55411767ff63 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:56.897842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a36763-0483-43cc-bf81-6c5e837dd52b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:56.931661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d8ea2-d0d1-46a2-9602-06450c8f7200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:56.932320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d8ea2-d0d1-46a2-9602-06450c8f7200 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:56.932600 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d8ea2-d0d1-46a2-9602-06450c8f7200 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:56.932872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d8ea2-d0d1-46a2-9602-06450c8f7200 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:56.933698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d8ea2-d0d1-46a2-9602-06450c8f7200 None admin] RBAC: Adding query filter params (group.id=f0709b5b2fe74ee4af654f97d9878a86, role.id=e613911293e3458c975cbab36cae354d, scope.project.id=5597d4acc0664c3e805bd547a6173ed0) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:56.934004 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d8ea2-d0d1-46a2-9602-06450c8f7200 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:56.936050 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d8ea2-d0d1-46a2-9602-06450c8f7200 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:56.938291 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232b14e-0d45-4ed2-a9a5-55411767ff63 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:56.942290 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 185/376] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 16:56:56 2022] GET /identity/v3/role_assignments?group.id=f0709b5b2fe74ee4af654f97d9878a86&scope.project.id=5597d4acc0664c3e805bd547a6173ed0&role.id=e613911293e3458c975cbab36cae354d => generated 260 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:56.943099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d8ea2-d0d1-46a2-9602-06450c8f7200 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:56.977738 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fd965-bd7d-4a4b-b577-d1d45fc2417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:56.978963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fd965-bd7d-4a4b-b577-d1d45fc2417a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:56.979459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fd965-bd7d-4a4b-b577-d1d45fc2417a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:56.979966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fd965-bd7d-4a4b-b577-d1d45fc2417a None admin] PATH_INFO: `/v3/groups/f0709b5b2fe74ee4af654f97d9878a86` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:56.981613 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fd965-bd7d-4a4b-b577-d1d45fc2417a None admin] RBAC: Authorizing `identity:get_group(group_id=f0709b5b2fe74ee4af654f97d9878a86)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:56.983317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fd965-bd7d-4a4b-b577-d1d45fc2417a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:56.985523 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 192/377] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 16:56:56 2022] GET /identity/v3/groups/f0709b5b2fe74ee4af654f97d9878a86 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:56.991260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fd965-bd7d-4a4b-b577-d1d45fc2417a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:57.051487 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d8ea2-d0d1-46a2-9602-06450c8f7200 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:57.091536 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e08268-18bc-40bd-8150-a489de67316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:57.092488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e08268-18bc-40bd-8150-a489de67316c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:57.093210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e08268-18bc-40bd-8150-a489de67316c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:57.093210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e08268-18bc-40bd-8150-a489de67316c None admin] PATH_INFO: `/v3/groups/7019fca97f1b490ea64652b3ee964940` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:57.098821 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e08268-18bc-40bd-8150-a489de67316c None admin] RBAC: Authorizing `identity:get_group(group_id=7019fca97f1b490ea64652b3ee964940)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:57.100359 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e08268-18bc-40bd-8150-a489de67316c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:57.102045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 186/378] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 16:56:56 2022] GET /identity/v3/groups/7019fca97f1b490ea64652b3ee964940 => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:57.108494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e08268-18bc-40bd-8150-a489de67316c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:57.112773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fd965-bd7d-4a4b-b577-d1d45fc2417a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:57.159319 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8071b8-af32-4af4-ac91-047e09b63dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:57.160829 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8071b8-af32-4af4-ac91-047e09b63dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:57.161355 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8071b8-af32-4af4-ac91-047e09b63dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:57.161820 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8071b8-af32-4af4-ac91-047e09b63dc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:57.162861 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8071b8-af32-4af4-ac91-047e09b63dc9 None admin] RBAC: Adding query filter params (group.id=f0709b5b2fe74ee4af654f97d9878a86, role.id=f47d350de184449f9ce5e84ebe7753da, scope.project.id=5597d4acc0664c3e805bd547a6173ed0) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:57.163375 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8071b8-af32-4af4-ac91-047e09b63dc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:57.165045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8071b8-af32-4af4-ac91-047e09b63dc9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:57.172118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 193/379] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 16:56:56 2022] GET /identity/v3/role_assignments?group.id=f0709b5b2fe74ee4af654f97d9878a86&scope.project.id=5597d4acc0664c3e805bd547a6173ed0&role.id=f47d350de184449f9ce5e84ebe7753da => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:57.227407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e08268-18bc-40bd-8150-a489de67316c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:57.267265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20644479-e7ee-44bd-9340-1ee4e6ce5622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:57.268409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20644479-e7ee-44bd-9340-1ee4e6ce5622 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:57.268933 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20644479-e7ee-44bd-9340-1ee4e6ce5622 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:57.269433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20644479-e7ee-44bd-9340-1ee4e6ce5622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:57.270525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20644479-e7ee-44bd-9340-1ee4e6ce5622 None admin] RBAC: Adding query filter params (group.id=7019fca97f1b490ea64652b3ee964940, role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=3a3ee3f323ac4b12815e2057e52b4ed6) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:57.271054 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20644479-e7ee-44bd-9340-1ee4e6ce5622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:57.272802 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20644479-e7ee-44bd-9340-1ee4e6ce5622 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:57.280505 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 187/380] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 16:56:57 2022] GET /identity/v3/role_assignments?group.id=7019fca97f1b490ea64652b3ee964940&scope.project.id=3a3ee3f323ac4b12815e2057e52b4ed6&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:57.636464 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa3387-33b2-4b36-b2d3-a77a8b7f38bb None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:57.636793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa3387-33b2-4b36-b2d3-a77a8b7f38bb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:57.637027 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa3387-33b2-4b36-b2d3-a77a8b7f38bb None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:57.638982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 194/381] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:57.644674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a4cb1-6d91-4323-9b35-22ef5a439fa8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:57.644962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a4cb1-6d91-4323-9b35-22ef5a439fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:57.645243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a4cb1-6d91-4323-9b35-22ef5a439fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:57.665951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-055a4cb1-6d91-4323-9b35-22ef5a439fa8 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:57.667133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-055a4cb1-6d91-4323-9b35-22ef5a439fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:57.752537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 188/382] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:56:57.797456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa3387-33b2-4b36-b2d3-a77a8b7f38bb None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:57.933309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa3387-33b2-4b36-b2d3-a77a8b7f38bb None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:57.978164 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b85b00-128d-4315-8e4a-c6451a774631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:57.978974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b85b00-128d-4315-8e4a-c6451a774631 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:57.979256 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b85b00-128d-4315-8e4a-c6451a774631 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:57.979528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b85b00-128d-4315-8e4a-c6451a774631 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:57.997484 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b85b00-128d-4315-8e4a-c6451a774631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-f0b85b00-128d-4315-8e4a-c6451a774631 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:58.005934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:58.006892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:58.007697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:58.007697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:58.007697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:58.007697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:58.007697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:58.007697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:58.007697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:58.007697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:58.007697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:58.007697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:58.007697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:56:58.007697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:56:58.007697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 195/383] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:56:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:58.013907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a4cb1-6d91-4323-9b35-22ef5a439fa8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:58.174772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a4cb1-6d91-4323-9b35-22ef5a439fa8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:58.217251 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54df917-12a7-41d1-a0a9-daf23b84bcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:58.217848 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54df917-12a7-41d1-a0a9-daf23b84bcc7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:58.218140 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54df917-12a7-41d1-a0a9-daf23b84bcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:58.218414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54df917-12a7-41d1-a0a9-daf23b84bcc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:58.219166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54df917-12a7-41d1-a0a9-daf23b84bcc7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:58.219472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54df917-12a7-41d1-a0a9-daf23b84bcc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:58.220889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54df917-12a7-41d1-a0a9-daf23b84bcc7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:58.235767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 189/384] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:56:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:58.241364 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b85b00-128d-4315-8e4a-c6451a774631 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:58.317812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b98a6-29c2-47dc-abab-9c2978e546d5 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:58.318126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b98a6-29c2-47dc-abab-9c2978e546d5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:58.318369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b98a6-29c2-47dc-abab-9c2978e546d5 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:58.320078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 190/385] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:56:58.329918 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3bc19-6503-44d6-8e2c-a2b300846e6d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:58.330086 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3bc19-6503-44d6-8e2c-a2b300846e6d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:58.330285 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3bc19-6503-44d6-8e2c-a2b300846e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:58.363954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f5d3bc19-6503-44d6-8e2c-a2b300846e6d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:56:58.365180 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f5d3bc19-6503-44d6-8e2c-a2b300846e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:56:58.374766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b85b00-128d-4315-8e4a-c6451a774631 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:58.413593 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87a65b-e43e-4c87-bb93-d8abdd7b20df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:58.414470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87a65b-e43e-4c87-bb93-d8abdd7b20df None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:58.414751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87a65b-e43e-4c87-bb93-d8abdd7b20df None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:58.415022 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87a65b-e43e-4c87-bb93-d8abdd7b20df None admin] PATH_INFO: `/v3/groups/f0709b5b2fe74ee4af654f97d9878a86` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:58.416930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87a65b-e43e-4c87-bb93-d8abdd7b20df None admin] RBAC: Authorizing `identity:get_group(group_id=f0709b5b2fe74ee4af654f97d9878a86)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:58.418370 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87a65b-e43e-4c87-bb93-d8abdd7b20df None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:58.420591 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 196/386] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 16:56:58 2022] GET /identity/v3/groups/f0709b5b2fe74ee4af654f97d9878a86 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:58.428939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87a65b-e43e-4c87-bb93-d8abdd7b20df None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:58.497411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 191/387] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:56:58.537342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3bc19-6503-44d6-8e2c-a2b300846e6d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:58.567266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87a65b-e43e-4c87-bb93-d8abdd7b20df None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:58.603927 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9956b86-7eb1-434a-98bd-64786c56d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:58.605168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9956b86-7eb1-434a-98bd-64786c56d2ef None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:58.607033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9956b86-7eb1-434a-98bd-64786c56d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:58.607507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9956b86-7eb1-434a-98bd-64786c56d2ef None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:58.609967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9956b86-7eb1-434a-98bd-64786c56d2ef None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:58.611627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9956b86-7eb1-434a-98bd-64786c56d2ef None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:58.614260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 197/388] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:58 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:56:58.620865 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9956b86-7eb1-434a-98bd-64786c56d2ef None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:58.756051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9956b86-7eb1-434a-98bd-64786c56d2ef None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:58.767177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3bc19-6503-44d6-8e2c-a2b300846e6d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:58.794324 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb357e-500c-4f33-9170-5a1fba2e822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:58.795300 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb357e-500c-4f33-9170-5a1fba2e822b None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:58.795585 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb357e-500c-4f33-9170-5a1fba2e822b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:58.795884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb357e-500c-4f33-9170-5a1fba2e822b None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0/groups/f0709b5b2fe74ee4af654f97d9878a86/roles/f47d350de184449f9ce5e84ebe7753da` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:58.802818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb357e-500c-4f33-9170-5a1fba2e822b None admin] RBAC: Authorizing `identity:create_grant(project_id=37528046958f43e8b9cf2ffd96d3def0, group_id=f0709b5b2fe74ee4af654f97d9878a86, role_id=f47d350de184449f9ce5e84ebe7753da)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:58.805367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb357e-500c-4f33-9170-5a1fba2e822b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:58.830040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 198/389] 10.222.0.48 () {58 vars in 1442 bytes} [Tue May 17 16:56:58 2022] PUT /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0/groups/f0709b5b2fe74ee4af654f97d9878a86/roles/f47d350de184449f9ce5e84ebe7753da => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:56:58.832188 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71c708-3c1f-4679-a0e0-9da8dd0e791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:58.833065 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c708-3c1f-4679-a0e0-9da8dd0e791e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:58.833353 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c708-3c1f-4679-a0e0-9da8dd0e791e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:58.833630 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c708-3c1f-4679-a0e0-9da8dd0e791e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:58.853707 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71c708-3c1f-4679-a0e0-9da8dd0e791e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-9c71c708-3c1f-4679-a0e0-9da8dd0e791e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:56:58.862562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:56:58.864393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:56:58.865973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:56:58.865973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:56:58.865973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:56:58.865973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:56:58.865973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:56:58.865973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:56:58.865973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:56:58.865973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:56:58.865973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:56:58.865973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:56:58.865973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:56:58.865973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:56:58.872690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 192/390] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:56:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:56:58.879081 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb357e-500c-4f33-9170-5a1fba2e822b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:59.033441 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb357e-500c-4f33-9170-5a1fba2e822b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:59.070794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84dfb6-5883-4f8f-ac15-1c4291e3375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:59.071523 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84dfb6-5883-4f8f-ac15-1c4291e3375d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:59.071844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84dfb6-5883-4f8f-ac15-1c4291e3375d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:59.072193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84dfb6-5883-4f8f-ac15-1c4291e3375d None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:59.072951 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84dfb6-5883-4f8f-ac15-1c4291e3375d None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:56:59.073266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84dfb6-5883-4f8f-ac15-1c4291e3375d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:59.074636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84dfb6-5883-4f8f-ac15-1c4291e3375d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:59.086693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 199/391] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:56:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:59.090086 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71c708-3c1f-4679-a0e0-9da8dd0e791e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:59.194700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71c708-3c1f-4679-a0e0-9da8dd0e791e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:59.229701 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafedc7d-b869-4e23-a0a3-4eb9b40b4e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:59.230570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafedc7d-b869-4e23-a0a3-4eb9b40b4e0a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:59.230852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafedc7d-b869-4e23-a0a3-4eb9b40b4e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:59.231708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafedc7d-b869-4e23-a0a3-4eb9b40b4e0a None admin] PATH_INFO: `/v3/groups/f0709b5b2fe74ee4af654f97d9878a86` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:59.233087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafedc7d-b869-4e23-a0a3-4eb9b40b4e0a None admin] RBAC: Authorizing `identity:get_group(group_id=f0709b5b2fe74ee4af654f97d9878a86)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:59.234572 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafedc7d-b869-4e23-a0a3-4eb9b40b4e0a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:59.236263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 193/392] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 16:56:59 2022] GET /identity/v3/groups/f0709b5b2fe74ee4af654f97d9878a86 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:59.241995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84dfb6-5883-4f8f-ac15-1c4291e3375d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:59.346117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84dfb6-5883-4f8f-ac15-1c4291e3375d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:59.386460 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123e96f-98b2-48ee-b0ad-163670cd3c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:59.387847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123e96f-98b2-48ee-b0ad-163670cd3c73 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:59.388705 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123e96f-98b2-48ee-b0ad-163670cd3c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:59.388990 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123e96f-98b2-48ee-b0ad-163670cd3c73 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:59.390207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123e96f-98b2-48ee-b0ad-163670cd3c73 None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:59.391687 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123e96f-98b2-48ee-b0ad-163670cd3c73 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:59.393385 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 200/393] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:56:59 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:56:59.399227 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafedc7d-b869-4e23-a0a3-4eb9b40b4e0a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:56:59.506232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafedc7d-b869-4e23-a0a3-4eb9b40b4e0a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:56:59.542949 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d1f4c-3365-4fbd-8875-97a63767b8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:56:59.545073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d1f4c-3365-4fbd-8875-97a63767b8e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:56:59.545366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d1f4c-3365-4fbd-8875-97a63767b8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:56:59.545646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d1f4c-3365-4fbd-8875-97a63767b8e1 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0/groups/f0709b5b2fe74ee4af654f97d9878a86/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:56:59.547688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d1f4c-3365-4fbd-8875-97a63767b8e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=37528046958f43e8b9cf2ffd96d3def0, group_id=f0709b5b2fe74ee4af654f97d9878a86, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:56:59.549162 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d1f4c-3365-4fbd-8875-97a63767b8e1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:56:59.572849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 194/394] 10.222.0.48 () {58 vars in 1442 bytes} [Tue May 17 16:56:59 2022] PUT /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0/groups/f0709b5b2fe74ee4af654f97d9878a86/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:57:00.059502 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7c474-f479-4cde-904e-ad96448ec3e8 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:00.059896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7c474-f479-4cde-904e-ad96448ec3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:00.060138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7c474-f479-4cde-904e-ad96448ec3e8 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:00.061695 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 201/395] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:00.068548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5feb5-557e-49ed-9a73-f86190d366e3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:00.068835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5feb5-557e-49ed-9a73-f86190d366e3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:00.069107 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5feb5-557e-49ed-9a73-f86190d366e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:00.090050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5870f-4d91-4256-9838-d2e0e7b32fbb None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:00.091401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5870f-4d91-4256-9838-d2e0e7b32fbb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:00.091805 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5870f-4d91-4256-9838-d2e0e7b32fbb None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:00.096218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 202/396] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:00.096386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1dd5feb5-557e-49ed-9a73-f86190d366e3 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:00.096987 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1dd5feb5-557e-49ed-9a73-f86190d366e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:00.104501 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd93c7a-5126-44a0-800c-6924bf01811c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:00.104798 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd93c7a-5126-44a0-800c-6924bf01811c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:00.105058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd93c7a-5126-44a0-800c-6924bf01811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:00.130650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6fd93c7a-5126-44a0-800c-6924bf01811c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:00.130650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6fd93c7a-5126-44a0-800c-6924bf01811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:00.209050 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 195/397] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:57:00.233594 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5feb5-557e-49ed-9a73-f86190d366e3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:00.245025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 203/398] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:57:00.283792 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd93c7a-5126-44a0-800c-6924bf01811c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:00.360457 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5feb5-557e-49ed-9a73-f86190d366e3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:00.398924 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085421a3-d3af-476f-b13a-162f543d9397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:00.402333 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085421a3-d3af-476f-b13a-162f543d9397 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:00.403756 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085421a3-d3af-476f-b13a-162f543d9397 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:00.404494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085421a3-d3af-476f-b13a-162f543d9397 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:00.410624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd93c7a-5126-44a0-800c-6924bf01811c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:00.425019 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085421a3-d3af-476f-b13a-162f543d9397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-085421a3-d3af-476f-b13a-162f543d9397 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:00.435900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:00.436812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:00.440221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:00.440221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:00.440221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:00.440221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:00.440221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:00.440221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:00.440221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:00.440221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:00.440221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:00.440221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:00.440221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:57:00.440221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:00.440221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 196/399] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:00.440221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c955e-fe44-471a-9e8b-e583e5def226 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:00.441423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c955e-fe44-471a-9e8b-e583e5def226 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:00.441423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c955e-fe44-471a-9e8b-e583e5def226 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:00.441423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 197/400] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:00.445676 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d7178-5d95-44de-99fb-849e8d760852 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:00.445990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d7178-5d95-44de-99fb-849e8d760852 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:00.448236 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d7178-5d95-44de-99fb-849e8d760852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:00.465811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585c29b-abe9-4db2-abff-6270c10d4b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:00.466994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585c29b-abe9-4db2-abff-6270c10d4b1e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:00.467485 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585c29b-abe9-4db2-abff-6270c10d4b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:00.468055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585c29b-abe9-4db2-abff-6270c10d4b1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:00.475239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f97d7178-5d95-44de-99fb-849e8d760852 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:00.476515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f97d7178-5d95-44de-99fb-849e8d760852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:00.481943 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585c29b-abe9-4db2-abff-6270c10d4b1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-4585c29b-abe9-4db2-abff-6270c10d4b1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:00.491274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:00.492402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:00.493543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:00.493543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:00.493543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:00.493543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:00.493543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:00.493543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:00.493543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:00.493543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:00.493543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:00.493543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:00.493543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:57:00.493543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:00.493543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 204/401] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:57:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:00.499094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585c29b-abe9-4db2-abff-6270c10d4b1e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:00.563566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 198/402] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:57:00.565281 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d7178-5d95-44de-99fb-849e8d760852 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:00.607554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585c29b-abe9-4db2-abff-6270c10d4b1e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:00.651548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a410a-2775-432c-859c-79733c35bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:00.651865 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a410a-2775-432c-859c-79733c35bc68 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:00.652067 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a410a-2775-432c-859c-79733c35bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:00.652346 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a410a-2775-432c-859c-79733c35bc68 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:00.653121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a410a-2775-432c-859c-79733c35bc68 None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:00.653602 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a410a-2775-432c-859c-79733c35bc68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:00.654979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a410a-2775-432c-859c-79733c35bc68 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:00.664878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 205/403] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:57:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:00.666025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a410a-2775-432c-859c-79733c35bc68 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:00.691962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d7178-5d95-44de-99fb-849e8d760852 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:00.739536 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8e49-9c6b-4712-a301-2fd2bbcbcd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:00.740532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8e49-9c6b-4712-a301-2fd2bbcbcd73 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:00.740619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8e49-9c6b-4712-a301-2fd2bbcbcd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:00.741019 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8e49-9c6b-4712-a301-2fd2bbcbcd73 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:00.741892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8e49-9c6b-4712-a301-2fd2bbcbcd73 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:00.742539 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8e49-9c6b-4712-a301-2fd2bbcbcd73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:00.743939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8e49-9c6b-4712-a301-2fd2bbcbcd73 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:00.753437 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 199/404] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:00.754233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8e49-9c6b-4712-a301-2fd2bbcbcd73 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:00.796512 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a410a-2775-432c-859c-79733c35bc68 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:00.850565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a6e70-208a-454e-a7fb-2bcc1ef35152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:00.851697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6e70-208a-454e-a7fb-2bcc1ef35152 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:00.852167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6e70-208a-454e-a7fb-2bcc1ef35152 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:00.852651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6e70-208a-454e-a7fb-2bcc1ef35152 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:00.869744 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8e49-9c6b-4712-a301-2fd2bbcbcd73 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:00.879629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a6e70-208a-454e-a7fb-2bcc1ef35152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-ac5a6e70-208a-454e-a7fb-2bcc1ef35152 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:00.884692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:00.885586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:00.886796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:00.886796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:00.886796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:00.886796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:00.886796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:00.886796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:00.886796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:00.886796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:00.886796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:00.886796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:00.886796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:00.886796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:00.886796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 206/405] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:57:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:00.886796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a6e70-208a-454e-a7fb-2bcc1ef35152 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:00.916936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10c2f9-507e-432b-b8a4-c5d9dc3a97cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:00.918163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10c2f9-507e-432b-b8a4-c5d9dc3a97cb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:00.919368 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10c2f9-507e-432b-b8a4-c5d9dc3a97cb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:00.919933 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10c2f9-507e-432b-b8a4-c5d9dc3a97cb None admin] PATH_INFO: `/v3/groups/f0709b5b2fe74ee4af654f97d9878a86` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:00.921355 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10c2f9-507e-432b-b8a4-c5d9dc3a97cb None admin] RBAC: Authorizing `identity:get_group(group_id=f0709b5b2fe74ee4af654f97d9878a86)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:00.923034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10c2f9-507e-432b-b8a4-c5d9dc3a97cb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:00.925354 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 200/406] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 16:57:00 2022] GET /identity/v3/groups/f0709b5b2fe74ee4af654f97d9878a86 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:00.926416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10c2f9-507e-432b-b8a4-c5d9dc3a97cb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:00.992932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a6e70-208a-454e-a7fb-2bcc1ef35152 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:01.032726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed2d9a-8462-416d-9abc-d32249f873e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:01.034160 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed2d9a-8462-416d-9abc-d32249f873e9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:01.034784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed2d9a-8462-416d-9abc-d32249f873e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:01.035509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed2d9a-8462-416d-9abc-d32249f873e9 None admin] PATH_INFO: `/v3/groups/f0709b5b2fe74ee4af654f97d9878a86` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:01.036900 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed2d9a-8462-416d-9abc-d32249f873e9 None admin] RBAC: Authorizing `identity:get_group(group_id=f0709b5b2fe74ee4af654f97d9878a86)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:01.038960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed2d9a-8462-416d-9abc-d32249f873e9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:01.041819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 207/407] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 16:57:00 2022] GET /identity/v3/groups/f0709b5b2fe74ee4af654f97d9878a86 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:01.042962 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed2d9a-8462-416d-9abc-d32249f873e9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:01.062176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10c2f9-507e-432b-b8a4-c5d9dc3a97cb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:01.107300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b9c46-3497-4fc2-b409-a7e92ccc3d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:01.108292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9c46-3497-4fc2-b409-a7e92ccc3d6c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:01.108571 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9c46-3497-4fc2-b409-a7e92ccc3d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:01.108843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9c46-3497-4fc2-b409-a7e92ccc3d6c None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:01.109760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b9c46-3497-4fc2-b409-a7e92ccc3d6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:01.111962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b9c46-3497-4fc2-b409-a7e92ccc3d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:01.113367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b9c46-3497-4fc2-b409-a7e92ccc3d6c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:01.127516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 201/408] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:01.130756 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b9c46-3497-4fc2-b409-a7e92ccc3d6c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:01.189068 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed2d9a-8462-416d-9abc-d32249f873e9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:01.232579 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cfa96-b632-4552-b4c3-40ba7e119a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:01.233929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cfa96-b632-4552-b4c3-40ba7e119a5c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:01.234702 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cfa96-b632-4552-b4c3-40ba7e119a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:01.235435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cfa96-b632-4552-b4c3-40ba7e119a5c None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:01.237112 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cfa96-b632-4552-b4c3-40ba7e119a5c None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:01.239289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cfa96-b632-4552-b4c3-40ba7e119a5c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:01.242299 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 208/409] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:57:01 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:01.243394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cfa96-b632-4552-b4c3-40ba7e119a5c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:01.248648 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b9c46-3497-4fc2-b409-a7e92ccc3d6c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:01.290895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6008f98-77fe-428a-ac5a-36efc785a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:01.291914 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6008f98-77fe-428a-ac5a-36efc785a1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:01.292265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6008f98-77fe-428a-ac5a-36efc785a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:01.292610 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6008f98-77fe-428a-ac5a-36efc785a1f5 None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:01.294390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6008f98-77fe-428a-ac5a-36efc785a1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:01.296309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6008f98-77fe-428a-ac5a-36efc785a1f5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:01.299143 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 202/410] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:57:01 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:01.300565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6008f98-77fe-428a-ac5a-36efc785a1f5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:01.355091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cfa96-b632-4552-b4c3-40ba7e119a5c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:01.389588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b703cfe-a807-4d5f-a040-81f24ddea7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:01.390557 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b703cfe-a807-4d5f-a040-81f24ddea7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:01.390906 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b703cfe-a807-4d5f-a040-81f24ddea7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:01.391301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b703cfe-a807-4d5f-a040-81f24ddea7e7 None admin] PATH_INFO: `/v3/groups/7019fca97f1b490ea64652b3ee964940` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:01.392639 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b703cfe-a807-4d5f-a040-81f24ddea7e7 None admin] RBAC: Authorizing `identity:get_group(group_id=7019fca97f1b490ea64652b3ee964940)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:01.394155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b703cfe-a807-4d5f-a040-81f24ddea7e7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:01.396143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 209/411] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 16:57:01 2022] GET /identity/v3/groups/7019fca97f1b490ea64652b3ee964940 => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:01.400265 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b703cfe-a807-4d5f-a040-81f24ddea7e7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:01.410915 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6008f98-77fe-428a-ac5a-36efc785a1f5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:01.446258 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d77ef7-bbb5-48bf-b698-2271a754873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:01.447075 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d77ef7-bbb5-48bf-b698-2271a754873b None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:01.447357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d77ef7-bbb5-48bf-b698-2271a754873b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:01.447660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d77ef7-bbb5-48bf-b698-2271a754873b None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0/groups/f0709b5b2fe74ee4af654f97d9878a86/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:01.449735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d77ef7-bbb5-48bf-b698-2271a754873b None admin] RBAC: Authorizing `identity:create_grant(project_id=5597d4acc0664c3e805bd547a6173ed0, group_id=f0709b5b2fe74ee4af654f97d9878a86, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:01.451189 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d77ef7-bbb5-48bf-b698-2271a754873b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:01.471793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 203/412] 10.222.0.48 () {58 vars in 1442 bytes} [Tue May 17 16:57:01 2022] PUT /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0/groups/f0709b5b2fe74ee4af654f97d9878a86/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:57:01.472725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d77ef7-bbb5-48bf-b698-2271a754873b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:01.563547 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b703cfe-a807-4d5f-a040-81f24ddea7e7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:01.604967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d77ef7-bbb5-48bf-b698-2271a754873b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:01.645886 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ddff2-8064-4ab0-8e2c-5981af4abc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:01.646771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ddff2-8064-4ab0-8e2c-5981af4abc68 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:01.647051 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ddff2-8064-4ab0-8e2c-5981af4abc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:01.647326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ddff2-8064-4ab0-8e2c-5981af4abc68 None admin] PATH_INFO: `/v3/projects/3a3ee3f323ac4b12815e2057e52b4ed6` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:01.648701 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ddff2-8064-4ab0-8e2c-5981af4abc68 None admin] RBAC: Authorizing `identity:get_project(project_id=3a3ee3f323ac4b12815e2057e52b4ed6)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:01.650755 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ddff2-8064-4ab0-8e2c-5981af4abc68 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:01.656245 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78a574-365f-4b59-8272-a5b767fd726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:01.657147 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78a574-365f-4b59-8272-a5b767fd726a None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:01.657429 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78a574-365f-4b59-8272-a5b767fd726a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:01.657704 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78a574-365f-4b59-8272-a5b767fd726a None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0/groups/f0709b5b2fe74ee4af654f97d9878a86/roles/f47d350de184449f9ce5e84ebe7753da` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:01.658289 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 204/413] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:57:01 2022] GET /identity/v3/projects/3a3ee3f323ac4b12815e2057e52b4ed6 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:01.660217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ddff2-8064-4ab0-8e2c-5981af4abc68 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:01.661320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78a574-365f-4b59-8272-a5b767fd726a None admin] RBAC: Authorizing `identity:create_grant(project_id=5597d4acc0664c3e805bd547a6173ed0, group_id=f0709b5b2fe74ee4af654f97d9878a86, role_id=f47d350de184449f9ce5e84ebe7753da)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:01.662788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78a574-365f-4b59-8272-a5b767fd726a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:01.687550 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 210/414] 10.222.0.48 () {58 vars in 1442 bytes} [Tue May 17 16:57:01 2022] PUT /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0/groups/f0709b5b2fe74ee4af654f97d9878a86/roles/f47d350de184449f9ce5e84ebe7753da => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:57:01.783385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ddff2-8064-4ab0-8e2c-5981af4abc68 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:01.821739 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bf897-21df-4093-9bd3-6a84c21f3e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:01.822697 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bf897-21df-4093-9bd3-6a84c21f3e02 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:01.822977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bf897-21df-4093-9bd3-6a84c21f3e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:01.823246 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bf897-21df-4093-9bd3-6a84c21f3e02 None admin] PATH_INFO: `/v3/projects/3a3ee3f323ac4b12815e2057e52b4ed6/groups/7019fca97f1b490ea64652b3ee964940/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:01.825421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bf897-21df-4093-9bd3-6a84c21f3e02 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a3ee3f323ac4b12815e2057e52b4ed6, group_id=7019fca97f1b490ea64652b3ee964940, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:01.826893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bf897-21df-4093-9bd3-6a84c21f3e02 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:01.843239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 205/415] 10.222.0.48 () {58 vars in 1442 bytes} [Tue May 17 16:57:01 2022] PUT /identity/v3/projects/3a3ee3f323ac4b12815e2057e52b4ed6/groups/7019fca97f1b490ea64652b3ee964940/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:57:02.082755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ac738-d6b1-431d-97ac-a32530ae2386 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:02.083133 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ac738-d6b1-431d-97ac-a32530ae2386 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:02.083314 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ac738-d6b1-431d-97ac-a32530ae2386 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:02.084992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 211/416] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:02.091153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef611a-7953-42cc-8035-1009d3850ff1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:02.091440 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef611a-7953-42cc-8035-1009d3850ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:02.091792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef611a-7953-42cc-8035-1009d3850ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:02.109221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-31ef611a-7953-42cc-8035-1009d3850ff1 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:02.110727 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-31ef611a-7953-42cc-8035-1009d3850ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:02.183406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 206/417] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:02.207829 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ac738-d6b1-431d-97ac-a32530ae2386 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:02.318611 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ac738-d6b1-431d-97ac-a32530ae2386 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:02.352867 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b4cac-8847-429d-8bc0-5fd9d6276576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:02.354051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b4cac-8847-429d-8bc0-5fd9d6276576 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:02.354532 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b4cac-8847-429d-8bc0-5fd9d6276576 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:02.355019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b4cac-8847-429d-8bc0-5fd9d6276576 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:02.366471 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b4cac-8847-429d-8bc0-5fd9d6276576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-205b4cac-8847-429d-8bc0-5fd9d6276576 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:02.375986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:02.376869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:02.377648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:02.377648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:02.377648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:02.377648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:02.377648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:02.377648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:02.377648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:02.377648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:02.377648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:02.377648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:02.377648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:57:02.377648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:02.380330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 212/418] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:57:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:02.386300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef611a-7953-42cc-8035-1009d3850ff1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:02.410987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733018c-bd23-437b-a942-961e45e27bf0 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:02.411593 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733018c-bd23-437b-a942-961e45e27bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:02.412116 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733018c-bd23-437b-a942-961e45e27bf0 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:02.413929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 213/419] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:57:02.422873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b1224-8afa-4161-9285-6e852f68b766 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:02.423439 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b1224-8afa-4161-9285-6e852f68b766 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:02.423986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b1224-8afa-4161-9285-6e852f68b766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:02.441261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-130b1224-8afa-4161-9285-6e852f68b766 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:02.442770 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-130b1224-8afa-4161-9285-6e852f68b766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:02.511527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 214/420] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:57:02.535299 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b1224-8afa-4161-9285-6e852f68b766 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:02.575088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef611a-7953-42cc-8035-1009d3850ff1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:02.640340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a70cd-946f-4953-afbb-7a8a0ffe7035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:02.640937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a70cd-946f-4953-afbb-7a8a0ffe7035 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:02.641216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a70cd-946f-4953-afbb-7a8a0ffe7035 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:02.641485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a70cd-946f-4953-afbb-7a8a0ffe7035 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:02.642236 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a70cd-946f-4953-afbb-7a8a0ffe7035 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:02.642540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a70cd-946f-4953-afbb-7a8a0ffe7035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:02.644913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a70cd-946f-4953-afbb-7a8a0ffe7035 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:02.654412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 207/421] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:02.660630 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a70cd-946f-4953-afbb-7a8a0ffe7035 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:02.738367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b1224-8afa-4161-9285-6e852f68b766 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:02.770770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a70cd-946f-4953-afbb-7a8a0ffe7035 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:02.811975 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c7c51-9be5-4d64-89f2-22f2dc878b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:02.813153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c7c51-9be5-4d64-89f2-22f2dc878b4c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:02.813433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c7c51-9be5-4d64-89f2-22f2dc878b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:02.813959 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c7c51-9be5-4d64-89f2-22f2dc878b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:02.820441 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38a27a-7ed9-4150-86cc-41e3d7ba7d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:02.821242 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38a27a-7ed9-4150-86cc-41e3d7ba7d72 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:02.821521 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38a27a-7ed9-4150-86cc-41e3d7ba7d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:02.821794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38a27a-7ed9-4150-86cc-41e3d7ba7d72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:02.844425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38a27a-7ed9-4150-86cc-41e3d7ba7d72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-9a38a27a-7ed9-4150-86cc-41e3d7ba7d72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:02.860983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:02.861936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:02.862717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:02.862717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:02.862717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:02.862717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:02.862717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:02.862717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:02.862717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:02.862717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:02.862717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:02.862717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:02.862717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:57:02.862717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:02.863926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 215/422] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:02.870316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38a27a-7ed9-4150-86cc-41e3d7ba7d72 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:02.968763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c7c51-9be5-4d64-89f2-22f2dc878b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:02.970576 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c7c51-9be5-4d64-89f2-22f2dc878b4c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:02.985944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38a27a-7ed9-4150-86cc-41e3d7ba7d72 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:03.025301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aa5ff-b559-4d92-921e-a43c92fe72c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:03.025970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aa5ff-b559-4d92-921e-a43c92fe72c3 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:03.026246 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aa5ff-b559-4d92-921e-a43c92fe72c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:03.026514 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aa5ff-b559-4d92-921e-a43c92fe72c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:03.027255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137aa5ff-b559-4d92-921e-a43c92fe72c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:03.027558 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137aa5ff-b559-4d92-921e-a43c92fe72c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:03.031627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137aa5ff-b559-4d92-921e-a43c92fe72c3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:03.039364 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 216/423] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:57:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:03.045300 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aa5ff-b559-4d92-921e-a43c92fe72c3 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:03.179375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 208/424] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:03.185449 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c7c51-9be5-4d64-89f2-22f2dc878b4c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:03.190036 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aa5ff-b559-4d92-921e-a43c92fe72c3 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:03.229431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030dca8-60ba-4b4b-ac8f-84f83115baf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:03.230133 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030dca8-60ba-4b4b-ac8f-84f83115baf6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:03.230418 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030dca8-60ba-4b4b-ac8f-84f83115baf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:03.230691 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030dca8-60ba-4b4b-ac8f-84f83115baf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:03.303312 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030dca8-60ba-4b4b-ac8f-84f83115baf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:03.304798 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030dca8-60ba-4b4b-ac8f-84f83115baf6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:03.396373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c7c51-9be5-4d64-89f2-22f2dc878b4c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:03.466780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2fa85-6480-479b-8a15-4ff896d45d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:03.467668 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2fa85-6480-479b-8a15-4ff896d45d42 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:03.467948 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2fa85-6480-479b-8a15-4ff896d45d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:03.468218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2fa85-6480-479b-8a15-4ff896d45d42 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:03.469971 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2fa85-6480-479b-8a15-4ff896d45d42 None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:03.471426 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2fa85-6480-479b-8a15-4ff896d45d42 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:03.475311 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 209/425] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:57:03 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:03.479768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2fa85-6480-479b-8a15-4ff896d45d42 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:03.480200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 217/426] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:03.485904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030dca8-60ba-4b4b-ac8f-84f83115baf6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:03.592491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2fa85-6480-479b-8a15-4ff896d45d42 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:03.627630 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee045aa-d901-4ffd-9765-d0e931d9e6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:03.629213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee045aa-d901-4ffd-9765-d0e931d9e6cb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:03.631676 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee045aa-d901-4ffd-9765-d0e931d9e6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:03.632675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee045aa-d901-4ffd-9765-d0e931d9e6cb None admin] PATH_INFO: `/v3/groups/f0709b5b2fe74ee4af654f97d9878a86` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:03.640402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee045aa-d901-4ffd-9765-d0e931d9e6cb None admin] RBAC: Authorizing `identity:get_group(group_id=f0709b5b2fe74ee4af654f97d9878a86)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:03.641880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee045aa-d901-4ffd-9765-d0e931d9e6cb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:03.643905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 210/427] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 16:57:03 2022] GET /identity/v3/groups/f0709b5b2fe74ee4af654f97d9878a86 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:03.649617 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee045aa-d901-4ffd-9765-d0e931d9e6cb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:03.687227 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030dca8-60ba-4b4b-ac8f-84f83115baf6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:03.756943 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214b26b-9039-4795-b50d-d42a350f74a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:03.758083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214b26b-9039-4795-b50d-d42a350f74a7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:03.758536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214b26b-9039-4795-b50d-d42a350f74a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:03.758977 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214b26b-9039-4795-b50d-d42a350f74a7 None admin] PATH_INFO: `/v3/projects/37528046958f43e8b9cf2ffd96d3def0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:03.760555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214b26b-9039-4795-b50d-d42a350f74a7 None admin] RBAC: Authorizing `identity:get_project(project_id=37528046958f43e8b9cf2ffd96d3def0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:03.763283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214b26b-9039-4795-b50d-d42a350f74a7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:03.769575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 218/428] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:57:03 2022] GET /identity/v3/projects/37528046958f43e8b9cf2ffd96d3def0 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:03.771960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214b26b-9039-4795-b50d-d42a350f74a7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:03.807987 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee045aa-d901-4ffd-9765-d0e931d9e6cb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:03.847628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09f11-f29b-4550-955a-07dfa856677e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:03.847628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09f11-f29b-4550-955a-07dfa856677e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:03.847628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09f11-f29b-4550-955a-07dfa856677e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:03.847628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09f11-f29b-4550-955a-07dfa856677e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:03.847989 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d09f11-f29b-4550-955a-07dfa856677e None admin] RBAC: Adding query filter params (group.id=f0709b5b2fe74ee4af654f97d9878a86, role.id=f47d350de184449f9ce5e84ebe7753da, scope.project.id=37528046958f43e8b9cf2ffd96d3def0) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:03.847989 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d09f11-f29b-4550-955a-07dfa856677e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:03.847989 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d09f11-f29b-4550-955a-07dfa856677e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:03.853963 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 211/429] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 16:57:03 2022] GET /identity/v3/role_assignments?group.id=f0709b5b2fe74ee4af654f97d9878a86&scope.project.id=37528046958f43e8b9cf2ffd96d3def0&role.id=f47d350de184449f9ce5e84ebe7753da => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:03.917199 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214b26b-9039-4795-b50d-d42a350f74a7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:03.960539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9c249-7c4c-4c01-b0c7-acfb3d443cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:03.961472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9c249-7c4c-4c01-b0c7-acfb3d443cef None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:03.961757 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9c249-7c4c-4c01-b0c7-acfb3d443cef None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:03.962033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9c249-7c4c-4c01-b0c7-acfb3d443cef None admin] PATH_INFO: `/v3/groups/f0709b5b2fe74ee4af654f97d9878a86` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:03.963264 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9c249-7c4c-4c01-b0c7-acfb3d443cef None admin] RBAC: Authorizing `identity:get_group(group_id=f0709b5b2fe74ee4af654f97d9878a86)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:03.964732 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9c249-7c4c-4c01-b0c7-acfb3d443cef None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:03.966388 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 219/430] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 16:57:03 2022] GET /identity/v3/groups/f0709b5b2fe74ee4af654f97d9878a86 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:03.972345 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09f11-f29b-4550-955a-07dfa856677e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:04.096517 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09f11-f29b-4550-955a-07dfa856677e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:04.140543 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e86dca-4e7d-447f-a412-f63f716db8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:04.141292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e86dca-4e7d-447f-a412-f63f716db8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:04.141584 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e86dca-4e7d-447f-a412-f63f716db8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:04.141866 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e86dca-4e7d-447f-a412-f63f716db8e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:04.142887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e86dca-4e7d-447f-a412-f63f716db8e1 None admin] RBAC: Adding query filter params (group.id=f0709b5b2fe74ee4af654f97d9878a86, role.id=e613911293e3458c975cbab36cae354d, scope.project.id=37528046958f43e8b9cf2ffd96d3def0) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:04.143209 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e86dca-4e7d-447f-a412-f63f716db8e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:04.144716 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e86dca-4e7d-447f-a412-f63f716db8e1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:04.155479 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 212/431] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 16:57:03 2022] GET /identity/v3/role_assignments?group.id=f0709b5b2fe74ee4af654f97d9878a86&scope.project.id=37528046958f43e8b9cf2ffd96d3def0&role.id=e613911293e3458c975cbab36cae354d => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:04.274948 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191400a-d6b9-4576-ac0f-21bb22422981 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:04.275268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191400a-d6b9-4576-ac0f-21bb22422981 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:04.275517 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191400a-d6b9-4576-ac0f-21bb22422981 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:04.277208 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 220/432] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:04.283511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890387-b6a4-4aed-951f-9039ad7989a0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:04.283831 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890387-b6a4-4aed-951f-9039ad7989a0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:04.284112 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890387-b6a4-4aed-951f-9039ad7989a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:04.303200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6f890387-b6a4-4aed-951f-9039ad7989a0 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:04.304446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6f890387-b6a4-4aed-951f-9039ad7989a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:04.393890 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 213/433] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:04.418586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191400a-d6b9-4576-ac0f-21bb22422981 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:04.525247 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191400a-d6b9-4576-ac0f-21bb22422981 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:04.555104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a98010-c1ae-44d7-b14b-55ec02c5f0fa None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:04.555653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a98010-c1ae-44d7-b14b-55ec02c5f0fa None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:04.555860 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a98010-c1ae-44d7-b14b-55ec02c5f0fa None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:04.557166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 214/434] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:04.564423 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff20be1-7ce7-4862-934c-5103ace558d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:04.564992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699c5a4-41bb-4c1f-9eb3-f93c23cb63a0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:04.565512 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff20be1-7ce7-4862-934c-5103ace558d2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:04.565762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699c5a4-41bb-4c1f-9eb3-f93c23cb63a0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:04.565860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff20be1-7ce7-4862-934c-5103ace558d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:04.566063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff20be1-7ce7-4862-934c-5103ace558d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:04.566500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699c5a4-41bb-4c1f-9eb3-f93c23cb63a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:04.577299 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff20be1-7ce7-4862-934c-5103ace558d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-9ff20be1-7ce7-4862-934c-5103ace558d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:04.585161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:04.586028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:04.586806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:04.586806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:04.586806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:04.586806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:04.586806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:04.586806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:04.586806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:04.586806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:04.586806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:04.586806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:04.586806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 16:57:04.586806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:04.587438 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a699c5a4-41bb-4c1f-9eb3-f93c23cb63a0 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:04.587509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 221/435] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:04.588134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a699c5a4-41bb-4c1f-9eb3-f93c23cb63a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:04.588245 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6b2bd-57fc-4719-a0eb-3d3e984e3e23 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:04.588395 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6b2bd-57fc-4719-a0eb-3d3e984e3e23 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:04.589606 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6b2bd-57fc-4719-a0eb-3d3e984e3e23 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:04.590076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 222/436] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:04.593768 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6b2bd-57fc-4719-a0eb-3d3e984e3e23 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:04.661985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 215/437] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:57:04.663581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c715b18-ba26-462c-b693-a67adea15e46 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:04.664111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c715b18-ba26-462c-b693-a67adea15e46 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:04.664585 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c715b18-ba26-462c-b693-a67adea15e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:04.680967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2c715b18-ba26-462c-b693-a67adea15e46 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:04.682657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2c715b18-ba26-462c-b693-a67adea15e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:04.708154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6b2bd-57fc-4719-a0eb-3d3e984e3e23 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:04.746467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd9701-d27d-4e88-a9bb-265a3fb15ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:04.747063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd9701-d27d-4e88-a9bb-265a3fb15ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:04.747428 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd9701-d27d-4e88-a9bb-265a3fb15ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:04.747752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd9701-d27d-4e88-a9bb-265a3fb15ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:04.748504 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd9701-d27d-4e88-a9bb-265a3fb15ec8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:04.748814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd9701-d27d-4e88-a9bb-265a3fb15ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:04.750209 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd9701-d27d-4e88-a9bb-265a3fb15ec8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:04.756499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 216/438] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:04.757185 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c715b18-ba26-462c-b693-a67adea15e46 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:04.766624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 223/439] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:57:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:04.772772 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd9701-d27d-4e88-a9bb-265a3fb15ec8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:04.867492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c715b18-ba26-462c-b693-a67adea15e46 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:04.874433 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd9701-d27d-4e88-a9bb-265a3fb15ec8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:04.899836 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7969ec-6fb3-4eaf-9ac3-7b4d77a9762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:04.900640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7969ec-6fb3-4eaf-9ac3-7b4d77a9762c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:04.900914 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7969ec-6fb3-4eaf-9ac3-7b4d77a9762c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:04.901188 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7969ec-6fb3-4eaf-9ac3-7b4d77a9762c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:04.906733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8e67f-bace-417b-9f27-34be3f758b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:04.907367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8e67f-bace-417b-9f27-34be3f758b40 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:04.907673 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8e67f-bace-417b-9f27-34be3f758b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:04.907950 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8e67f-bace-417b-9f27-34be3f758b40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:04.912274 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7969ec-6fb3-4eaf-9ac3-7b4d77a9762c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-3a7969ec-6fb3-4eaf-9ac3-7b4d77a9762c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:04.921308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:04.922377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:04.927972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:04.927972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:04.927972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:04.927972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:04.927972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:04.927972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:04.927972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:04.927972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:04.927972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:04.927972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:04.927972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:57:04.927972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:04.927972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 217/440] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:57:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:04.927972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7969ec-6fb3-4eaf-9ac3-7b4d77a9762c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:04.972529 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8e67f-bace-417b-9f27-34be3f758b40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:04.973976 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8e67f-bace-417b-9f27-34be3f758b40 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:05.019653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7969ec-6fb3-4eaf-9ac3-7b4d77a9762c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:05.051849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424a718-01d1-4c32-95f0-887182c4bf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:05.052629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a718-01d1-4c32-95f0-887182c4bf8e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:05.052905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a718-01d1-4c32-95f0-887182c4bf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:05.053178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a718-01d1-4c32-95f0-887182c4bf8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:05.062721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424a718-01d1-4c32-95f0-887182c4bf8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:05.065984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 224/441] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:05.066832 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8e67f-bace-417b-9f27-34be3f758b40 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5424a718-01d1-4c32-95f0-887182c4bf8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:05.070901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:05.071954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:05.072750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:05.072750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:05.072750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:05.072750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:05.072750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:05.072750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:05.072750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:05.072750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:05.072750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:05.072750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:05.072750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:05.072750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:05.072750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 218/442] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:57:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:05.073396 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424a718-01d1-4c32-95f0-887182c4bf8e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:05.167220 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8e67f-bace-417b-9f27-34be3f758b40 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:05.172433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424a718-01d1-4c32-95f0-887182c4bf8e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:05.198985 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f72ca-01c5-4fcc-b9c1-687e0cdac499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:05.199730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f72ca-01c5-4fcc-b9c1-687e0cdac499 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:05.200142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f72ca-01c5-4fcc-b9c1-687e0cdac499 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:05.200419 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f72ca-01c5-4fcc-b9c1-687e0cdac499 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:05.201150 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f72ca-01c5-4fcc-b9c1-687e0cdac499 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:05.201448 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f72ca-01c5-4fcc-b9c1-687e0cdac499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:05.202795 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f72ca-01c5-4fcc-b9c1-687e0cdac499 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:05.204152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fad11d-aae5-4172-9b32-98d5239e0632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:05.205010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fad11d-aae5-4172-9b32-98d5239e0632 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:05.205291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fad11d-aae5-4172-9b32-98d5239e0632 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:05.205562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fad11d-aae5-4172-9b32-98d5239e0632 None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:05.206732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fad11d-aae5-4172-9b32-98d5239e0632 None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:05.208213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fad11d-aae5-4172-9b32-98d5239e0632 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:05.209881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 219/443] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:57:05 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:05.215553 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 225/444] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:05.215729 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fad11d-aae5-4172-9b32-98d5239e0632 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:05.216098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f72ca-01c5-4fcc-b9c1-687e0cdac499 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:05.308090 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fad11d-aae5-4172-9b32-98d5239e0632 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:05.308841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f72ca-01c5-4fcc-b9c1-687e0cdac499 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:05.339823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d3c9f-3e33-466e-80df-a4e0b684ac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:05.340810 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241909c1-0876-43b4-81a4-ee789d2ed584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:05.341145 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d3c9f-3e33-466e-80df-a4e0b684ac04 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:05.341406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d3c9f-3e33-466e-80df-a4e0b684ac04 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:05.341681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241909c1-0876-43b4-81a4-ee789d2ed584 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:05.341784 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d3c9f-3e33-466e-80df-a4e0b684ac04 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:05.342039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241909c1-0876-43b4-81a4-ee789d2ed584 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:05.342227 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241909c1-0876-43b4-81a4-ee789d2ed584 None admin] PATH_INFO: `/v3/groups/f0709b5b2fe74ee4af654f97d9878a86` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:05.342420 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d3c9f-3e33-466e-80df-a4e0b684ac04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:05.342726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d3c9f-3e33-466e-80df-a4e0b684ac04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:05.343399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241909c1-0876-43b4-81a4-ee789d2ed584 None admin] RBAC: Authorizing `identity:get_group(group_id=f0709b5b2fe74ee4af654f97d9878a86)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:05.344130 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d3c9f-3e33-466e-80df-a4e0b684ac04 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:05.344858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241909c1-0876-43b4-81a4-ee789d2ed584 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:05.346453 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 226/445] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 16:57:05 2022] GET /identity/v3/groups/f0709b5b2fe74ee4af654f97d9878a86 => generated 226 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:05.350261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241909c1-0876-43b4-81a4-ee789d2ed584 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:05.356513 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 220/446] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:05.356513 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d3c9f-3e33-466e-80df-a4e0b684ac04 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:05.443636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241909c1-0876-43b4-81a4-ee789d2ed584 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:05.449503 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d3c9f-3e33-466e-80df-a4e0b684ac04 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:05.474200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7b6e3-e7ef-42c5-9789-bd2786fc6512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:05.474831 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7b6e3-e7ef-42c5-9789-bd2786fc6512 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:05.475107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7b6e3-e7ef-42c5-9789-bd2786fc6512 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:05.475379 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7b6e3-e7ef-42c5-9789-bd2786fc6512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:05.480637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ba0c2-8257-49d6-bc4a-39221eed65a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:05.481788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ba0c2-8257-49d6-bc4a-39221eed65a5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:05.482066 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ba0c2-8257-49d6-bc4a-39221eed65a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:05.482339 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ba0c2-8257-49d6-bc4a-39221eed65a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:05.483155 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ba0c2-8257-49d6-bc4a-39221eed65a5 None admin] RBAC: Adding query filter params (group.id=f0709b5b2fe74ee4af654f97d9878a86, role.id=e613911293e3458c975cbab36cae354d, scope.project.id=5597d4acc0664c3e805bd547a6173ed0) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:05.483467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ba0c2-8257-49d6-bc4a-39221eed65a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:05.484922 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ba0c2-8257-49d6-bc4a-39221eed65a5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:05.490496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 221/447] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 16:57:05 2022] GET /identity/v3/role_assignments?group.id=f0709b5b2fe74ee4af654f97d9878a86&scope.project.id=5597d4acc0664c3e805bd547a6173ed0&role.id=e613911293e3458c975cbab36cae354d => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:05.491264 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ba0c2-8257-49d6-bc4a-39221eed65a5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:05.544512 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7b6e3-e7ef-42c5-9789-bd2786fc6512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:05.546041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7b6e3-e7ef-42c5-9789-bd2786fc6512 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:05.595419 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ba0c2-8257-49d6-bc4a-39221eed65a5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:05.630023 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04ba6d-45c9-4f09-91b0-32a4c1ca1ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:05.630684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04ba6d-45c9-4f09-91b0-32a4c1ca1ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:05.630964 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04ba6d-45c9-4f09-91b0-32a4c1ca1ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:05.631233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04ba6d-45c9-4f09-91b0-32a4c1ca1ae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:05.648993 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 227/448] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:05.654598 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7b6e3-e7ef-42c5-9789-bd2786fc6512 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:05.714636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04ba6d-45c9-4f09-91b0-32a4c1ca1ae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:05.716794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04ba6d-45c9-4f09-91b0-32a4c1ca1ae0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:05.762175 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7b6e3-e7ef-42c5-9789-bd2786fc6512 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:05.800715 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed602f-016f-4305-ad58-e1aeebe66e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:05.801578 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed602f-016f-4305-ad58-e1aeebe66e6a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:05.801882 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed602f-016f-4305-ad58-e1aeebe66e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:05.802128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed602f-016f-4305-ad58-e1aeebe66e6a None admin] PATH_INFO: `/v3/projects/5597d4acc0664c3e805bd547a6173ed0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:05.803320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed602f-016f-4305-ad58-e1aeebe66e6a None admin] RBAC: Authorizing `identity:get_project(project_id=5597d4acc0664c3e805bd547a6173ed0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:05.804890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed602f-016f-4305-ad58-e1aeebe66e6a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:05.806432 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 228/449] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:57:05 2022] GET /identity/v3/projects/5597d4acc0664c3e805bd547a6173ed0 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:05.812719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed602f-016f-4305-ad58-e1aeebe66e6a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:05.825308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 222/450] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:05.830938 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04ba6d-45c9-4f09-91b0-32a4c1ca1ae0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:05.915168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed602f-016f-4305-ad58-e1aeebe66e6a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:05.931653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04ba6d-45c9-4f09-91b0-32a4c1ca1ae0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:05.947271 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285048b1-c496-4f52-8eaa-8ca605bbf183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:05.948137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285048b1-c496-4f52-8eaa-8ca605bbf183 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:05.948414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285048b1-c496-4f52-8eaa-8ca605bbf183 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:05.948684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285048b1-c496-4f52-8eaa-8ca605bbf183 None admin] PATH_INFO: `/v3/groups/f0709b5b2fe74ee4af654f97d9878a86` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:05.950962 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285048b1-c496-4f52-8eaa-8ca605bbf183 None admin] RBAC: Authorizing `identity:get_group(group_id=f0709b5b2fe74ee4af654f97d9878a86)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:05.952414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285048b1-c496-4f52-8eaa-8ca605bbf183 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:05.954171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 229/451] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 16:57:05 2022] GET /identity/v3/groups/f0709b5b2fe74ee4af654f97d9878a86 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:05.959743 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285048b1-c496-4f52-8eaa-8ca605bbf183 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:05.964447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c603342-57c5-4043-9fb3-e61aabb64b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:05.965485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c603342-57c5-4043-9fb3-e61aabb64b34 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:05.965720 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c603342-57c5-4043-9fb3-e61aabb64b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:05.966004 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c603342-57c5-4043-9fb3-e61aabb64b34 None admin] PATH_INFO: `/v3/projects/3a3ee3f323ac4b12815e2057e52b4ed6` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:05.967188 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c603342-57c5-4043-9fb3-e61aabb64b34 None admin] RBAC: Authorizing `identity:get_project(project_id=3a3ee3f323ac4b12815e2057e52b4ed6)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:05.968647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c603342-57c5-4043-9fb3-e61aabb64b34 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:05.970328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 223/452] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:57:05 2022] GET /identity/v3/projects/3a3ee3f323ac4b12815e2057e52b4ed6 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:05.975487 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c603342-57c5-4043-9fb3-e61aabb64b34 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:06.050973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285048b1-c496-4f52-8eaa-8ca605bbf183 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:06.068701 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c603342-57c5-4043-9fb3-e61aabb64b34 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:06.082522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82440256-fd02-4a5e-9ebe-b65080b5eee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:06.083157 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82440256-fd02-4a5e-9ebe-b65080b5eee5 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:06.083434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82440256-fd02-4a5e-9ebe-b65080b5eee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:06.083742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82440256-fd02-4a5e-9ebe-b65080b5eee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:06.084553 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82440256-fd02-4a5e-9ebe-b65080b5eee5 None admin] RBAC: Adding query filter params (group.id=f0709b5b2fe74ee4af654f97d9878a86, role.id=f47d350de184449f9ce5e84ebe7753da, scope.project.id=5597d4acc0664c3e805bd547a6173ed0) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:06.084858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82440256-fd02-4a5e-9ebe-b65080b5eee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:06.086265 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82440256-fd02-4a5e-9ebe-b65080b5eee5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:06.092132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 230/453] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 16:57:05 2022] GET /identity/v3/role_assignments?group.id=f0709b5b2fe74ee4af654f97d9878a86&scope.project.id=5597d4acc0664c3e805bd547a6173ed0&role.id=f47d350de184449f9ce5e84ebe7753da => generated 611 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:06.101973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40acefa-6d7c-4929-94ea-9fa7d3736956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:06.102852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40acefa-6d7c-4929-94ea-9fa7d3736956 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:06.103130 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40acefa-6d7c-4929-94ea-9fa7d3736956 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:06.103402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40acefa-6d7c-4929-94ea-9fa7d3736956 None admin] PATH_INFO: `/v3/groups/7019fca97f1b490ea64652b3ee964940` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:06.104685 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40acefa-6d7c-4929-94ea-9fa7d3736956 None admin] RBAC: Authorizing `identity:get_group(group_id=7019fca97f1b490ea64652b3ee964940)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:06.106851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40acefa-6d7c-4929-94ea-9fa7d3736956 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:06.108589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 224/454] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 16:57:05 2022] GET /identity/v3/groups/7019fca97f1b490ea64652b3ee964940 => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:06.114654 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82440256-fd02-4a5e-9ebe-b65080b5eee5 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:06.218431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82440256-fd02-4a5e-9ebe-b65080b5eee5 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:06.252189 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027d633-5538-49f0-ac97-977d49860b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:06.252851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027d633-5538-49f0-ac97-977d49860b40 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:06.253134 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027d633-5538-49f0-ac97-977d49860b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:06.253409 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027d633-5538-49f0-ac97-977d49860b40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:06.254282 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027d633-5538-49f0-ac97-977d49860b40 None admin] RBAC: Adding query filter params (group.id=7019fca97f1b490ea64652b3ee964940, role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=3a3ee3f323ac4b12815e2057e52b4ed6) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:06.254596 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027d633-5538-49f0-ac97-977d49860b40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:06.256092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027d633-5538-49f0-ac97-977d49860b40 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:06.262862 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 231/455] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 16:57:06 2022] GET /identity/v3/role_assignments?group.id=7019fca97f1b490ea64652b3ee964940&scope.project.id=3a3ee3f323ac4b12815e2057e52b4ed6&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:09.153496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9e78a-acaf-4929-a297-7a3304703772 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:09.154047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9e78a-acaf-4929-a297-7a3304703772 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:09.154047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9e78a-acaf-4929-a297-7a3304703772 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:09.155675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 225/456] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:09.160727 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9b947-f41b-4ddd-9a71-0ff51b99aa74 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:09.161599 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9b947-f41b-4ddd-9a71-0ff51b99aa74 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:09.162106 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9b947-f41b-4ddd-9a71-0ff51b99aa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:09.187524 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-74c9b947-f41b-4ddd-9a71-0ff51b99aa74 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:09.189369 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-74c9b947-f41b-4ddd-9a71-0ff51b99aa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:09.268419 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 232/457] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:09.288969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e47a8-5405-48b1-bb5e-1910f5ec581f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:09.288969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e47a8-5405-48b1-bb5e-1910f5ec581f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:09.288969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e47a8-5405-48b1-bb5e-1910f5ec581f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:09.289637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 226/458] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:09.291662 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9b947-f41b-4ddd-9a71-0ff51b99aa74 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:09.295986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f4ca7-25fd-4c76-83c5-3c7bafd47505 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:09.296536 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f4ca7-25fd-4c76-83c5-3c7bafd47505 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:09.297009 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f4ca7-25fd-4c76-83c5-3c7bafd47505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:09.317032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-682f4ca7-25fd-4c76-83c5-3c7bafd47505 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:09.319132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-682f4ca7-25fd-4c76-83c5-3c7bafd47505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:09.394486 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 227/459] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:57:09.423443 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f4ca7-25fd-4c76-83c5-3c7bafd47505 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:09.477002 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9b947-f41b-4ddd-9a71-0ff51b99aa74 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:09.517994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02c442-e8cc-4a5a-9874-a3647ee06de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:09.519439 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02c442-e8cc-4a5a-9874-a3647ee06de5 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:09.519948 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02c442-e8cc-4a5a-9874-a3647ee06de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:09.520402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02c442-e8cc-4a5a-9874-a3647ee06de5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:09.536919 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f4ca7-25fd-4c76-83c5-3c7bafd47505 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:09.537815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02c442-e8cc-4a5a-9874-a3647ee06de5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:09.539772 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02c442-e8cc-4a5a-9874-a3647ee06de5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:09.564191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-3b02c442-e8cc-4a5a-9874-a3647ee06de5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:09.564191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:09.564191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:09.564191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:09.564191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:09.564191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:09.564191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:09.564191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:09.564191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:09.564191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:09.564191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:09.564191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:09.564191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:09.564191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:09.564191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:09.565311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:09.566357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:09.566357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:09.566357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:09.566357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:09.573427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 233/460] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:09.573427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77097e-3d64-4349-b1ea-7a8c87c12856 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:09.573427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77097e-3d64-4349-b1ea-7a8c87c12856 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:09.573718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77097e-3d64-4349-b1ea-7a8c87c12856 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:09.575289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 234/461] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:09.575860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77097e-3d64-4349-b1ea-7a8c87c12856 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:09.583859 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df8002-2951-45e6-9938-f7a5306ade5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:09.584941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df8002-2951-45e6-9938-f7a5306ade5b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:09.585449 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df8002-2951-45e6-9938-f7a5306ade5b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:09.585916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df8002-2951-45e6-9938-f7a5306ade5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:09.597058 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df8002-2951-45e6-9938-f7a5306ade5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:09.598804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df8002-2951-45e6-9938-f7a5306ade5b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:09.617595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-75df8002-2951-45e6-9938-f7a5306ade5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:09.617595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:09.617595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:09.617595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:09.617595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:09.617595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:09.617595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:09.617595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:09.617595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:09.617595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:09.617595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:09.617595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:09.617595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:09.617595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:09.617595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:09.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:09.619340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:09.619340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:09.619340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:09.619340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:09.622166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 228/462] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:09.623574 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3a1f6-c947-45cc-bd31-73d8a2e6a4e5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:09.624080 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3a1f6-c947-45cc-bd31-73d8a2e6a4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:09.624735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3a1f6-c947-45cc-bd31-73d8a2e6a4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:09.642600 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d9f3a1f6-c947-45cc-bd31-73d8a2e6a4e5 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:09.644115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d9f3a1f6-c947-45cc-bd31-73d8a2e6a4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:09.681284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77097e-3d64-4349-b1ea-7a8c87c12856 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:09.711638 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 229/463] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:09.713081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3a1f6-c947-45cc-bd31-73d8a2e6a4e5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:09.720389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e62b9-2580-4ae2-83cb-47778008d923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:09.721717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e62b9-2580-4ae2-83cb-47778008d923 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:09.722208 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e62b9-2580-4ae2-83cb-47778008d923 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:09.722726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e62b9-2580-4ae2-83cb-47778008d923 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:09.724031 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e62b9-2580-4ae2-83cb-47778008d923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:09.724863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e62b9-2580-4ae2-83cb-47778008d923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:09.726935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e62b9-2580-4ae2-83cb-47778008d923 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:09.739752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 235/464] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:09.741084 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94884bb8-8f65-4bb0-b55c-eec8a6ec9b3e None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:09.741371 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94884bb8-8f65-4bb0-b55c-eec8a6ec9b3e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:09.741650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94884bb8-8f65-4bb0-b55c-eec8a6ec9b3e None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:09.743012 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 236/465] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:09.743815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94884bb8-8f65-4bb0-b55c-eec8a6ec9b3e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:09.815973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3a1f6-c947-45cc-bd31-73d8a2e6a4e5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:09.840591 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94884bb8-8f65-4bb0-b55c-eec8a6ec9b3e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:09.848789 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745b705-5343-4588-825a-b729dfea42f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:09.849450 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745b705-5343-4588-825a-b729dfea42f3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:09.849730 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745b705-5343-4588-825a-b729dfea42f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:09.850003 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745b705-5343-4588-825a-b729dfea42f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:09.850714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745b705-5343-4588-825a-b729dfea42f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:09.851017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745b705-5343-4588-825a-b729dfea42f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:09.852405 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745b705-5343-4588-825a-b729dfea42f3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:09.869503 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 230/466] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:09.871808 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b7e90-4e36-4e53-a16b-4f416b84431c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:09.871808 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b7e90-4e36-4e53-a16b-4f416b84431c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:09.871808 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b7e90-4e36-4e53-a16b-4f416b84431c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:09.877931 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5f8dc-96ed-4aa8-be2e-15a9866f7a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:09.878727 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5f8dc-96ed-4aa8-be2e-15a9866f7a77 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:09.879010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5f8dc-96ed-4aa8-be2e-15a9866f7a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:09.879287 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5f8dc-96ed-4aa8-be2e-15a9866f7a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:09.887926 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-187b7e90-4e36-4e53-a16b-4f416b84431c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:09.889083 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-187b7e90-4e36-4e53-a16b-4f416b84431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:09.890951 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5f8dc-96ed-4aa8-be2e-15a9866f7a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:09.892503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5f8dc-96ed-4aa8-be2e-15a9866f7a77 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:09.909610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-5ae5f8dc-96ed-4aa8-be2e-15a9866f7a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:09.909610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:09.909610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:09.909610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:09.909610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:09.909610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:09.909610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:09.909610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:09.909610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:09.909610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:09.909610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:09.909610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:09.909610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:09.909610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:09.909610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:09.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:09.911329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:09.911329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:09.911329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:09.911329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:09.911329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 237/467] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:09.911583 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5f8dc-96ed-4aa8-be2e-15a9866f7a77 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:09.962741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 231/468] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:09.963457 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b7e90-4e36-4e53-a16b-4f416b84431c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:10.025776 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5f8dc-96ed-4aa8-be2e-15a9866f7a77 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:10.060343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a8873-fd8d-44c5-bb1f-550748cae6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:10.061003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a8873-fd8d-44c5-bb1f-550748cae6b7 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:10.061283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a8873-fd8d-44c5-bb1f-550748cae6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:10.061554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a8873-fd8d-44c5-bb1f-550748cae6b7 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:10.062248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a8873-fd8d-44c5-bb1f-550748cae6b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:10.063969 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a8873-fd8d-44c5-bb1f-550748cae6b7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:10.065501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b7e90-4e36-4e53-a16b-4f416b84431c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:10.083871 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 238/469] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:57:09 2022] POST /identity/v3/users => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:57:10.093544 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a8873-fd8d-44c5-bb1f-550748cae6b7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:10.107871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52512dd-7ed8-45ae-a27f-f05d63943470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:10.108951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52512dd-7ed8-45ae-a27f-f05d63943470 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:10.109515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52512dd-7ed8-45ae-a27f-f05d63943470 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:10.110018 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52512dd-7ed8-45ae-a27f-f05d63943470 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:10.110992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52512dd-7ed8-45ae-a27f-f05d63943470 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:10.112785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52512dd-7ed8-45ae-a27f-f05d63943470 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:10.137392 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 232/470] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:57:09 2022] POST /identity/v3/users => generated 248 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:57:10.137392 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52512dd-7ed8-45ae-a27f-f05d63943470 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:10.277919 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52512dd-7ed8-45ae-a27f-f05d63943470 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:10.295006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a8873-fd8d-44c5-bb1f-550748cae6b7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:10.335790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332e734-7154-41ee-a8a9-857d99a6a256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:10.336269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83feb449-51b5-477e-97bb-84ae43b0d9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:10.336501 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332e734-7154-41ee-a8a9-857d99a6a256 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:10.336739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332e734-7154-41ee-a8a9-857d99a6a256 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:10.337061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332e734-7154-41ee-a8a9-857d99a6a256 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:10.337158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feb449-51b5-477e-97bb-84ae43b0d9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:10.337331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feb449-51b5-477e-97bb-84ae43b0d9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:10.337600 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feb449-51b5-477e-97bb-84ae43b0d9b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:10.337781 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332e734-7154-41ee-a8a9-857d99a6a256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:10.338141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332e734-7154-41ee-a8a9-857d99a6a256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:10.339463 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332e734-7154-41ee-a8a9-857d99a6a256 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:10.349375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83feb449-51b5-477e-97bb-84ae43b0d9b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:10.350905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83feb449-51b5-477e-97bb-84ae43b0d9b3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:10.356974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 239/471] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:10.366097 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332e734-7154-41ee-a8a9-857d99a6a256 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:10.379968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-83feb449-51b5-477e-97bb-84ae43b0d9b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:10.379968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:10.379968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:10.379968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:10.379968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:10.379968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:10.379968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:10.379968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:10.379968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:10.379968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:10.379968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:10.379968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:10.379968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:10.379968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:10.379968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:10.380902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:10.381723 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:10.381723 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:10.381723 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:10.381723 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:10.381723 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 233/472] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:10.392682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83feb449-51b5-477e-97bb-84ae43b0d9b3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:10.483774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332e734-7154-41ee-a8a9-857d99a6a256 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:10.504606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83feb449-51b5-477e-97bb-84ae43b0d9b3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:10.524792 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf75ef-f7a6-4a9c-aa04-a6522876e106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:10.526084 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf75ef-f7a6-4a9c-aa04-a6522876e106 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:10.526564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf75ef-f7a6-4a9c-aa04-a6522876e106 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:10.527052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf75ef-f7a6-4a9c-aa04-a6522876e106 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:10.528716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf75ef-f7a6-4a9c-aa04-a6522876e106 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:10.530872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf75ef-f7a6-4a9c-aa04-a6522876e106 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:10.548108 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619040f-64ef-4f46-9aa9-b1dec4175064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:10.548544 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619040f-64ef-4f46-9aa9-b1dec4175064 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:10.548829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619040f-64ef-4f46-9aa9-b1dec4175064 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:10.549107 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619040f-64ef-4f46-9aa9-b1dec4175064 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:10.550352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619040f-64ef-4f46-9aa9-b1dec4175064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:10.550659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619040f-64ef-4f46-9aa9-b1dec4175064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:10.552141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619040f-64ef-4f46-9aa9-b1dec4175064 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:10.554719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 240/473] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:57:10 2022] POST /identity/v3/users => generated 248 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:57:10.566413 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 234/474] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:10.571835 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf75ef-f7a6-4a9c-aa04-a6522876e106 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:10.596683 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425a90d-3638-4631-9fd1-2eb5d313d815 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:10.597162 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425a90d-3638-4631-9fd1-2eb5d313d815 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:10.597514 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425a90d-3638-4631-9fd1-2eb5d313d815 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:10.599281 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 235/475] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:10.605783 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc15a33-1260-4b6f-9678-504f2c9abeae None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:10.606427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc15a33-1260-4b6f-9678-504f2c9abeae None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:10.606887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc15a33-1260-4b6f-9678-504f2c9abeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:10.626230 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7fc15a33-1260-4b6f-9678-504f2c9abeae None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:10.627817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7fc15a33-1260-4b6f-9678-504f2c9abeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:10.711935 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 236/476] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:57:10.736876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf75ef-f7a6-4a9c-aa04-a6522876e106 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:10.743469 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc15a33-1260-4b6f-9678-504f2c9abeae None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:10.800191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12187b-35b1-49cf-be9f-e943c4499d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:10.800904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12187b-35b1-49cf-be9f-e943c4499d8d None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:10.801509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12187b-35b1-49cf-be9f-e943c4499d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:10.801790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12187b-35b1-49cf-be9f-e943c4499d8d None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:10.802873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12187b-35b1-49cf-be9f-e943c4499d8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:10.804586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12187b-35b1-49cf-be9f-e943c4499d8d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:10.832875 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 241/477] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:57:10 2022] POST /identity/v3/users => generated 249 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:57:10.880667 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc15a33-1260-4b6f-9678-504f2c9abeae None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:10.925779 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c72e6-7a29-45c7-a5b2-c4eaf5aaf99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:10.926485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c72e6-7a29-45c7-a5b2-c4eaf5aaf99d None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:10.926768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c72e6-7a29-45c7-a5b2-c4eaf5aaf99d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:10.927043 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c72e6-7a29-45c7-a5b2-c4eaf5aaf99d None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:10.927854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c72e6-7a29-45c7-a5b2-c4eaf5aaf99d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:10.929275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c72e6-7a29-45c7-a5b2-c4eaf5aaf99d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:10.937358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.sql.core [None req-465c72e6-7a29-45c7-a5b2-c4eaf5aaf99d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 16:57:10.937358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 17 16:57:10.937358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [parameters: {'id': '82a0e0ec90b9488396e5c8b448bf682a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 17 16:57:10.937358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80069) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 16:57:10.955785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-465c72e6-7a29-45c7-a5b2-c4eaf5aaf99d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 17 16:57:10.955785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:10.955785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 16:57:10.955785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 16:57:10.955785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 16:57:10.955785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 16:57:10.955785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 16:57:10.955785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result = self._query(query) May 17 16:57:10.955785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 16:57:10.955785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application conn.query(q) May 17 16:57:10.955785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 16:57:10.955785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 16:57:10.955785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 16:57:10.955785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result.read() May 17 16:57:10.955785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return ref.to_dict() May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 16:57:10.956689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application next(self.gen) May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application yield resource May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application next(self.gen) May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.session.rollback() May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.force_reraise() May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise self.value May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application session.commit() May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 16:57:10.957565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._prepare_impl() May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.session.flush() May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._flush(objects) May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application compat.raise_( May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application flush_context.execute() May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rec.execute(self) May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 16:57:10.958415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application c = connection._execute_20( May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 16:57:10.959232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result = self._query(query) May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application conn.query(q) May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result.read() May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 16:57:10.960239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [parameters: {'id': '82a0e0ec90b9488396e5c8b448bf682a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:10.962530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 17 16:57:10.964312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:10.966832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 237/478] 10.222.0.48 () {60 vars in 1131 bytes} [Tue May 17 16:57:10 2022] POST /identity/v3/roles => generated 144 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:10.967075 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12187b-35b1-49cf-be9f-e943c4499d8d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:11.098700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12187b-35b1-49cf-be9f-e943c4499d8d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:11.139133 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681b67d-3a8b-4c12-bfc0-7380eb4f7911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:11.140384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681b67d-3a8b-4c12-bfc0-7380eb4f7911 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:11.140889 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681b67d-3a8b-4c12-bfc0-7380eb4f7911 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:11.141375 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681b67d-3a8b-4c12-bfc0-7380eb4f7911 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:11.153026 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681b67d-3a8b-4c12-bfc0-7380eb4f7911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-c681b67d-3a8b-4c12-bfc0-7380eb4f7911 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:11.161528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:11.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:11.163215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:11.163215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:11.163215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:11.163215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:11.163215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:11.163215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:11.163215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:11.163215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:11.163215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:11.163215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:11.163215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 16:57:11.163215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:11.166025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 242/479] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:57:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:11.171593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c72e6-7a29-45c7-a5b2-c4eaf5aaf99d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:11.276986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c72e6-7a29-45c7-a5b2-c4eaf5aaf99d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:11.312341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a688d-281a-4715-b60b-9c54d8152b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:11.314050 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a688d-281a-4715-b60b-9c54d8152b91 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:11.314542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a688d-281a-4715-b60b-9c54d8152b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:11.315029 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a688d-281a-4715-b60b-9c54d8152b91 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:11.315988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a688d-281a-4715-b60b-9c54d8152b91 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:11.316487 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a688d-281a-4715-b60b-9c54d8152b91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:11.318040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a688d-281a-4715-b60b-9c54d8152b91 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:11.327409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 238/480] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:12.941786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18fc5b-4110-4465-b9cf-6f5f98da3578 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:12.942309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18fc5b-4110-4465-b9cf-6f5f98da3578 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:12.942309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18fc5b-4110-4465-b9cf-6f5f98da3578 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:12.943993 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 243/481] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:12.949671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c7e9d-aaac-4aae-a635-22ee61437dac None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:12.950237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c7e9d-aaac-4aae-a635-22ee61437dac None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:12.950237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c7e9d-aaac-4aae-a635-22ee61437dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:12.976641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4a4c7e9d-aaac-4aae-a635-22ee61437dac None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:12.977825 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4a4c7e9d-aaac-4aae-a635-22ee61437dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:13.029111 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916bd73-011d-46c5-83bd-610edd36651b None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:13.029769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916bd73-011d-46c5-83bd-610edd36651b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:13.030256 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916bd73-011d-46c5-83bd-610edd36651b None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:13.032070 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 244/482] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:13.037636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607e214-c9a1-409b-a1f1-ca3a3685546c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:13.038190 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607e214-c9a1-409b-a1f1-ca3a3685546c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:13.038695 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607e214-c9a1-409b-a1f1-ca3a3685546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:13.058161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e607e214-c9a1-409b-a1f1-ca3a3685546c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:13.060570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e607e214-c9a1-409b-a1f1-ca3a3685546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:13.079637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 239/483] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:13.122764 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c7e9d-aaac-4aae-a635-22ee61437dac None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:13.149783 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 245/484] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:57:13.174964 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607e214-c9a1-409b-a1f1-ca3a3685546c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:13.286237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607e214-c9a1-409b-a1f1-ca3a3685546c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:13.325240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355e2d4-ba76-47c0-9b24-04ebe9c98b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:13.326616 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355e2d4-ba76-47c0-9b24-04ebe9c98b6d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:13.326904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355e2d4-ba76-47c0-9b24-04ebe9c98b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:13.327180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355e2d4-ba76-47c0-9b24-04ebe9c98b6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:13.329075 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c7e9d-aaac-4aae-a635-22ee61437dac None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:13.338759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355e2d4-ba76-47c0-9b24-04ebe9c98b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-6355e2d4-ba76-47c0-9b24-04ebe9c98b6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:13.348809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:13.349676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:13.350478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:13.350478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:13.350478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:13.350478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:13.350478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:13.350478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:13.350478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:13.350478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:13.350478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:13.350478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:13.350478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:13.350478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:13.350478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 246/485] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:13.351664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bea42-baa2-4eef-a963-04ec3cb348a7 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:13.351852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bea42-baa2-4eef-a963-04ec3cb348a7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:13.352093 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bea42-baa2-4eef-a963-04ec3cb348a7 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:13.353462 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 247/486] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:13.360049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1bf03-465b-41e9-a894-75dd8ca2330a None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:13.360330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1bf03-465b-41e9-a894-75dd8ca2330a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:13.360602 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1bf03-465b-41e9-a894-75dd8ca2330a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:13.379391 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670f92f-031e-431b-9632-c144abccdddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:13.380627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670f92f-031e-431b-9632-c144abccdddb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:13.380735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-08d1bf03-465b-41e9-a894-75dd8ca2330a None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:13.381246 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670f92f-031e-431b-9632-c144abccdddb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:13.381735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670f92f-031e-431b-9632-c144abccdddb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:13.381839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-08d1bf03-465b-41e9-a894-75dd8ca2330a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:13.396148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670f92f-031e-431b-9632-c144abccdddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6670f92f-031e-431b-9632-c144abccdddb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:13.407383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:13.408315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:13.409110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:13.409110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:13.409110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:13.409110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:13.409110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:13.409110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:13.409110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:13.409110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:13.409110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:13.409110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:13.409110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:13.409110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:13.415777 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 240/487] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:13.417897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670f92f-031e-431b-9632-c144abccdddb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:13.473608 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 248/488] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:13.473608 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1bf03-465b-41e9-a894-75dd8ca2330a None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:13.536150 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670f92f-031e-431b-9632-c144abccdddb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:13.569829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bdf26-fc79-494a-9768-b07e1dcb6ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:13.570547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bdf26-fc79-494a-9768-b07e1dcb6ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:13.570832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bdf26-fc79-494a-9768-b07e1dcb6ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:13.571104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bdf26-fc79-494a-9768-b07e1dcb6ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:13.571881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bdf26-fc79-494a-9768-b07e1dcb6ad8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:13.572187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bdf26-fc79-494a-9768-b07e1dcb6ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:13.573577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bdf26-fc79-494a-9768-b07e1dcb6ad8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:13.586524 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 241/489] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:13.587175 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bdf26-fc79-494a-9768-b07e1dcb6ad8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:13.599013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1bf03-465b-41e9-a894-75dd8ca2330a None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:13.640121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e22a7-0d3d-4314-ba72-255ea773fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:13.640908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e22a7-0d3d-4314-ba72-255ea773fba7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:13.641240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e22a7-0d3d-4314-ba72-255ea773fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:13.641518 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e22a7-0d3d-4314-ba72-255ea773fba7 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:13.643177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e22a7-0d3d-4314-ba72-255ea773fba7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:13.643489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e22a7-0d3d-4314-ba72-255ea773fba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:13.645009 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e22a7-0d3d-4314-ba72-255ea773fba7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:13.653382 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 249/490] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:13.654207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e22a7-0d3d-4314-ba72-255ea773fba7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:13.717157 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bdf26-fc79-494a-9768-b07e1dcb6ad8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:13.755415 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e22a7-0d3d-4314-ba72-255ea773fba7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:13.760263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd3df7-9b0c-44cc-824d-4d70216a8a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:13.761300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd3df7-9b0c-44cc-824d-4d70216a8a9d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:13.762289 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd3df7-9b0c-44cc-824d-4d70216a8a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:13.762747 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd3df7-9b0c-44cc-824d-4d70216a8a9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:13.776372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd3df7-9b0c-44cc-824d-4d70216a8a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a3dd3df7-9b0c-44cc-824d-4d70216a8a9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:13.787232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:13.788158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:13.788946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:13.788946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:13.788946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:13.788946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:13.788946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:13.788946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:13.788946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:13.788946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:13.788946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:13.788946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:13.788946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:13.788946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:13.796554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 242/491] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:13.796554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd3df7-9b0c-44cc-824d-4d70216a8a9d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:13.797205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54195ed2-15d3-4dee-942e-66f6353af72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:13.797999 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54195ed2-15d3-4dee-942e-66f6353af72a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:13.798279 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54195ed2-15d3-4dee-942e-66f6353af72a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:13.798985 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54195ed2-15d3-4dee-942e-66f6353af72a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:13.811011 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54195ed2-15d3-4dee-942e-66f6353af72a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:13.812568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54195ed2-15d3-4dee-942e-66f6353af72a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:13.831060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-54195ed2-15d3-4dee-942e-66f6353af72a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:13.831060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:13.831060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:13.831060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:13.831060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:13.831060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:13.831060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:13.831060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:13.831060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:13.831060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:13.831060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:13.831060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:13.831060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:13.831060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:13.831060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:13.831934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:13.832821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:13.832821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:13.832821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:13.832821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:13.836949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 250/492] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:13.837640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54195ed2-15d3-4dee-942e-66f6353af72a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:13.941394 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd3df7-9b0c-44cc-824d-4d70216a8a9d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:13.954010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54195ed2-15d3-4dee-942e-66f6353af72a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:13.977452 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d2a18-0aa7-42e8-a81b-3db5808abbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:13.978815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d2a18-0aa7-42e8-a81b-3db5808abbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:13.979345 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d2a18-0aa7-42e8-a81b-3db5808abbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:13.979788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d2a18-0aa7-42e8-a81b-3db5808abbb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:13.988568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cfbc9-f0d1-4fcb-83df-ce866f3ce3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:13.989317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cfbc9-f0d1-4fcb-83df-ce866f3ce3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:13.989667 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cfbc9-f0d1-4fcb-83df-ce866f3ce3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:13.990013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cfbc9-f0d1-4fcb-83df-ce866f3ce3b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:13.990888 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cfbc9-f0d1-4fcb-83df-ce866f3ce3b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:13.991201 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cfbc9-f0d1-4fcb-83df-ce866f3ce3b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:13.992680 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cfbc9-f0d1-4fcb-83df-ce866f3ce3b9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:13.993404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d2a18-0aa7-42e8-a81b-3db5808abbb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:13.995038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d2a18-0aa7-42e8-a81b-3db5808abbb2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:14.006602 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 251/493] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:14.006602 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cfbc9-f0d1-4fcb-83df-ce866f3ce3b9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:14.019125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-897d2a18-0aa7-42e8-a81b-3db5808abbb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:14.019125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:14.019125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:14.019125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:14.019125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:14.019125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:14.019125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:14.019125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:14.019125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:14.019125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:14.019125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:14.019125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:14.019125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:14.019125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:14.019125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:14.020048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:14.020895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:14.020895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:14.020895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:14.020895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:14.022861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 243/494] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:14.023959 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d2a18-0aa7-42e8-a81b-3db5808abbb2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:14.109778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cfbc9-f0d1-4fcb-83df-ce866f3ce3b9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:14.129171 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d2a18-0aa7-42e8-a81b-3db5808abbb2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:14.143012 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084df629-a56d-4ad2-ae8b-2ac9601142a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:14.143703 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df629-a56d-4ad2-ae8b-2ac9601142a1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:14.143990 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df629-a56d-4ad2-ae8b-2ac9601142a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:14.144266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df629-a56d-4ad2-ae8b-2ac9601142a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:14.144979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084df629-a56d-4ad2-ae8b-2ac9601142a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:14.145285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084df629-a56d-4ad2-ae8b-2ac9601142a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:14.146660 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084df629-a56d-4ad2-ae8b-2ac9601142a1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:14.157975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 252/495] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:14.159456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084df629-a56d-4ad2-ae8b-2ac9601142a1 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:14.161491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c3b8f-382c-432f-99a2-d35d1f2d4869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:14.162281 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c3b8f-382c-432f-99a2-d35d1f2d4869 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:14.162557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c3b8f-382c-432f-99a2-d35d1f2d4869 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:14.162828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c3b8f-382c-432f-99a2-d35d1f2d4869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:14.173376 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c3b8f-382c-432f-99a2-d35d1f2d4869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:14.174819 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c3b8f-382c-432f-99a2-d35d1f2d4869 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:14.191843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-403c3b8f-382c-432f-99a2-d35d1f2d4869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:14.191843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:14.191843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:14.191843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:14.191843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:14.191843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:14.191843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:14.191843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:14.191843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:14.191843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:14.191843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:14.191843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:14.191843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:14.191843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:14.191843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:14.192686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:14.193516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:14.193516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:14.193516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:14.193516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:14.193516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 244/496] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:14.194275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3380ae-31e7-4a6e-8b26-48adec160eaa None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:14.194435 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3380ae-31e7-4a6e-8b26-48adec160eaa None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:14.194698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3380ae-31e7-4a6e-8b26-48adec160eaa None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:14.198072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 245/497] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:14.198072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfbd1e-49bc-4f3a-830c-b418b949de3b None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:14.198072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfbd1e-49bc-4f3a-830c-b418b949de3b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:14.198072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfbd1e-49bc-4f3a-830c-b418b949de3b None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:14.198815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 246/498] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:14.200818 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfbd1e-49bc-4f3a-830c-b418b949de3b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:14.256518 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084df629-a56d-4ad2-ae8b-2ac9601142a1 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:14.288539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407b4b5-31a7-417e-a1e6-c938129e85db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:14.289187 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407b4b5-31a7-417e-a1e6-c938129e85db None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:14.289462 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407b4b5-31a7-417e-a1e6-c938129e85db None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:14.289732 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407b4b5-31a7-417e-a1e6-c938129e85db None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:14.290435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407b4b5-31a7-417e-a1e6-c938129e85db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:14.290734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407b4b5-31a7-417e-a1e6-c938129e85db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:14.292117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407b4b5-31a7-417e-a1e6-c938129e85db None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:14.298921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfbd1e-49bc-4f3a-830c-b418b949de3b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:14.303240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 253/499] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:14.304042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407b4b5-31a7-417e-a1e6-c938129e85db None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:14.332337 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bbddf-6d01-411b-883d-42ba31c8a1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:14.333129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bbddf-6d01-411b-883d-42ba31c8a1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:14.333413 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bbddf-6d01-411b-883d-42ba31c8a1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:14.333690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bbddf-6d01-411b-883d-42ba31c8a1a2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:14.341244 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bbddf-6d01-411b-883d-42ba31c8a1a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:14.342807 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bbddf-6d01-411b-883d-42ba31c8a1a2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-4d2bbddf-6d01-411b-883d-42ba31c8a1a2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:14.358547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:14.359436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:14.365190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:14.365190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:14.365190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:14.365190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:14.365190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:14.365190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:14.365190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:14.365190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:14.365190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 16:57:14.365190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:14.365190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 247/500] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:14.365190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d04e6c-e7a9-4410-85bb-b9b2ce0e7fd0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:14.365190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d04e6c-e7a9-4410-85bb-b9b2ce0e7fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:14.365858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d04e6c-e7a9-4410-85bb-b9b2ce0e7fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:14.377518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-08d04e6c-e7a9-4410-85bb-b9b2ce0e7fd0 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:14.378687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-08d04e6c-e7a9-4410-85bb-b9b2ce0e7fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:14.400916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407b4b5-31a7-417e-a1e6-c938129e85db None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:14.432280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d9e55-1342-4928-a217-e7966cc8d482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:14.432925 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9e55-1342-4928-a217-e7966cc8d482 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:14.433207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9e55-1342-4928-a217-e7966cc8d482 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:14.433566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9e55-1342-4928-a217-e7966cc8d482 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:14.434289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d9e55-1342-4928-a217-e7966cc8d482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:14.434590 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d9e55-1342-4928-a217-e7966cc8d482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:14.435968 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d9e55-1342-4928-a217-e7966cc8d482 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:14.440944 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 248/501] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:14.442306 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a16517-e1f7-438c-9549-cb0e7d0e4bfb None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:14.442598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a16517-e1f7-438c-9549-cb0e7d0e4bfb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:14.442868 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a16517-e1f7-438c-9549-cb0e7d0e4bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:14.458886 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f8a16517-e1f7-438c-9549-cb0e7d0e4bfb None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:14.460061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f8a16517-e1f7-438c-9549-cb0e7d0e4bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:14.466290 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 254/502] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:14.466290 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d9e55-1342-4928-a217-e7966cc8d482 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:14.522789 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 249/503] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:14.523634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a16517-e1f7-438c-9549-cb0e7d0e4bfb None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:14.567088 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d9e55-1342-4928-a217-e7966cc8d482 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:14.599228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4ffa0-99ec-441e-ac4f-984245e7d9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:14.599974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4ffa0-99ec-441e-ac4f-984245e7d9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:14.600259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4ffa0-99ec-441e-ac4f-984245e7d9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:14.600527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4ffa0-99ec-441e-ac4f-984245e7d9e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:14.607262 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4ffa0-99ec-441e-ac4f-984245e7d9e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:14.608719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4ffa0-99ec-441e-ac4f-984245e7d9e5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:14.616950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a16517-e1f7-438c-9549-cb0e7d0e4bfb None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-5ce4ffa0-99ec-441e-ac4f-984245e7d9e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:14.623858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:14.624845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:14.625730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:14.625730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:14.625730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:14.625730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:14.625730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:14.625730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:14.625730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:14.625730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:14.625730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 16:57:14.625730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:14.625730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 255/504] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 16:57:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:14.626269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4ffa0-99ec-441e-ac4f-984245e7d9e5 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:14.653230 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a6f5a-d62e-41c0-be54-d6b4821ecdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:14.653897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a6f5a-d62e-41c0-be54-d6b4821ecdcf None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:14.654174 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a6f5a-d62e-41c0-be54-d6b4821ecdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:14.654445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a6f5a-d62e-41c0-be54-d6b4821ecdcf None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:14.655266 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a6f5a-d62e-41c0-be54-d6b4821ecdcf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:14.655570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a6f5a-d62e-41c0-be54-d6b4821ecdcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:14.657035 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a6f5a-d62e-41c0-be54-d6b4821ecdcf None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:14.692892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 250/505] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 17 16:57:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:14.693793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a6f5a-d62e-41c0-be54-d6b4821ecdcf None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:14.719908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4ffa0-99ec-441e-ac4f-984245e7d9e5 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:14.751769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279146f2-cf2c-4786-b711-43872349104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:14.752554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279146f2-cf2c-4786-b711-43872349104a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:14.752834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279146f2-cf2c-4786-b711-43872349104a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:14.753108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279146f2-cf2c-4786-b711-43872349104a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:14.763475 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279146f2-cf2c-4786-b711-43872349104a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-279146f2-cf2c-4786-b711-43872349104a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:14.771186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:14.772171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:14.772937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:14.772937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:14.772937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:14.772937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:14.772937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:14.772937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:14.772937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:14.772937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:14.772937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:14.772937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:14.772937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:14.772937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:14.772937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 256/506] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:14.773580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279146f2-cf2c-4786-b711-43872349104a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:14.795704 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a6f5a-d62e-41c0-be54-d6b4821ecdcf None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:14.828081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6728e-bfd9-408e-b6bf-2ac01fbaad7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:14.828875 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6728e-bfd9-408e-b6bf-2ac01fbaad7b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:14.829163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6728e-bfd9-408e-b6bf-2ac01fbaad7b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:14.829437 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6728e-bfd9-408e-b6bf-2ac01fbaad7b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:14.836620 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6728e-bfd9-408e-b6bf-2ac01fbaad7b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:14.838240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6728e-bfd9-408e-b6bf-2ac01fbaad7b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a6b6728e-bfd9-408e-b6bf-2ac01fbaad7b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:14.852670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:14.853721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:14.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:14.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:14.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:14.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:14.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:14.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:14.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:14.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:14.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 16:57:14.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:14.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 251/507] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:14.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6728e-bfd9-408e-b6bf-2ac01fbaad7b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:14.873924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279146f2-cf2c-4786-b711-43872349104a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:14.905007 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55227a-9b2c-4648-91f2-2b855e020ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:14.905791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55227a-9b2c-4648-91f2-2b855e020ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:14.906064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55227a-9b2c-4648-91f2-2b855e020ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:14.906334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55227a-9b2c-4648-91f2-2b855e020ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:14.916134 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55227a-9b2c-4648-91f2-2b855e020ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:14.917562 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55227a-9b2c-4648-91f2-2b855e020ed7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:14.934168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-8f55227a-9b2c-4648-91f2-2b855e020ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:14.934168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:14.934168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:14.934168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:14.934168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:14.934168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:14.934168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:14.934168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:14.934168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:14.934168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:14.934168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:14.934168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:14.934168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:14.934168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:14.934168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:14.935225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:14.936649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:14.936649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:14.936649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:14.936649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:14.936649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 257/508] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:14.936649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55227a-9b2c-4648-91f2-2b855e020ed7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:14.954154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6728e-bfd9-408e-b6bf-2ac01fbaad7b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:14.985194 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8826e-d3dc-4908-84b2-95e588fca32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:14.985846 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8826e-d3dc-4908-84b2-95e588fca32a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:14.986126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8826e-d3dc-4908-84b2-95e588fca32a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:14.986559 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8826e-d3dc-4908-84b2-95e588fca32a None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:14.988076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8826e-d3dc-4908-84b2-95e588fca32a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:14.988627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8826e-d3dc-4908-84b2-95e588fca32a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:14.991308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8826e-d3dc-4908-84b2-95e588fca32a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:15.010530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 252/509] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 16:57:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:15.011331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8826e-d3dc-4908-84b2-95e588fca32a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:15.030015 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55227a-9b2c-4648-91f2-2b855e020ed7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:15.062574 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e7da9-e686-4b54-99ac-f8bc3a674c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:15.063227 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e7da9-e686-4b54-99ac-f8bc3a674c7f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:15.063833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e7da9-e686-4b54-99ac-f8bc3a674c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:15.064108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e7da9-e686-4b54-99ac-f8bc3a674c7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:15.110700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8826e-d3dc-4908-84b2-95e588fca32a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:15.128453 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e7da9-e686-4b54-99ac-f8bc3a674c7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:15.129975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e7da9-e686-4b54-99ac-f8bc3a674c7f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:15.144298 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0b054-77ea-46d1-a93f-54b89553b939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:15.144963 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0b054-77ea-46d1-a93f-54b89553b939 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:15.145240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0b054-77ea-46d1-a93f-54b89553b939 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:15.145511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0b054-77ea-46d1-a93f-54b89553b939 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:15.146246 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0b054-77ea-46d1-a93f-54b89553b939 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:15.146546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0b054-77ea-46d1-a93f-54b89553b939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:15.147935 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0b054-77ea-46d1-a93f-54b89553b939 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:15.160133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 253/510] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:15.160133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0b054-77ea-46d1-a93f-54b89553b939 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:15.222016 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 258/511] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:15.222841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e7da9-e686-4b54-99ac-f8bc3a674c7f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:15.254032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0b054-77ea-46d1-a93f-54b89553b939 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:15.288327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64aea0c-a99b-4374-ab5c-acb2f6cc55a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:15.288996 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64aea0c-a99b-4374-ab5c-acb2f6cc55a8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:15.289273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64aea0c-a99b-4374-ab5c-acb2f6cc55a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:15.289545 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64aea0c-a99b-4374-ab5c-acb2f6cc55a8 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:15.290362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64aea0c-a99b-4374-ab5c-acb2f6cc55a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:15.290666 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64aea0c-a99b-4374-ab5c-acb2f6cc55a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:15.292127 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64aea0c-a99b-4374-ab5c-acb2f6cc55a8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:15.313017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 254/512] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 17 16:57:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:15.313017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64aea0c-a99b-4374-ab5c-acb2f6cc55a8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:15.319759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e7da9-e686-4b54-99ac-f8bc3a674c7f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:15.352137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ffde0-e8b1-4c53-a24e-d32fe59f55e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:15.352782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ffde0-e8b1-4c53-a24e-d32fe59f55e0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:15.353065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ffde0-e8b1-4c53-a24e-d32fe59f55e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:15.353338 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ffde0-e8b1-4c53-a24e-d32fe59f55e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:15.354043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ffde0-e8b1-4c53-a24e-d32fe59f55e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:15.354342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ffde0-e8b1-4c53-a24e-d32fe59f55e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:15.355764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ffde0-e8b1-4c53-a24e-d32fe59f55e0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:15.366428 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 259/513] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:15.367135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ffde0-e8b1-4c53-a24e-d32fe59f55e0 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:15.407549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64aea0c-a99b-4374-ab5c-acb2f6cc55a8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:15.440626 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbbf01-ee71-447e-a65b-6d4187e99013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:15.441267 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbbf01-ee71-447e-a65b-6d4187e99013 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:15.441543 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbbf01-ee71-447e-a65b-6d4187e99013 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:15.441812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbbf01-ee71-447e-a65b-6d4187e99013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:15.462266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ffde0-e8b1-4c53-a24e-d32fe59f55e0 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:15.494284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255c0df-f944-49b9-8aa6-ee55f704696b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:15.495070 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c0df-f944-49b9-8aa6-ee55f704696b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:15.495350 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c0df-f944-49b9-8aa6-ee55f704696b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:15.495649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c0df-f944-49b9-8aa6-ee55f704696b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:15.506787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255c0df-f944-49b9-8aa6-ee55f704696b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:15.508281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255c0df-f944-49b9-8aa6-ee55f704696b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:15.509091 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbbf01-ee71-447e-a65b-6d4187e99013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:15.510538 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbbf01-ee71-447e-a65b-6d4187e99013 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:15.525322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-2255c0df-f944-49b9-8aa6-ee55f704696b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:15.525322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:15.525322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:15.525322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:15.525322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:15.525322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:15.525322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:15.525322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:15.525322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:15.525322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:15.525322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:15.525322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:15.525322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:15.525322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:15.525322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:15.526349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:15.527499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:15.527499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:15.527499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:15.527499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:15.527499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 260/514] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:15.527499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255c0df-f944-49b9-8aa6-ee55f704696b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:15.602420 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 255/515] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:15.603251 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbbf01-ee71-447e-a65b-6d4187e99013 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:15.620676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255c0df-f944-49b9-8aa6-ee55f704696b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:15.653239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8d6a5-fa2c-44d6-bae6-7e5560e69552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:15.654015 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8d6a5-fa2c-44d6-bae6-7e5560e69552 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:15.654298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8d6a5-fa2c-44d6-bae6-7e5560e69552 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:15.654576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8d6a5-fa2c-44d6-bae6-7e5560e69552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:15.664445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8d6a5-fa2c-44d6-bae6-7e5560e69552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:15.665872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8d6a5-fa2c-44d6-bae6-7e5560e69552 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:15.682091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-bfe8d6a5-fa2c-44d6-bae6-7e5560e69552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:15.682091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:15.682091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:15.682091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:15.682091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:15.682091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:15.682091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:15.682091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:15.682091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:15.682091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:15.682091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:15.682091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:15.682091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:15.682091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:15.682091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:15.682980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:15.684916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:15.684916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:15.684916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:15.684916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:15.684916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 261/516] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:15.684916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8d6a5-fa2c-44d6-bae6-7e5560e69552 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:15.700011 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbbf01-ee71-447e-a65b-6d4187e99013 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:15.731409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab35dc3-bcae-4194-82f1-0b596e9070ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:15.732087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab35dc3-bcae-4194-82f1-0b596e9070ba None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:15.732364 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab35dc3-bcae-4194-82f1-0b596e9070ba None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:15.732634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab35dc3-bcae-4194-82f1-0b596e9070ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:15.779085 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8d6a5-fa2c-44d6-bae6-7e5560e69552 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:15.797582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab35dc3-bcae-4194-82f1-0b596e9070ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:15.799030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab35dc3-bcae-4194-82f1-0b596e9070ba None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:15.811128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f80c0-728a-4c29-940b-9eb43691bd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:15.811819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f80c0-728a-4c29-940b-9eb43691bd5a None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:15.812104 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f80c0-728a-4c29-940b-9eb43691bd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:15.812383 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f80c0-728a-4c29-940b-9eb43691bd5a None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:15.813078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f80c0-728a-4c29-940b-9eb43691bd5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:15.814760 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f80c0-728a-4c29-940b-9eb43691bd5a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:15.833217 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 262/517] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:57:15 2022] POST /identity/v3/users => generated 247 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:57:15.834023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f80c0-728a-4c29-940b-9eb43691bd5a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:15.902458 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 256/518] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:15.903730 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab35dc3-bcae-4194-82f1-0b596e9070ba None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:15.940664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f80c0-728a-4c29-940b-9eb43691bd5a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:15.975161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e629c-1ee7-4cdc-8c1a-4add0593e1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:15.976255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e629c-1ee7-4cdc-8c1a-4add0593e1ec None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:15.976768 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e629c-1ee7-4cdc-8c1a-4add0593e1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:15.977238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e629c-1ee7-4cdc-8c1a-4add0593e1ec None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:15.977975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e629c-1ee7-4cdc-8c1a-4add0593e1ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:15.978283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e629c-1ee7-4cdc-8c1a-4add0593e1ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:15.979773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e629c-1ee7-4cdc-8c1a-4add0593e1ec None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:15.992872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 263/519] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:15.994091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e629c-1ee7-4cdc-8c1a-4add0593e1ec None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:16.008287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab35dc3-bcae-4194-82f1-0b596e9070ba None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:16.045121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50434ee6-32d6-4c9c-9128-78b04342069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:16.046533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50434ee6-32d6-4c9c-9128-78b04342069c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:16.046533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50434ee6-32d6-4c9c-9128-78b04342069c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:16.046533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50434ee6-32d6-4c9c-9128-78b04342069c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:16.057820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50434ee6-32d6-4c9c-9128-78b04342069c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:16.060131 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50434ee6-32d6-4c9c-9128-78b04342069c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:16.079960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-50434ee6-32d6-4c9c-9128-78b04342069c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:16.079960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:16.079960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:16.079960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:16.079960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:16.079960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:16.079960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:16.079960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:16.079960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:16.079960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:16.079960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:16.079960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:16.079960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:16.079960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:16.079960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:16.080854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:16.081690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:16.081690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:16.081690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:16.081690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:16.081690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 257/520] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:16.082541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50434ee6-32d6-4c9c-9128-78b04342069c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:16.100263 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e629c-1ee7-4cdc-8c1a-4add0593e1ec None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:16.137878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8d14e-3631-4e4e-a8b9-c7f904ea5532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:16.138591 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d14e-3631-4e4e-a8b9-c7f904ea5532 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:16.138873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d14e-3631-4e4e-a8b9-c7f904ea5532 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:16.139140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d14e-3631-4e4e-a8b9-c7f904ea5532 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:16.139952 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8d14e-3631-4e4e-a8b9-c7f904ea5532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:16.140255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8d14e-3631-4e4e-a8b9-c7f904ea5532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:16.141633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8d14e-3631-4e4e-a8b9-c7f904ea5532 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:16.153622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 264/521] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:16.154368 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8d14e-3631-4e4e-a8b9-c7f904ea5532 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:16.189872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50434ee6-32d6-4c9c-9128-78b04342069c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:16.222897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbb54b-6081-4507-aa65-31a8a3acc6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:16.223723 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbb54b-6081-4507-aa65-31a8a3acc6bb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:16.223998 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbb54b-6081-4507-aa65-31a8a3acc6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:16.224267 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbb54b-6081-4507-aa65-31a8a3acc6bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:16.235024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbb54b-6081-4507-aa65-31a8a3acc6bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:16.236943 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbb54b-6081-4507-aa65-31a8a3acc6bb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:16.254555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8d14e-3631-4e4e-a8b9-c7f904ea5532 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:16.254916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-cfcbb54b-6081-4507-aa65-31a8a3acc6bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:16.254916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:16.254916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:16.254916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:16.254916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:16.254916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:16.254916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:16.254916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:16.254916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:16.254916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:16.254916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:16.254916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:16.254916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:16.254916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:16.254916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:16.255760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:16.256582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:16.256582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:16.256582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:16.256582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:16.256582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 258/522] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:16.257390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbb54b-6081-4507-aa65-31a8a3acc6bb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:16.292284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9102e9-c846-4e40-9433-92cb9eff4d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:16.293631 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9102e9-c846-4e40-9433-92cb9eff4d00 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:16.293912 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9102e9-c846-4e40-9433-92cb9eff4d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:16.294187 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9102e9-c846-4e40-9433-92cb9eff4d00 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:16.301582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9102e9-c846-4e40-9433-92cb9eff4d00 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:16.303039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9102e9-c846-4e40-9433-92cb9eff4d00 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-4f9102e9-c846-4e40-9433-92cb9eff4d00 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:16.317272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:16.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:16.319060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:16.319060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:16.319060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:16.319060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:16.319060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:16.319060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:16.319060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:16.319060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:16.319060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 16:57:16.319060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:16.319060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 265/523] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:16.319625 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9102e9-c846-4e40-9433-92cb9eff4d00 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:16.362554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbb54b-6081-4507-aa65-31a8a3acc6bb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:16.395939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f871e99-0ebf-4990-ad49-7ff0e5ab0ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:16.397817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f871e99-0ebf-4990-ad49-7ff0e5ab0ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:16.397817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f871e99-0ebf-4990-ad49-7ff0e5ab0ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:16.397817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f871e99-0ebf-4990-ad49-7ff0e5ab0ee2 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:16.397817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f871e99-0ebf-4990-ad49-7ff0e5ab0ee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:16.398119 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f871e99-0ebf-4990-ad49-7ff0e5ab0ee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:16.399525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f871e99-0ebf-4990-ad49-7ff0e5ab0ee2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:16.416048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 259/524] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:16.417536 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f871e99-0ebf-4990-ad49-7ff0e5ab0ee2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:16.427687 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9102e9-c846-4e40-9433-92cb9eff4d00 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:16.461438 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c572ca-8bf9-43bd-9a84-ec3e3a42b3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:16.462475 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c572ca-8bf9-43bd-9a84-ec3e3a42b3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:16.462748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c572ca-8bf9-43bd-9a84-ec3e3a42b3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:16.463028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c572ca-8bf9-43bd-9a84-ec3e3a42b3e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:16.470289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c572ca-8bf9-43bd-9a84-ec3e3a42b3e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:16.471765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c572ca-8bf9-43bd-9a84-ec3e3a42b3e2 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:16.486678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-62c572ca-8bf9-43bd-9a84-ec3e3a42b3e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:16.486678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:16.486678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:16.486678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:16.486678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:16.486678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:16.486678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:16.486678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:16.486678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:16.486678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:16.486678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:16.486678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:16.486678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:16.486678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:16.486678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:16.487556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:16.488451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:16.488451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:16.488451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:16.488451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:16.488451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:16.488451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:16.488451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:16.488451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:16.488451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 266/525] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:16.488936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c572ca-8bf9-43bd-9a84-ec3e3a42b3e2 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:16.525586 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f871e99-0ebf-4990-ad49-7ff0e5ab0ee2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:16.560151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fc057-8928-4e47-88b3-e1bdedf2b460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:16.560811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fc057-8928-4e47-88b3-e1bdedf2b460 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:16.561091 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fc057-8928-4e47-88b3-e1bdedf2b460 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:16.561362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fc057-8928-4e47-88b3-e1bdedf2b460 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:16.562076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fc057-8928-4e47-88b3-e1bdedf2b460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:16.562380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fc057-8928-4e47-88b3-e1bdedf2b460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:16.564025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fc057-8928-4e47-88b3-e1bdedf2b460 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:16.576134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 260/526] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:16.576974 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fc057-8928-4e47-88b3-e1bdedf2b460 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:16.589074 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c572ca-8bf9-43bd-9a84-ec3e3a42b3e2 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:16.623101 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b783fa-0edb-451c-9b01-4cc81a7213e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:16.623806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b783fa-0edb-451c-9b01-4cc81a7213e4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:16.624083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b783fa-0edb-451c-9b01-4cc81a7213e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:16.624355 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b783fa-0edb-451c-9b01-4cc81a7213e4 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:16.625176 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b783fa-0edb-451c-9b01-4cc81a7213e4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:16.625481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b783fa-0edb-451c-9b01-4cc81a7213e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:16.626892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b783fa-0edb-451c-9b01-4cc81a7213e4 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:16.663978 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 267/527] 10.222.0.48 () {56 vars in 1139 bytes} [Tue May 17 16:57:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:16.669778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b783fa-0edb-451c-9b01-4cc81a7213e4 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:16.675962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fc057-8928-4e47-88b3-e1bdedf2b460 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:16.711167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b201352-1666-4ba9-96b3-03f61eaf2753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:16.712549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b201352-1666-4ba9-96b3-03f61eaf2753 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:16.713026 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b201352-1666-4ba9-96b3-03f61eaf2753 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:16.713541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b201352-1666-4ba9-96b3-03f61eaf2753 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:16.721636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b201352-1666-4ba9-96b3-03f61eaf2753 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:16.723106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b201352-1666-4ba9-96b3-03f61eaf2753 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:16.738681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-1b201352-1666-4ba9-96b3-03f61eaf2753 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:16.738681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:16.738681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:16.738681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:16.738681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:16.738681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:16.738681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:16.738681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:16.738681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:16.738681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:16.738681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:16.738681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:16.738681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:16.738681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:16.738681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:16.739501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:16.740692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:16.740692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:16.740692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:16.740692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:16.740692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:16.740692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:16.740692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:16.740692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:16.744795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 261/528] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:16.745753 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b201352-1666-4ba9-96b3-03f61eaf2753 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:16.765773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b783fa-0edb-451c-9b01-4cc81a7213e4 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:16.799141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bf067-3c48-4f33-94f5-024e71ff191a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:16.799816 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf067-3c48-4f33-94f5-024e71ff191a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:16.800103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf067-3c48-4f33-94f5-024e71ff191a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:16.800382 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf067-3c48-4f33-94f5-024e71ff191a None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:16.801159 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bf067-3c48-4f33-94f5-024e71ff191a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:16.801469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bf067-3c48-4f33-94f5-024e71ff191a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:16.802898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bf067-3c48-4f33-94f5-024e71ff191a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:16.825820 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 268/529] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:16.825820 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bf067-3c48-4f33-94f5-024e71ff191a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:16.844346 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b201352-1666-4ba9-96b3-03f61eaf2753 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:16.879952 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936cf87-bfd2-4b88-b960-7d8995537e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:16.880747 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936cf87-bfd2-4b88-b960-7d8995537e23 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:16.881029 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936cf87-bfd2-4b88-b960-7d8995537e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:16.881310 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936cf87-bfd2-4b88-b960-7d8995537e23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:16.888101 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936cf87-bfd2-4b88-b960-7d8995537e23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:16.889704 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936cf87-bfd2-4b88-b960-7d8995537e23 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:16.903905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-d936cf87-bfd2-4b88-b960-7d8995537e23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:16.903905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:16.903905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:16.903905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:16.903905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:16.903905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:16.903905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:16.903905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:16.903905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:16.903905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:16.903905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:16.903905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:16.903905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:16.903905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:16.903905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:16.904923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:16.906060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:16.906060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:16.906060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:16.906060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:16.906060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:16.906060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:16.906060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:16.906060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:16.908137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 262/530] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:16.909126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936cf87-bfd2-4b88-b960-7d8995537e23 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:16.928022 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bf067-3c48-4f33-94f5-024e71ff191a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:16.962769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318705a2-d8a4-4f2e-ad78-02dc4da34c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:16.963411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318705a2-d8a4-4f2e-ad78-02dc4da34c7c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:16.963738 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318705a2-d8a4-4f2e-ad78-02dc4da34c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:16.964015 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318705a2-d8a4-4f2e-ad78-02dc4da34c7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:17.008818 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936cf87-bfd2-4b88-b960-7d8995537e23 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:17.032944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318705a2-d8a4-4f2e-ad78-02dc4da34c7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:17.034416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318705a2-d8a4-4f2e-ad78-02dc4da34c7c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:17.044555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521eea0-291a-4ef7-b169-1d929b6895dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:17.045224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521eea0-291a-4ef7-b169-1d929b6895dd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:17.045505 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521eea0-291a-4ef7-b169-1d929b6895dd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:17.045777 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521eea0-291a-4ef7-b169-1d929b6895dd None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:17.046625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521eea0-291a-4ef7-b169-1d929b6895dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:17.046939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521eea0-291a-4ef7-b169-1d929b6895dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:17.048404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521eea0-291a-4ef7-b169-1d929b6895dd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:17.071442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 263/531] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:17.071442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521eea0-291a-4ef7-b169-1d929b6895dd None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:17.133257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 269/532] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:17.134879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318705a2-d8a4-4f2e-ad78-02dc4da34c7c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:17.168662 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521eea0-291a-4ef7-b169-1d929b6895dd None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:17.202654 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3302190-9aaf-4dd7-b5a3-9164c27617e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:17.203229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3302190-9aaf-4dd7-b5a3-9164c27617e0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:17.203507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3302190-9aaf-4dd7-b5a3-9164c27617e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:17.203807 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3302190-9aaf-4dd7-b5a3-9164c27617e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:17.204649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3302190-9aaf-4dd7-b5a3-9164c27617e0 None admin] RBAC: Adding query filter params (role.id=958871a8463d49d89ddade803adb47c4, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=97e0aa0cdd8544ca9e16d1af3bff411f) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:17.204956 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3302190-9aaf-4dd7-b5a3-9164c27617e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:17.206389 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3302190-9aaf-4dd7-b5a3-9164c27617e0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:17.211714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 264/533] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:17 2022] GET /identity/v3/role_assignments?user.id=97e0aa0cdd8544ca9e16d1af3bff411f&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=958871a8463d49d89ddade803adb47c4 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:17.212489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3302190-9aaf-4dd7-b5a3-9164c27617e0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:17.247845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318705a2-d8a4-4f2e-ad78-02dc4da34c7c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:17.285794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ae009-f6b5-4ed3-ae27-ed84f2e7ad8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:17.286818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ae009-f6b5-4ed3-ae27-ed84f2e7ad8d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:17.287386 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ae009-f6b5-4ed3-ae27-ed84f2e7ad8d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:17.287878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ae009-f6b5-4ed3-ae27-ed84f2e7ad8d None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:17.288841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ae009-f6b5-4ed3-ae27-ed84f2e7ad8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:17.289325 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ae009-f6b5-4ed3-ae27-ed84f2e7ad8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:17.290945 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ae009-f6b5-4ed3-ae27-ed84f2e7ad8d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:17.304935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 270/534] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:17.306321 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ae009-f6b5-4ed3-ae27-ed84f2e7ad8d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:17.320782 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3302190-9aaf-4dd7-b5a3-9164c27617e0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:17.357043 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8518a9-a491-4395-bb21-2d41f8bd6ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:17.357704 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8518a9-a491-4395-bb21-2d41f8bd6ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:17.358375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8518a9-a491-4395-bb21-2d41f8bd6ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:17.358375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8518a9-a491-4395-bb21-2d41f8bd6ec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:17.359078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8518a9-a491-4395-bb21-2d41f8bd6ec8 None admin] RBAC: Adding query filter params (role.id=958871a8463d49d89ddade803adb47c4, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=5becb135afbd43e9bc0b1347ba04e2b5) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:17.359394 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8518a9-a491-4395-bb21-2d41f8bd6ec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:17.360914 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8518a9-a491-4395-bb21-2d41f8bd6ec8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:17.366986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 265/535] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:17 2022] GET /identity/v3/role_assignments?user.id=5becb135afbd43e9bc0b1347ba04e2b5&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=958871a8463d49d89ddade803adb47c4 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:17.367861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8518a9-a491-4395-bb21-2d41f8bd6ec8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:17.419015 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ae009-f6b5-4ed3-ae27-ed84f2e7ad8d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:17.458053 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ce10c-851d-4d1c-970a-06fe8b0e68d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:17.459186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ce10c-851d-4d1c-970a-06fe8b0e68d0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:17.459716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ce10c-851d-4d1c-970a-06fe8b0e68d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:17.460191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ce10c-851d-4d1c-970a-06fe8b0e68d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:17.472308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ce10c-851d-4d1c-970a-06fe8b0e68d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:17.473978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8518a9-a491-4395-bb21-2d41f8bd6ec8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:17.474451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ce10c-851d-4d1c-970a-06fe8b0e68d0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:17.493935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-357ce10c-851d-4d1c-970a-06fe8b0e68d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:17.493935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:17.493935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:17.493935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:17.493935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:17.493935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:17.493935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:17.493935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:17.493935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:17.493935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:17.493935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:17.493935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:17.493935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:17.493935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:17.493935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:17.494878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:17.496536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:17.496536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:17.496536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:17.496536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:17.498949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 271/536] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:17.506478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ce10c-851d-4d1c-970a-06fe8b0e68d0 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:17.524060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5b48f-f42a-461d-a102-435dbd715d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:17.524873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5b48f-f42a-461d-a102-435dbd715d3c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:17.525153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5b48f-f42a-461d-a102-435dbd715d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:17.525427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5b48f-f42a-461d-a102-435dbd715d3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:17.526270 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5b48f-f42a-461d-a102-435dbd715d3c None admin] RBAC: Adding query filter params (role.id=958871a8463d49d89ddade803adb47c4, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=b25519cdc25244a0b039ce3097c328d8) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:17.526581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5b48f-f42a-461d-a102-435dbd715d3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:17.528855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5b48f-f42a-461d-a102-435dbd715d3c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:17.535677 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 266/537] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:17 2022] GET /identity/v3/role_assignments?user.id=b25519cdc25244a0b039ce3097c328d8&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=958871a8463d49d89ddade803adb47c4 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:17.629213 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ce10c-851d-4d1c-970a-06fe8b0e68d0 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:17.666333 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab9f4e-77f8-406a-8387-245eaa892145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:17.667363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab9f4e-77f8-406a-8387-245eaa892145 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:17.667969 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab9f4e-77f8-406a-8387-245eaa892145 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:17.668471 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab9f4e-77f8-406a-8387-245eaa892145 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:17.669395 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab9f4e-77f8-406a-8387-245eaa892145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:17.669907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab9f4e-77f8-406a-8387-245eaa892145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:17.671530 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab9f4e-77f8-406a-8387-245eaa892145 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:17.685814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 272/538] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:17.691952 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5b48f-f42a-461d-a102-435dbd715d3c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:17.799636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5b48f-f42a-461d-a102-435dbd715d3c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:17.837772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbf515-abbc-44e9-bacb-53c0ff5a07fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:17.838581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbf515-abbc-44e9-bacb-53c0ff5a07fb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:17.838857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbf515-abbc-44e9-bacb-53c0ff5a07fb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:17.839128 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbf515-abbc-44e9-bacb-53c0ff5a07fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:17.847302 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbf515-abbc-44e9-bacb-53c0ff5a07fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:17.848913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbf515-abbc-44e9-bacb-53c0ff5a07fb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:17.863477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-bbbbf515-abbc-44e9-bacb-53c0ff5a07fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:17.863477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:17.863477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:17.863477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:17.863477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:17.863477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:17.863477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:17.863477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:17.863477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:17.863477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:17.863477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:17.863477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:17.863477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:17.863477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:17.863477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:17.864366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:17.865644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:17.865644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:17.865644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:17.865644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:17.865644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:17.865644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:17.865644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:17.865644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:17.865644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 267/539] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:17.870714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab9f4e-77f8-406a-8387-245eaa892145 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:17.972152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab9f4e-77f8-406a-8387-245eaa892145 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:18.008763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1a265-26af-4eae-9bd6-700bd9dc0bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:18.009441 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1a265-26af-4eae-9bd6-700bd9dc0bed None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:18.009722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1a265-26af-4eae-9bd6-700bd9dc0bed None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:18.009993 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1a265-26af-4eae-9bd6-700bd9dc0bed None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:18.010809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1a265-26af-4eae-9bd6-700bd9dc0bed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:18.011118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1a265-26af-4eae-9bd6-700bd9dc0bed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:18.013950 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1a265-26af-4eae-9bd6-700bd9dc0bed None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:18.027995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 273/540] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:18.035764 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbf515-abbc-44e9-bacb-53c0ff5a07fb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:18.167023 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbf515-abbc-44e9-bacb-53c0ff5a07fb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:18.188274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f177cf-89a0-4338-930c-812e4c5bb291 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:18.189029 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f177cf-89a0-4338-930c-812e4c5bb291 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:18.189029 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f177cf-89a0-4338-930c-812e4c5bb291 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:18.190626 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 274/541] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:18.195921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d973-f91c-444f-92b3-1e9b6eb8ea43 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:18.196265 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d973-f91c-444f-92b3-1e9b6eb8ea43 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:18.196548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d973-f91c-444f-92b3-1e9b6eb8ea43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:18.213651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0c59d973-f91c-444f-92b3-1e9b6eb8ea43 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:18.214896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0c59d973-f91c-444f-92b3-1e9b6eb8ea43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:18.228953 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0c530-9060-4945-8521-073e6678bdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:18.229614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0c530-9060-4945-8521-073e6678bdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:18.229894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0c530-9060-4945-8521-073e6678bdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:18.230752 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0c530-9060-4945-8521-073e6678bdd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:18.231692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0c530-9060-4945-8521-073e6678bdd4 None admin] RBAC: Adding query filter params (role.id=958871a8463d49d89ddade803adb47c4, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=5819e022286b454e9e2f23d975c6e921) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:18.231984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0c530-9060-4945-8521-073e6678bdd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:18.236484 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0c530-9060-4945-8521-073e6678bdd4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:18.249716 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 268/542] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:18 2022] GET /identity/v3/role_assignments?user.id=5819e022286b454e9e2f23d975c6e921&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=958871a8463d49d89ddade803adb47c4 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:18.300779 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 275/543] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:57:18.325006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0c530-9060-4945-8521-073e6678bdd4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:18.459179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0c530-9060-4945-8521-073e6678bdd4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:18.499051 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14eb0f-ac48-4839-a8f7-e4e01dc1af92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:18.499880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14eb0f-ac48-4839-a8f7-e4e01dc1af92 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:18.500159 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14eb0f-ac48-4839-a8f7-e4e01dc1af92 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:18.500429 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14eb0f-ac48-4839-a8f7-e4e01dc1af92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:18.512281 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14eb0f-ac48-4839-a8f7-e4e01dc1af92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6a14eb0f-ac48-4839-a8f7-e4e01dc1af92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:18.519934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:18.520787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:18.521580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:18.521580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:18.521580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:18.521580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:18.521580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:18.521580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:18.521580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:18.521580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:18.521580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:18.521580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:18.521580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:18.521580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:18.522174 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 269/544] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:18.528311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59d973-f91c-444f-92b3-1e9b6eb8ea43 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:18.682052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59d973-f91c-444f-92b3-1e9b6eb8ea43 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:18.727541 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5952ac-74f4-4c26-b153-76a06435968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:18.728156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5952ac-74f4-4c26-b153-76a06435968e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:18.728434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5952ac-74f4-4c26-b153-76a06435968e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:18.728703 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5952ac-74f4-4c26-b153-76a06435968e None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:18.729440 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5952ac-74f4-4c26-b153-76a06435968e None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:18.729740 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5952ac-74f4-4c26-b153-76a06435968e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:18.731239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5952ac-74f4-4c26-b153-76a06435968e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:18.743255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 276/545] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:18.749252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14eb0f-ac48-4839-a8f7-e4e01dc1af92 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:18.906467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14eb0f-ac48-4839-a8f7-e4e01dc1af92 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:18.948571 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a20d1c-351a-4189-bb4b-5566359932b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:18.950269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a20d1c-351a-4189-bb4b-5566359932b5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:18.950768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a20d1c-351a-4189-bb4b-5566359932b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:18.951238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a20d1c-351a-4189-bb4b-5566359932b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:18.962224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a20d1c-351a-4189-bb4b-5566359932b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:18.964021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a20d1c-351a-4189-bb4b-5566359932b5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:18.981988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-d8a20d1c-351a-4189-bb4b-5566359932b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:18.981988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:18.981988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:18.981988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:18.981988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:18.981988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:18.981988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:18.981988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:18.981988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:18.981988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:18.981988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:18.981988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:18.981988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:18.981988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:18.981988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:18.982835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:18.983717 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:18.983717 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:18.983717 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:18.983717 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:18.985892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 270/546] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:18.991096 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5952ac-74f4-4c26-b153-76a06435968e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:19.137856 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5952ac-74f4-4c26-b153-76a06435968e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:19.180293 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c75e0-8a28-4eee-b75b-d83ae9b0c6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:19.180960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c75e0-8a28-4eee-b75b-d83ae9b0c6db None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:19.181243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c75e0-8a28-4eee-b75b-d83ae9b0c6db None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:19.181515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c75e0-8a28-4eee-b75b-d83ae9b0c6db None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:19.182232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c75e0-8a28-4eee-b75b-d83ae9b0c6db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:19.182536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c75e0-8a28-4eee-b75b-d83ae9b0c6db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:19.184435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c75e0-8a28-4eee-b75b-d83ae9b0c6db None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:19.196788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 277/547] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:19.202342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a20d1c-351a-4189-bb4b-5566359932b5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:19.322866 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a20d1c-351a-4189-bb4b-5566359932b5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:19.363059 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58c002-050e-4491-b673-57621a1053c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:19.363889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58c002-050e-4491-b673-57621a1053c1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:19.364169 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58c002-050e-4491-b673-57621a1053c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:19.364437 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58c002-050e-4491-b673-57621a1053c1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:19.375072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58c002-050e-4491-b673-57621a1053c1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:19.376561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58c002-050e-4491-b673-57621a1053c1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-df58c002-050e-4491-b673-57621a1053c1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:19.394659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:19.395577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:19.396500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:19.396500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:19.396500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:19.396500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:19.396500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:19.396500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:19.396500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:19.396500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:19.396500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 16:57:19.396500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:19.404264 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 271/548] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:57:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:19.409545 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c75e0-8a28-4eee-b75b-d83ae9b0c6db None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:19.530788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c75e0-8a28-4eee-b75b-d83ae9b0c6db None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:19.571068 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645c37d-2a60-4669-9749-a85551548e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:19.571768 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645c37d-2a60-4669-9749-a85551548e61 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:19.572045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645c37d-2a60-4669-9749-a85551548e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:19.572317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645c37d-2a60-4669-9749-a85551548e61 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:19.573205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645c37d-2a60-4669-9749-a85551548e61 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:19.573457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645c37d-2a60-4669-9749-a85551548e61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:19.575449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645c37d-2a60-4669-9749-a85551548e61 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:19.594080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 278/549] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 17 16:57:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:19.599204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58c002-050e-4491-b673-57621a1053c1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:19.784604 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58c002-050e-4491-b673-57621a1053c1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:19.835099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ede78-db7a-40de-be78-dc2731090ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:19.835698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ede78-db7a-40de-be78-dc2731090ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:19.835982 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ede78-db7a-40de-be78-dc2731090ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:19.836256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ede78-db7a-40de-be78-dc2731090ae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:19.912623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ede78-db7a-40de-be78-dc2731090ae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:19.914095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ede78-db7a-40de-be78-dc2731090ae5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:20.022602 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 272/550] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:20.028440 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645c37d-2a60-4669-9749-a85551548e61 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:20.181486 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1984b-1e7a-42b9-91be-497be4f276e4 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:20.181486 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1984b-1e7a-42b9-91be-497be4f276e4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:20.181486 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1984b-1e7a-42b9-91be-497be4f276e4 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:20.183089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 273/551] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:57:20.184888 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d407c-04e4-4c02-8e34-8da822776422 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:20.185170 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d407c-04e4-4c02-8e34-8da822776422 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:20.185445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d407c-04e4-4c02-8e34-8da822776422 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:20.186864 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 274/552] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:20.192072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a381f0-610f-45e0-8dad-58b6c8a50b7c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:20.192354 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a381f0-610f-45e0-8dad-58b6c8a50b7c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:20.192631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a381f0-610f-45e0-8dad-58b6c8a50b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:20.209595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645c37d-2a60-4669-9749-a85551548e61 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:20.210119 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-77a381f0-610f-45e0-8dad-58b6c8a50b7c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:20.210908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-77a381f0-610f-45e0-8dad-58b6c8a50b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:20.245136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e6d1f-77d0-41af-8779-3521eb1a1576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:20.247054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e6d1f-77d0-41af-8779-3521eb1a1576 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:20.247526 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e6d1f-77d0-41af-8779-3521eb1a1576 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:20.247984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e6d1f-77d0-41af-8779-3521eb1a1576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:20.258524 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e6d1f-77d0-41af-8779-3521eb1a1576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:20.260208 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e6d1f-77d0-41af-8779-3521eb1a1576 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:20.279684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-c64e6d1f-77d0-41af-8779-3521eb1a1576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:20.279684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:20.279684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:20.279684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:20.279684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:20.279684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:20.279684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:20.279684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:20.279684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:20.279684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:20.279684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:20.279684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:20.279684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:20.279684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:20.279684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:20.280780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:20.281768 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:20.281768 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:20.281768 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:20.281768 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:20.281986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 275/553] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:20.281986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae1bdd-ff62-46db-b0bd-2b0d929249fe None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:20.281986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae1bdd-ff62-46db-b0bd-2b0d929249fe None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:20.282157 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae1bdd-ff62-46db-b0bd-2b0d929249fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:20.283903 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 279/554] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:20.291647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e6d1f-77d0-41af-8779-3521eb1a1576 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:20.299027 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a8ae1bdd-ff62-46db-b0bd-2b0d929249fe None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:20.300222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a8ae1bdd-ff62-46db-b0bd-2b0d929249fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:20.372191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 276/555] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:20.373076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae1bdd-ff62-46db-b0bd-2b0d929249fe None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:20.425813 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e6d1f-77d0-41af-8779-3521eb1a1576 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:20.469746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a9491-163c-4072-a249-86eab45d90c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:20.471063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a9491-163c-4072-a249-86eab45d90c8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:20.471348 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a9491-163c-4072-a249-86eab45d90c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:20.471640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a9491-163c-4072-a249-86eab45d90c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:20.472523 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a9491-163c-4072-a249-86eab45d90c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:20.472831 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a9491-163c-4072-a249-86eab45d90c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:20.474793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a9491-163c-4072-a249-86eab45d90c8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:20.479380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae1bdd-ff62-46db-b0bd-2b0d929249fe None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:20.488750 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 280/556] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:20.489954 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a9491-163c-4072-a249-86eab45d90c8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:20.519439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa160e5f-6cc2-4c1d-b391-eaafed9988da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:20.520265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa160e5f-6cc2-4c1d-b391-eaafed9988da None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:20.520545 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa160e5f-6cc2-4c1d-b391-eaafed9988da None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:20.520816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa160e5f-6cc2-4c1d-b391-eaafed9988da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:20.532219 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa160e5f-6cc2-4c1d-b391-eaafed9988da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-aa160e5f-6cc2-4c1d-b391-eaafed9988da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:20.540198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:20.541104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:20.541887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:20.541887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:20.541887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:20.541887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:20.541887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:20.541887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:20.541887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:20.541887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:20.541887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:20.541887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:20.541887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:20.541887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:20.541887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 277/557] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:20.543204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa160e5f-6cc2-4c1d-b391-eaafed9988da None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:20.616891 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a9491-163c-4072-a249-86eab45d90c8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:20.650369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa160e5f-6cc2-4c1d-b391-eaafed9988da None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:20.652502 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050cb6a-2608-4dfb-8d6a-41a4338cda84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:20.653319 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050cb6a-2608-4dfb-8d6a-41a4338cda84 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:20.653601 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050cb6a-2608-4dfb-8d6a-41a4338cda84 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:20.653871 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050cb6a-2608-4dfb-8d6a-41a4338cda84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:20.663733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050cb6a-2608-4dfb-8d6a-41a4338cda84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-2050cb6a-2608-4dfb-8d6a-41a4338cda84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:20.671542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:20.672656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:20.673720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:20.673720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:20.673720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:20.673720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:20.673720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:20.673720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:20.673720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:20.673720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:20.673720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:20.673720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:20.673720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:20.673720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:20.673720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 281/558] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:20.674391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050cb6a-2608-4dfb-8d6a-41a4338cda84 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:20.691267 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d057f7-3762-41a7-8189-a34a80aaa86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:20.692250 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d057f7-3762-41a7-8189-a34a80aaa86a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:20.692817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d057f7-3762-41a7-8189-a34a80aaa86a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:20.693096 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d057f7-3762-41a7-8189-a34a80aaa86a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:20.702320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d057f7-3762-41a7-8189-a34a80aaa86a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:20.704241 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d057f7-3762-41a7-8189-a34a80aaa86a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:20.719917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c1d057f7-3762-41a7-8189-a34a80aaa86a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:20.719917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:20.719917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:20.719917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:20.719917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:20.719917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:20.719917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:20.719917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:20.719917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:20.719917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:20.719917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:20.719917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:20.719917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:20.719917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:20.719917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:20.720941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:20.721765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:20.721765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:20.721765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:20.721765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:20.721765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:20.721765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:20.721765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:20.721765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:20.721765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 278/559] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:20.722548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff7174-2826-4ea4-b9b0-b21a8e7a8bdc None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:20.722652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff7174-2826-4ea4-b9b0-b21a8e7a8bdc None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:20.722896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff7174-2826-4ea4-b9b0-b21a8e7a8bdc None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:20.724342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 279/560] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:20.724956 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff7174-2826-4ea4-b9b0-b21a8e7a8bdc None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:20.776682 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050cb6a-2608-4dfb-8d6a-41a4338cda84 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:20.811644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd3f62-246a-4c95-a52e-5ef23d8dce67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:20.812335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd3f62-246a-4c95-a52e-5ef23d8dce67 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:20.812620 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd3f62-246a-4c95-a52e-5ef23d8dce67 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:20.812900 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd3f62-246a-4c95-a52e-5ef23d8dce67 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:20.813914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd3f62-246a-4c95-a52e-5ef23d8dce67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:20.814228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd3f62-246a-4c95-a52e-5ef23d8dce67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:20.815681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd3f62-246a-4c95-a52e-5ef23d8dce67 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:20.830051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 282/561] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:20.830051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd3f62-246a-4c95-a52e-5ef23d8dce67 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:20.854582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff7174-2826-4ea4-b9b0-b21a8e7a8bdc None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:20.892262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9c38c-cefd-41a0-b885-e1321fa1b7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:20.892926 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9c38c-cefd-41a0-b885-e1321fa1b7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:20.893211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9c38c-cefd-41a0-b885-e1321fa1b7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:20.893484 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9c38c-cefd-41a0-b885-e1321fa1b7b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:20.894226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9c38c-cefd-41a0-b885-e1321fa1b7b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:20.894533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9c38c-cefd-41a0-b885-e1321fa1b7b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:20.895936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9c38c-cefd-41a0-b885-e1321fa1b7b8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:20.904367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 280/562] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:20.905365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e2294-71c7-42cc-8d27-2061cba36ca8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:20.905651 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e2294-71c7-42cc-8d27-2061cba36ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:20.905925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e2294-71c7-42cc-8d27-2061cba36ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:20.921368 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f26e2294-71c7-42cc-8d27-2061cba36ca8 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:20.922518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f26e2294-71c7-42cc-8d27-2061cba36ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:20.931038 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd3f62-246a-4c95-a52e-5ef23d8dce67 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:20.965692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f6a8e-7716-41c7-8483-bf51e520b7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:20.966243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f6a8e-7716-41c7-8483-bf51e520b7ad None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:20.966563 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f6a8e-7716-41c7-8483-bf51e520b7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:20.966841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f6a8e-7716-41c7-8483-bf51e520b7ad None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:20.967637 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f6a8e-7716-41c7-8483-bf51e520b7ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:20.967943 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f6a8e-7716-41c7-8483-bf51e520b7ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:20.969569 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f6a8e-7716-41c7-8483-bf51e520b7ad None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:20.982419 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 283/563] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:20.983233 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f6a8e-7716-41c7-8483-bf51e520b7ad None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:20.990772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 281/564] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:20.991974 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e2294-71c7-42cc-8d27-2061cba36ca8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:21.086827 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e2294-71c7-42cc-8d27-2061cba36ca8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:21.095344 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f6a8e-7716-41c7-8483-bf51e520b7ad None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:21.119174 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd86da5-2944-4e9d-a86d-3924dd8d1cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:21.119990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd86da5-2944-4e9d-a86d-3924dd8d1cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:21.120266 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd86da5-2944-4e9d-a86d-3924dd8d1cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:21.120558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd86da5-2944-4e9d-a86d-3924dd8d1cf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:21.126755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c06a59-a74b-4395-b98d-da218a6a4856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:21.127536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c06a59-a74b-4395-b98d-da218a6a4856 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:21.127852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c06a59-a74b-4395-b98d-da218a6a4856 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:21.128122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c06a59-a74b-4395-b98d-da218a6a4856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:21.130297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd86da5-2944-4e9d-a86d-3924dd8d1cf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:21.131790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd86da5-2944-4e9d-a86d-3924dd8d1cf0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:21.138491 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c06a59-a74b-4395-b98d-da218a6a4856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:21.139931 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c06a59-a74b-4395-b98d-da218a6a4856 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:21.149633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-2cd86da5-2944-4e9d-a86d-3924dd8d1cf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:21.149633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:21.149633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:21.149633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:21.149633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:21.149633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:21.149633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:21.149633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:21.149633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:21.149633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:21.149633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:21.149633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:21.149633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:21.149633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:21.149633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:21.150653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:21.151507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:21.151507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:21.151507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:21.151507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:21.151507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 282/565] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:21.152676 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd86da5-2944-4e9d-a86d-3924dd8d1cf0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:21.157384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-11c06a59-a74b-4395-b98d-da218a6a4856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:21.157384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:21.157384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:21.157384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:21.157384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:21.157384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:21.157384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:21.157384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:21.157384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:21.157384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:21.157384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:21.157384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:21.157384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:21.157384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:21.157384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:21.158387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:21.159445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:21.159445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:21.159445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:21.159445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:21.159445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 284/566] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:21.160178 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a5d31-5658-4830-a1ff-0d8f355fce72 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:21.160324 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a5d31-5658-4830-a1ff-0d8f355fce72 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:21.160516 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a5d31-5658-4830-a1ff-0d8f355fce72 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:21.161755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 285/567] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:21.162435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a5d31-5658-4830-a1ff-0d8f355fce72 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:21.248171 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd86da5-2944-4e9d-a86d-3924dd8d1cf0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:21.260165 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a5d31-5658-4830-a1ff-0d8f355fce72 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:21.280190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaf51e-faea-4e88-80b0-f83bc300a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:21.280838 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaf51e-faea-4e88-80b0-f83bc300a3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:21.281118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaf51e-faea-4e88-80b0-f83bc300a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:21.281387 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaf51e-faea-4e88-80b0-f83bc300a3d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:21.282210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaf51e-faea-4e88-80b0-f83bc300a3d8 None admin] RBAC: Adding query filter params (role.id=958871a8463d49d89ddade803adb47c4, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=bc87aba3662244bea0428475bb0c9e8b) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:21.282519 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaf51e-faea-4e88-80b0-f83bc300a3d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:21.283981 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaf51e-faea-4e88-80b0-f83bc300a3d8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:21.289178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 283/568] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:21 2022] GET /identity/v3/role_assignments?user.id=bc87aba3662244bea0428475bb0c9e8b&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=958871a8463d49d89ddade803adb47c4 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:21.289943 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaf51e-faea-4e88-80b0-f83bc300a3d8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:21.292963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474dbbe-06a4-4a1c-8b93-20ecd1b4b555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:21.293997 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474dbbe-06a4-4a1c-8b93-20ecd1b4b555 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:21.294118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474dbbe-06a4-4a1c-8b93-20ecd1b4b555 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:21.294345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474dbbe-06a4-4a1c-8b93-20ecd1b4b555 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:21.306098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474dbbe-06a4-4a1c-8b93-20ecd1b4b555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-6474dbbe-06a4-4a1c-8b93-20ecd1b4b555 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:21.314357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:21.315506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:21.316411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:21.316411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:21.316411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:21.316411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:21.316411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:21.316411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:21.316411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:21.316411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:21.316411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:21.316411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:21.316411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:21.316411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:21.316411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 286/569] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:21.317134 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15580fc-a41b-4a8e-8f68-2a4e76058bf0 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:21.317213 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15580fc-a41b-4a8e-8f68-2a4e76058bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:21.317839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15580fc-a41b-4a8e-8f68-2a4e76058bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:21.335326 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c15580fc-a41b-4a8e-8f68-2a4e76058bf0 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:21.336575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c15580fc-a41b-4a8e-8f68-2a4e76058bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:21.415723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 287/570] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:21.415948 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaf51e-faea-4e88-80b0-f83bc300a3d8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:21.416050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15580fc-a41b-4a8e-8f68-2a4e76058bf0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:21.458014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822ac16-54d3-4f86-8abd-89bc31f0060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:21.458972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822ac16-54d3-4f86-8abd-89bc31f0060b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:21.459425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822ac16-54d3-4f86-8abd-89bc31f0060b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:21.459748 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822ac16-54d3-4f86-8abd-89bc31f0060b None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:21.460478 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822ac16-54d3-4f86-8abd-89bc31f0060b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:21.460780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822ac16-54d3-4f86-8abd-89bc31f0060b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:21.462155 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822ac16-54d3-4f86-8abd-89bc31f0060b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:21.475969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 284/571] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:21.476814 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822ac16-54d3-4f86-8abd-89bc31f0060b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:21.522207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15580fc-a41b-4a8e-8f68-2a4e76058bf0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:21.555904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239757f5-8561-4e09-b772-05339c7308c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:21.556465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239757f5-8561-4e09-b772-05339c7308c8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:21.556748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239757f5-8561-4e09-b772-05339c7308c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:21.557025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239757f5-8561-4e09-b772-05339c7308c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:21.557745 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239757f5-8561-4e09-b772-05339c7308c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:21.558558 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239757f5-8561-4e09-b772-05339c7308c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:21.560019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239757f5-8561-4e09-b772-05339c7308c8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:21.571671 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 288/572] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:21.572832 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239757f5-8561-4e09-b772-05339c7308c8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:21.581913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822ac16-54d3-4f86-8abd-89bc31f0060b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:21.615137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76ad0e-2cf8-4e55-ab76-7a41b95505b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:21.615833 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76ad0e-2cf8-4e55-ab76-7a41b95505b1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:21.616203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76ad0e-2cf8-4e55-ab76-7a41b95505b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:21.616377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76ad0e-2cf8-4e55-ab76-7a41b95505b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:21.617105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76ad0e-2cf8-4e55-ab76-7a41b95505b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:21.617404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76ad0e-2cf8-4e55-ab76-7a41b95505b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:21.618924 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76ad0e-2cf8-4e55-ab76-7a41b95505b1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:21.632117 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 285/573] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:21.632117 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76ad0e-2cf8-4e55-ab76-7a41b95505b1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:21.676511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239757f5-8561-4e09-b772-05339c7308c8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:21.715928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b072a-1cda-44c3-95dc-1d4b5ccd4bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:21.716888 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b072a-1cda-44c3-95dc-1d4b5ccd4bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:21.717174 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b072a-1cda-44c3-95dc-1d4b5ccd4bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:21.717730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b072a-1cda-44c3-95dc-1d4b5ccd4bd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:21.730688 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b072a-1cda-44c3-95dc-1d4b5ccd4bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:21.731156 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76ad0e-2cf8-4e55-ab76-7a41b95505b1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d00b072a-1cda-44c3-95dc-1d4b5ccd4bd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:21.740167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:21.741614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:21.742446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:21.742446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:21.742446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:21.742446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:21.742446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:21.742446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:21.742446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:21.742446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:21.742446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:21.742446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:21.742446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:21.742446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:21.742446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 289/574] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:21.743146 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b072a-1cda-44c3-95dc-1d4b5ccd4bd4 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:21.769322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1b11b-559e-4693-877e-3081f1a2467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:21.770116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1b11b-559e-4693-877e-3081f1a2467d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:21.770477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1b11b-559e-4693-877e-3081f1a2467d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:21.770756 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1b11b-559e-4693-877e-3081f1a2467d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:21.778361 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1b11b-559e-4693-877e-3081f1a2467d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:21.779805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1b11b-559e-4693-877e-3081f1a2467d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-29a1b11b-559e-4693-877e-3081f1a2467d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:21.794277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:21.795475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:21.796689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:21.796689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:21.796689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:21.796689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:21.796689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:21.796689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:21.796689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:21.796689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:21.796689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 16:57:21.796689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:21.796689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 286/575] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:21.796689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1b11b-559e-4693-877e-3081f1a2467d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:21.857793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b072a-1cda-44c3-95dc-1d4b5ccd4bd4 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:21.890550 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566bbcb-5445-4970-a93c-457775079f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:21.891344 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566bbcb-5445-4970-a93c-457775079f48 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:21.891639 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566bbcb-5445-4970-a93c-457775079f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:21.891929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566bbcb-5445-4970-a93c-457775079f48 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:21.899155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566bbcb-5445-4970-a93c-457775079f48 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:21.899268 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1b11b-559e-4693-877e-3081f1a2467d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:21.900635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566bbcb-5445-4970-a93c-457775079f48 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-8566bbcb-5445-4970-a93c-457775079f48 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:21.914697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:21.915663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:21.916697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:21.916697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:21.916697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:21.916697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:21.916697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:21.916697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:21.916697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:21.916697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:21.916697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 16:57:21.916697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:21.919897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 290/576] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 16:57:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:21.920907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566bbcb-5445-4970-a93c-457775079f48 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:21.935044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c040f-c7d8-4b3d-9b18-702a4fe75763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:21.935916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c040f-c7d8-4b3d-9b18-702a4fe75763 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:21.936102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c040f-c7d8-4b3d-9b18-702a4fe75763 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:21.936343 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c040f-c7d8-4b3d-9b18-702a4fe75763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:21.947352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c040f-c7d8-4b3d-9b18-702a4fe75763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:21.949418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c040f-c7d8-4b3d-9b18-702a4fe75763 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:21.966969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-332c040f-c7d8-4b3d-9b18-702a4fe75763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:21.966969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:21.966969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:21.966969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:21.966969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:21.966969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:21.966969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:21.966969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:21.966969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:21.966969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:21.966969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:21.966969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:21.966969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:21.966969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:21.966969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:21.968121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:21.973851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:21.973851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:21.973851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:21.973851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:21.973851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 287/577] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:21.973851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c040f-c7d8-4b3d-9b18-702a4fe75763 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:22.031116 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566bbcb-5445-4970-a93c-457775079f48 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:22.066603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c040f-c7d8-4b3d-9b18-702a4fe75763 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:22.067490 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60c6c4-6671-44b1-ac4f-dd2f2e3f1dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:22.068191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60c6c4-6671-44b1-ac4f-dd2f2e3f1dee None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:22.068477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60c6c4-6671-44b1-ac4f-dd2f2e3f1dee None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:22.068765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60c6c4-6671-44b1-ac4f-dd2f2e3f1dee None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:22.069501 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60c6c4-6671-44b1-ac4f-dd2f2e3f1dee None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:22.069806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60c6c4-6671-44b1-ac4f-dd2f2e3f1dee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:22.071195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60c6c4-6671-44b1-ac4f-dd2f2e3f1dee None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:22.079457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 291/578] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:22.080577 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60c6c4-6671-44b1-ac4f-dd2f2e3f1dee None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:22.108012 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be369371-437b-4592-b472-601b32078b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:22.108679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be369371-437b-4592-b472-601b32078b8b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:22.108956 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be369371-437b-4592-b472-601b32078b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:22.109222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be369371-437b-4592-b472-601b32078b8b None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:22.110051 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be369371-437b-4592-b472-601b32078b8b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:22.110353 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be369371-437b-4592-b472-601b32078b8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:22.111823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be369371-437b-4592-b472-601b32078b8b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:22.137718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 288/579] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 17 16:57:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:22.137718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be369371-437b-4592-b472-601b32078b8b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:22.181960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60c6c4-6671-44b1-ac4f-dd2f2e3f1dee None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:22.214097 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349d3d5-d1f7-44f1-8537-dc0510f99f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:22.215466 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349d3d5-d1f7-44f1-8537-dc0510f99f90 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:22.215776 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349d3d5-d1f7-44f1-8537-dc0510f99f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:22.216053 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349d3d5-d1f7-44f1-8537-dc0510f99f90 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:22.216903 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349d3d5-d1f7-44f1-8537-dc0510f99f90 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:22.217286 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349d3d5-d1f7-44f1-8537-dc0510f99f90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:22.218633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349d3d5-d1f7-44f1-8537-dc0510f99f90 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:22.235453 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be369371-437b-4592-b472-601b32078b8b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:22.240289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 292/580] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 16:57:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:22.240289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349d3d5-d1f7-44f1-8537-dc0510f99f90 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:22.271319 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7caf64-6745-4afa-a6b5-1c4b5f32c711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:22.272641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7caf64-6745-4afa-a6b5-1c4b5f32c711 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:22.273141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7caf64-6745-4afa-a6b5-1c4b5f32c711 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:22.273410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7caf64-6745-4afa-a6b5-1c4b5f32c711 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:22.274122 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7caf64-6745-4afa-a6b5-1c4b5f32c711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:22.274423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7caf64-6745-4afa-a6b5-1c4b5f32c711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:22.275792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7caf64-6745-4afa-a6b5-1c4b5f32c711 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:22.292992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 289/581] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:22.292992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7caf64-6745-4afa-a6b5-1c4b5f32c711 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:22.335235 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349d3d5-d1f7-44f1-8537-dc0510f99f90 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:22.369051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32161390-d944-4030-ad2a-ceb4548e6029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:22.369841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32161390-d944-4030-ad2a-ceb4548e6029 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:22.370124 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32161390-d944-4030-ad2a-ceb4548e6029 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:22.370397 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32161390-d944-4030-ad2a-ceb4548e6029 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:22.380307 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32161390-d944-4030-ad2a-ceb4548e6029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:22.381734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32161390-d944-4030-ad2a-ceb4548e6029 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:22.391721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7caf64-6745-4afa-a6b5-1c4b5f32c711 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:22.399640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-32161390-d944-4030-ad2a-ceb4548e6029 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:22.399640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:22.399640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:22.399640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:22.399640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:22.399640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:22.399640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:22.399640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:22.399640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:22.399640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:22.399640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:22.399640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:22.399640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:22.399640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:22.399640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:22.400629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:22.402869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:22.402869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:22.402869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:22.402869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:22.402869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 293/582] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:22.402869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32161390-d944-4030-ad2a-ceb4548e6029 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:22.433902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911807ad-82ff-4553-8d40-a3d2610ee0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:22.435322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911807ad-82ff-4553-8d40-a3d2610ee0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:22.435788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911807ad-82ff-4553-8d40-a3d2610ee0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:22.436224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911807ad-82ff-4553-8d40-a3d2610ee0f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:22.448661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911807ad-82ff-4553-8d40-a3d2610ee0f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:22.450511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911807ad-82ff-4553-8d40-a3d2610ee0f2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:22.475036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-911807ad-82ff-4553-8d40-a3d2610ee0f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:22.475036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:22.475036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:22.475036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:22.475036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:22.475036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:22.475036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:22.475036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:22.475036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:22.475036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:22.475036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:22.475036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:22.475036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:22.475036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:22.475036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:22.476006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:22.476897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:22.476897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:22.476897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:22.476897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:22.476897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 290/583] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:22.477190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911807ad-82ff-4553-8d40-a3d2610ee0f2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:22.517675 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32161390-d944-4030-ad2a-ceb4548e6029 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:22.560620 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece1107-75f2-4694-b293-8667b649a476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:22.561413 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece1107-75f2-4694-b293-8667b649a476 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:22.561692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece1107-75f2-4694-b293-8667b649a476 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:22.561961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece1107-75f2-4694-b293-8667b649a476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:22.575082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece1107-75f2-4694-b293-8667b649a476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:22.575238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911807ad-82ff-4553-8d40-a3d2610ee0f2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:22.576551 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece1107-75f2-4694-b293-8667b649a476 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:22.595970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-fece1107-75f2-4694-b293-8667b649a476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:22.595970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:22.595970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:22.595970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:22.595970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:22.595970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:22.595970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:22.595970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:22.595970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:22.595970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:22.595970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:22.595970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:22.595970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:22.595970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:22.595970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:22.597049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:22.598131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:22.598131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:22.598131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:22.598131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:22.598131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 294/584] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:22.598131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece1107-75f2-4694-b293-8667b649a476 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:22.611049 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4c4c1-50b3-4d29-871e-33d5ac79bc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:22.611876 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4c4c1-50b3-4d29-871e-33d5ac79bc7d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:22.612160 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4c4c1-50b3-4d29-871e-33d5ac79bc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:22.612433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4c4c1-50b3-4d29-871e-33d5ac79bc7d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:22.619913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4c4c1-50b3-4d29-871e-33d5ac79bc7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:22.621580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4c4c1-50b3-4d29-871e-33d5ac79bc7d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-bcb4c4c1-50b3-4d29-871e-33d5ac79bc7d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:22.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:22.636881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:22.638032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:22.638032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:22.638032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:22.638032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:22.638032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:22.638032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:22.638032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:22.638032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:22.638032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 16:57:22.638032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:22.642505 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 291/585] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:22.643384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4c4c1-50b3-4d29-871e-33d5ac79bc7d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:22.702692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece1107-75f2-4694-b293-8667b649a476 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:22.738949 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4c4c1-50b3-4d29-871e-33d5ac79bc7d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:22.743302 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e54db-173d-4e2a-a3bf-f8d1b49d9dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:22.744109 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e54db-173d-4e2a-a3bf-f8d1b49d9dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:22.744552 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e54db-173d-4e2a-a3bf-f8d1b49d9dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:22.744964 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e54db-173d-4e2a-a3bf-f8d1b49d9dc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:22.745772 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e54db-173d-4e2a-a3bf-f8d1b49d9dc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:22.746656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e54db-173d-4e2a-a3bf-f8d1b49d9dc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:22.748567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e54db-173d-4e2a-a3bf-f8d1b49d9dc1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:22.764536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 295/586] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:22.764536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e54db-173d-4e2a-a3bf-f8d1b49d9dc1 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:22.776259 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799976e0-d1fd-4835-8714-37aa32e59cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:22.777617 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799976e0-d1fd-4835-8714-37aa32e59cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:22.777964 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799976e0-d1fd-4835-8714-37aa32e59cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:22.778245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799976e0-d1fd-4835-8714-37aa32e59cb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:22.778984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799976e0-d1fd-4835-8714-37aa32e59cb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:22.779294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799976e0-d1fd-4835-8714-37aa32e59cb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:22.780699 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799976e0-d1fd-4835-8714-37aa32e59cb2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:22.796530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 292/587] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:22.796530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799976e0-d1fd-4835-8714-37aa32e59cb2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:22.862607 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e54db-173d-4e2a-a3bf-f8d1b49d9dc1 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:22.895185 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799976e0-d1fd-4835-8714-37aa32e59cb2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:22.897092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c074d40-1c54-435b-9a55-3369d23bfc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:22.897990 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c074d40-1c54-435b-9a55-3369d23bfc7d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:22.898422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c074d40-1c54-435b-9a55-3369d23bfc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:22.898840 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c074d40-1c54-435b-9a55-3369d23bfc7d None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:22.899734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c074d40-1c54-435b-9a55-3369d23bfc7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:22.900179 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c074d40-1c54-435b-9a55-3369d23bfc7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:22.901686 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c074d40-1c54-435b-9a55-3369d23bfc7d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:22.913983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 296/588] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:22.914931 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c074d40-1c54-435b-9a55-3369d23bfc7d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:22.932424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2747770-c548-4e4d-b40d-c2e656e102b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:22.933705 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2747770-c548-4e4d-b40d-c2e656e102b2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:22.934516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2747770-c548-4e4d-b40d-c2e656e102b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:22.934804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2747770-c548-4e4d-b40d-c2e656e102b2 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:22.935704 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2747770-c548-4e4d-b40d-c2e656e102b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:22.936017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2747770-c548-4e4d-b40d-c2e656e102b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:22.937456 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2747770-c548-4e4d-b40d-c2e656e102b2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:22.959718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 293/589] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 17 16:57:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:22.959718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2747770-c548-4e4d-b40d-c2e656e102b2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:23.019481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c074d40-1c54-435b-9a55-3369d23bfc7d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:23.056245 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180073db-a71c-47a0-bd40-822d3278a9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:23.057047 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180073db-a71c-47a0-bd40-822d3278a9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:23.057333 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180073db-a71c-47a0-bd40-822d3278a9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:23.057610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180073db-a71c-47a0-bd40-822d3278a9e0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:23.059298 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2747770-c548-4e4d-b40d-c2e656e102b2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:23.066204 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180073db-a71c-47a0-bd40-822d3278a9e0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:23.067669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180073db-a71c-47a0-bd40-822d3278a9e0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-180073db-a71c-47a0-bd40-822d3278a9e0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:23.082930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:23.084140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:23.085099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:23.085099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:23.085099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:23.085099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:23.085099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:23.085099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:23.085099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:23.085099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:23.085099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 16:57:23.085099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:23.085099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 297/590] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:23.085691 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180073db-a71c-47a0-bd40-822d3278a9e0 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:23.103754 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4505a8-cdaa-44c8-adee-2b78cb10fb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:23.104777 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4505a8-cdaa-44c8-adee-2b78cb10fb2b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:23.105941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4505a8-cdaa-44c8-adee-2b78cb10fb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:23.106446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4505a8-cdaa-44c8-adee-2b78cb10fb2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:23.115867 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4505a8-cdaa-44c8-adee-2b78cb10fb2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:23.118587 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4505a8-cdaa-44c8-adee-2b78cb10fb2b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:23.133522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-1d4505a8-cdaa-44c8-adee-2b78cb10fb2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:23.133522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:23.133522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:23.133522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:23.133522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:23.133522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:23.133522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:23.133522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:23.133522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:23.133522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:23.133522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:23.133522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:23.133522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:23.133522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:23.133522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:23.134509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:23.135398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:23.135398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:23.135398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:23.135398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:23.135398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:23.135398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:23.135398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:23.135398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:23.135398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 294/591] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:23.135936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4505a8-cdaa-44c8-adee-2b78cb10fb2b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:23.191118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180073db-a71c-47a0-bd40-822d3278a9e0 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:23.224509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22018213-3d7f-4f7b-b5f0-d78522fc388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:23.225559 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22018213-3d7f-4f7b-b5f0-d78522fc388f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:23.225845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22018213-3d7f-4f7b-b5f0-d78522fc388f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:23.226123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22018213-3d7f-4f7b-b5f0-d78522fc388f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:23.233585 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22018213-3d7f-4f7b-b5f0-d78522fc388f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:23.235114 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22018213-3d7f-4f7b-b5f0-d78522fc388f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:23.241801 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4505a8-cdaa-44c8-adee-2b78cb10fb2b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:23.250161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-22018213-3d7f-4f7b-b5f0-d78522fc388f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:23.250161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:23.250161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:23.250161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:23.250161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:23.250161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:23.250161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:23.250161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:23.250161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:23.250161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:23.250161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:23.250161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:23.250161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:23.250161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:23.250161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:23.251073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:23.256942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:23.256942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:23.256942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:23.256942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:23.256942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:23.256942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:23.256942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:23.256942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:23.256942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 298/592] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:23.256942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22018213-3d7f-4f7b-b5f0-d78522fc388f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:23.275496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0eac9-cec4-425f-8639-0d48f1520d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:23.276256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0eac9-cec4-425f-8639-0d48f1520d0f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:23.276533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0eac9-cec4-425f-8639-0d48f1520d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:23.277379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0eac9-cec4-425f-8639-0d48f1520d0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:23.287684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0eac9-cec4-425f-8639-0d48f1520d0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:23.289110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0eac9-cec4-425f-8639-0d48f1520d0f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:23.307087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-f8f0eac9-cec4-425f-8639-0d48f1520d0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:23.307087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:23.307087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:23.307087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:23.307087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:23.307087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:23.307087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:23.307087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:23.307087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:23.307087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:23.307087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:23.307087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:23.307087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:23.307087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:23.307087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:23.308592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:23.309493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:23.309493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:23.309493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:23.309493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:23.309493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 295/593] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:23.309493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0eac9-cec4-425f-8639-0d48f1520d0f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:23.362586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22018213-3d7f-4f7b-b5f0-d78522fc388f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:23.397502 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046653b8-90f0-4830-8520-8c8a720f0d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:23.398275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046653b8-90f0-4830-8520-8c8a720f0d4a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:23.398623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046653b8-90f0-4830-8520-8c8a720f0d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:23.398971 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046653b8-90f0-4830-8520-8c8a720f0d4a None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:23.399907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046653b8-90f0-4830-8520-8c8a720f0d4a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:23.400294 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046653b8-90f0-4830-8520-8c8a720f0d4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:23.401842 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046653b8-90f0-4830-8520-8c8a720f0d4a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:23.419853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 299/594] 10.222.0.48 () {56 vars in 1139 bytes} [Tue May 17 16:57:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:23.420680 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046653b8-90f0-4830-8520-8c8a720f0d4a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:23.421945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0eac9-cec4-425f-8639-0d48f1520d0f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:23.456326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2963ada-c4c8-42b4-bd95-481aa9ab35eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:23.457085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2963ada-c4c8-42b4-bd95-481aa9ab35eb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:23.457471 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2963ada-c4c8-42b4-bd95-481aa9ab35eb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:23.457851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2963ada-c4c8-42b4-bd95-481aa9ab35eb None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:23.458748 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2963ada-c4c8-42b4-bd95-481aa9ab35eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:23.459168 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2963ada-c4c8-42b4-bd95-481aa9ab35eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:23.460732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2963ada-c4c8-42b4-bd95-481aa9ab35eb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:23.476835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 296/595] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:23.476835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2963ada-c4c8-42b4-bd95-481aa9ab35eb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:23.523835 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046653b8-90f0-4830-8520-8c8a720f0d4a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:23.555848 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d900a0-8a21-437d-9865-1a487fd24d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:23.556500 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d900a0-8a21-437d-9865-1a487fd24d31 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:23.556782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d900a0-8a21-437d-9865-1a487fd24d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:23.557055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d900a0-8a21-437d-9865-1a487fd24d31 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:23.557902 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d900a0-8a21-437d-9865-1a487fd24d31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:23.558709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d900a0-8a21-437d-9865-1a487fd24d31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:23.560228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d900a0-8a21-437d-9865-1a487fd24d31 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:23.571288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 300/596] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:23.572098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d900a0-8a21-437d-9865-1a487fd24d31 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:23.573515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2963ada-c4c8-42b4-bd95-481aa9ab35eb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:23.605768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28daab2e-6f53-41ac-adc1-64fa072321f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:23.606736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daab2e-6f53-41ac-adc1-64fa072321f5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:23.607021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daab2e-6f53-41ac-adc1-64fa072321f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:23.607304 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daab2e-6f53-41ac-adc1-64fa072321f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:23.608055 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28daab2e-6f53-41ac-adc1-64fa072321f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:23.608365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28daab2e-6f53-41ac-adc1-64fa072321f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:23.609739 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28daab2e-6f53-41ac-adc1-64fa072321f5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:23.621727 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 297/597] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:23.622492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28daab2e-6f53-41ac-adc1-64fa072321f5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:23.669005 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d900a0-8a21-437d-9865-1a487fd24d31 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:23.699568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dbd98-524d-4075-b922-c87abb528624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:23.700375 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dbd98-524d-4075-b922-c87abb528624 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:23.700652 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dbd98-524d-4075-b922-c87abb528624 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:23.700924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dbd98-524d-4075-b922-c87abb528624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:23.710722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dbd98-524d-4075-b922-c87abb528624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:23.712169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dbd98-524d-4075-b922-c87abb528624 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:23.715812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28daab2e-6f53-41ac-adc1-64fa072321f5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:23.728918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-f50dbd98-524d-4075-b922-c87abb528624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:23.728918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:23.728918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:23.728918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:23.728918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:23.728918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:23.728918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:23.728918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:23.728918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:23.728918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:23.728918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:23.728918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:23.728918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:23.728918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:23.728918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:23.730648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:23.732042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:23.732042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:23.732042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:23.732042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:23.732042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 301/598] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:23.732042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f146a83-990a-44c0-a304-9b3f6a0251d6 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:23.732444 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f146a83-990a-44c0-a304-9b3f6a0251d6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:23.732444 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f146a83-990a-44c0-a304-9b3f6a0251d6 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:23.733553 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 302/599] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:23.734323 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f146a83-990a-44c0-a304-9b3f6a0251d6 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:23.754117 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec8d4b-3c38-45b8-8e53-5e85c30bbc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:23.755002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec8d4b-3c38-45b8-8e53-5e85c30bbc01 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:23.755275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec8d4b-3c38-45b8-8e53-5e85c30bbc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:23.755542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec8d4b-3c38-45b8-8e53-5e85c30bbc01 None admin] PATH_INFO: `/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/97e0aa0cdd8544ca9e16d1af3bff411f/roles/958871a8463d49d89ddade803adb47c4` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:23.769457 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec8d4b-3c38-45b8-8e53-5e85c30bbc01 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2b356e72cf84d099f2ce8678103ecef, user_id=97e0aa0cdd8544ca9e16d1af3bff411f, role_id=958871a8463d49d89ddade803adb47c4)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:23.770878 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec8d4b-3c38-45b8-8e53-5e85c30bbc01 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:23.783373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 298/600] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:57:23 2022] PUT /identity/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/97e0aa0cdd8544ca9e16d1af3bff411f/roles/958871a8463d49d89ddade803adb47c4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:57:23.784391 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec8d4b-3c38-45b8-8e53-5e85c30bbc01 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:23.836068 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f146a83-990a-44c0-a304-9b3f6a0251d6 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:23.872707 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353f49c-2bda-45d0-936f-a9fd26dc74c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:23.873601 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353f49c-2bda-45d0-936f-a9fd26dc74c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:23.873875 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353f49c-2bda-45d0-936f-a9fd26dc74c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:23.874143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353f49c-2bda-45d0-936f-a9fd26dc74c5 None admin] PATH_INFO: `/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/5becb135afbd43e9bc0b1347ba04e2b5/roles/958871a8463d49d89ddade803adb47c4` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:23.890672 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec8d4b-3c38-45b8-8e53-5e85c30bbc01 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:23.891184 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353f49c-2bda-45d0-936f-a9fd26dc74c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2b356e72cf84d099f2ce8678103ecef, user_id=5becb135afbd43e9bc0b1347ba04e2b5, role_id=958871a8463d49d89ddade803adb47c4)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:23.892799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353f49c-2bda-45d0-936f-a9fd26dc74c5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:23.919642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 303/601] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:57:23 2022] PUT /identity/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/5becb135afbd43e9bc0b1347ba04e2b5/roles/958871a8463d49d89ddade803adb47c4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:57:23.919642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353f49c-2bda-45d0-936f-a9fd26dc74c5 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:23.928824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93146401-17d6-4b80-b88b-14bcbea1dac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:23.929654 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93146401-17d6-4b80-b88b-14bcbea1dac0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:23.929934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93146401-17d6-4b80-b88b-14bcbea1dac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:23.930206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93146401-17d6-4b80-b88b-14bcbea1dac0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:23.939532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93146401-17d6-4b80-b88b-14bcbea1dac0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:23.941083 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93146401-17d6-4b80-b88b-14bcbea1dac0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:23.956951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-93146401-17d6-4b80-b88b-14bcbea1dac0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:23.956951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:23.956951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:23.956951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:23.956951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:23.956951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:23.956951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:23.956951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:23.956951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:23.956951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:23.956951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:23.956951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:23.956951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:23.956951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:23.956951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:23.958068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:23.959167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:23.959167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:23.959167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:23.959167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:23.959167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:23.959167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:23.959167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:23.959167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:23.959167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 299/602] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:23.959794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cf0f3-cf09-4c55-80e8-6a6e70a36f87 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:23.961788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cf0f3-cf09-4c55-80e8-6a6e70a36f87 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:23.961788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cf0f3-cf09-4c55-80e8-6a6e70a36f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:23.981606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-823cf0f3-cf09-4c55-80e8-6a6e70a36f87 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:23.982819 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-823cf0f3-cf09-4c55-80e8-6a6e70a36f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:24.038488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353f49c-2bda-45d0-936f-a9fd26dc74c5 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:24.060732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 300/603] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:24.062001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cf0f3-cf09-4c55-80e8-6a6e70a36f87 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:24.085085 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d7eb9-5c5a-4d47-af64-667176270649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:24.085960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d7eb9-5c5a-4d47-af64-667176270649 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:24.086420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d7eb9-5c5a-4d47-af64-667176270649 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:24.086737 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d7eb9-5c5a-4d47-af64-667176270649 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:24.090837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d7eb9-5c5a-4d47-af64-667176270649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:24.090837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d7eb9-5c5a-4d47-af64-667176270649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:24.091814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d7eb9-5c5a-4d47-af64-667176270649 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:24.113627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 304/604] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:24.114851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d7eb9-5c5a-4d47-af64-667176270649 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:24.211985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cf0f3-cf09-4c55-80e8-6a6e70a36f87 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:24.222603 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d7eb9-5c5a-4d47-af64-667176270649 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:24.255578 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aebda-90ac-42e9-9253-600d7e291c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:24.256443 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aebda-90ac-42e9-9253-600d7e291c2d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:24.256822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aebda-90ac-42e9-9253-600d7e291c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:24.257046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a2961-6ec4-406c-a0ca-b87675dc501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:24.257280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aebda-90ac-42e9-9253-600d7e291c2d None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:24.257844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a2961-6ec4-406c-a0ca-b87675dc501d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:24.258123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a2961-6ec4-406c-a0ca-b87675dc501d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:24.258325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99aebda-90ac-42e9-9253-600d7e291c2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:24.258435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a2961-6ec4-406c-a0ca-b87675dc501d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:24.258818 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99aebda-90ac-42e9-9253-600d7e291c2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:24.260470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99aebda-90ac-42e9-9253-600d7e291c2d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:24.269106 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a2961-6ec4-406c-a0ca-b87675dc501d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:24.273364 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 301/605] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:24.274271 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aebda-90ac-42e9-9253-600d7e291c2d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d44a2961-6ec4-406c-a0ca-b87675dc501d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:24.282004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:24.282961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:24.284239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:24.284239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:24.284239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:24.284239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:24.284239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:24.284239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:24.284239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:24.284239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:24.284239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:24.284239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:24.284239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:24.284239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:24.284239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 305/606] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:24.286016 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a2961-6ec4-406c-a0ca-b87675dc501d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:24.383495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aebda-90ac-42e9-9253-600d7e291c2d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:24.385832 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a2961-6ec4-406c-a0ca-b87675dc501d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:24.419476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6a4b6-26f5-47a2-a5dd-cffc70e825f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:24.420424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6a4b6-26f5-47a2-a5dd-cffc70e825f9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:24.420708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6a4b6-26f5-47a2-a5dd-cffc70e825f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:24.420979 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6a4b6-26f5-47a2-a5dd-cffc70e825f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:24.423543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede849c-08de-4632-af8c-2534ba3ac78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:24.424680 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede849c-08de-4632-af8c-2534ba3ac78e None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:24.425179 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede849c-08de-4632-af8c-2534ba3ac78e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:24.425669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede849c-08de-4632-af8c-2534ba3ac78e None admin] PATH_INFO: `/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/b25519cdc25244a0b039ce3097c328d8/roles/958871a8463d49d89ddade803adb47c4` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:24.428260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6a4b6-26f5-47a2-a5dd-cffc70e825f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:24.430092 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6a4b6-26f5-47a2-a5dd-cffc70e825f9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:24.442403 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede849c-08de-4632-af8c-2534ba3ac78e None admin] RBAC: Authorizing `identity:create_grant(project_id=b2b356e72cf84d099f2ce8678103ecef, user_id=b25519cdc25244a0b039ce3097c328d8, role_id=958871a8463d49d89ddade803adb47c4)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:24.444206 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede849c-08de-4632-af8c-2534ba3ac78e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:24.445932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-f8e6a4b6-26f5-47a2-a5dd-cffc70e825f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:24.445932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:24.445932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:24.445932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:24.445932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:24.445932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:24.445932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:24.445932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:24.445932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:24.445932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:24.445932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:24.445932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:24.445932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:24.445932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:24.445932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:24.446977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:24.448089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:24.448089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:24.448089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:24.448089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:24.448089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:24.448089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:24.448089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:24.448089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:24.451741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 302/607] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:24.452807 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6a4b6-26f5-47a2-a5dd-cffc70e825f9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:24.468044 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 306/608] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:57:24 2022] PUT /identity/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/b25519cdc25244a0b039ce3097c328d8/roles/958871a8463d49d89ddade803adb47c4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:57:24.469273 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede849c-08de-4632-af8c-2534ba3ac78e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:24.567446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6a4b6-26f5-47a2-a5dd-cffc70e825f9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:24.575993 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede849c-08de-4632-af8c-2534ba3ac78e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:24.605917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f641a-77e2-4075-ac3c-f062176ce849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:24.606604 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f641a-77e2-4075-ac3c-f062176ce849 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:24.606881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f641a-77e2-4075-ac3c-f062176ce849 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:24.607153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f641a-77e2-4075-ac3c-f062176ce849 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:24.607949 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f641a-77e2-4075-ac3c-f062176ce849 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:24.608250 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f641a-77e2-4075-ac3c-f062176ce849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:24.609650 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f641a-77e2-4075-ac3c-f062176ce849 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:24.619383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 303/609] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:24.631629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f641a-77e2-4075-ac3c-f062176ce849 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:24.653299 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bb79b-3233-4f62-8987-b1208f3e3db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:24.654238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bb79b-3233-4f62-8987-b1208f3e3db6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:24.654682 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bb79b-3233-4f62-8987-b1208f3e3db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:24.655104 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bb79b-3233-4f62-8987-b1208f3e3db6 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:24.656090 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bb79b-3233-4f62-8987-b1208f3e3db6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:24.656547 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bb79b-3233-4f62-8987-b1208f3e3db6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:24.658169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bb79b-3233-4f62-8987-b1208f3e3db6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:24.683706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 307/610] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:24.685521 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bb79b-3233-4f62-8987-b1208f3e3db6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:24.730574 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f641a-77e2-4075-ac3c-f062176ce849 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:24.764829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e55fc4-be3d-40b5-a59a-3554bac7de81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:24.765638 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e55fc4-be3d-40b5-a59a-3554bac7de81 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:24.765911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e55fc4-be3d-40b5-a59a-3554bac7de81 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:24.766184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e55fc4-be3d-40b5-a59a-3554bac7de81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:24.777583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e55fc4-be3d-40b5-a59a-3554bac7de81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:24.779031 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e55fc4-be3d-40b5-a59a-3554bac7de81 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:24.788868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bb79b-3233-4f62-8987-b1208f3e3db6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:24.797022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a6e55fc4-be3d-40b5-a59a-3554bac7de81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:24.797022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:24.797022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:24.797022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:24.797022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:24.797022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:24.797022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:24.797022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:24.797022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:24.797022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:24.797022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:24.797022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:24.797022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:24.797022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:24.797022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:24.798102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:24.799115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:24.799115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:24.799115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:24.799115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:24.799115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 304/611] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:24.803914 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e55fc4-be3d-40b5-a59a-3554bac7de81 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:24.824789 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb127e-7900-4ca0-acf3-06532ad712b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:24.825728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb127e-7900-4ca0-acf3-06532ad712b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:24.826013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb127e-7900-4ca0-acf3-06532ad712b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:24.826285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb127e-7900-4ca0-acf3-06532ad712b7 None admin] PATH_INFO: `/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/5819e022286b454e9e2f23d975c6e921/roles/958871a8463d49d89ddade803adb47c4` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:24.841468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb127e-7900-4ca0-acf3-06532ad712b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2b356e72cf84d099f2ce8678103ecef, user_id=5819e022286b454e9e2f23d975c6e921, role_id=958871a8463d49d89ddade803adb47c4)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:24.843051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb127e-7900-4ca0-acf3-06532ad712b7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:24.860500 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 308/612] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:57:24 2022] PUT /identity/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/5819e022286b454e9e2f23d975c6e921/roles/958871a8463d49d89ddade803adb47c4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 16:57:24.912386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e55fc4-be3d-40b5-a59a-3554bac7de81 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:24.947917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44215d64-4030-4997-af2d-26ed313b09a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:24.949139 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44215d64-4030-4997-af2d-26ed313b09a3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:24.949424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44215d64-4030-4997-af2d-26ed313b09a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:24.949736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44215d64-4030-4997-af2d-26ed313b09a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:24.950510 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44215d64-4030-4997-af2d-26ed313b09a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:24.950811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44215d64-4030-4997-af2d-26ed313b09a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:24.952388 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44215d64-4030-4997-af2d-26ed313b09a3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:24.965836 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 305/613] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:24.971361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb127e-7900-4ca0-acf3-06532ad712b7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:25.113918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb127e-7900-4ca0-acf3-06532ad712b7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:25.152487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ceeee-9760-457b-b7bc-d82903d00583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:25.153432 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ceeee-9760-457b-b7bc-d82903d00583 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:25.153814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ceeee-9760-457b-b7bc-d82903d00583 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:25.154195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ceeee-9760-457b-b7bc-d82903d00583 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:25.161701 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ceeee-9760-457b-b7bc-d82903d00583 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:25.163375 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ceeee-9760-457b-b7bc-d82903d00583 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-fb1ceeee-9760-457b-b7bc-d82903d00583 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:25.178872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:25.180103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:25.181154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:25.181154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:25.181154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:25.181154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:25.181154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:25.181154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:25.181154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:25.181154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:25.181154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 16:57:25.181154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:25.183818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 309/614] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:57:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:25.189000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44215d64-4030-4997-af2d-26ed313b09a3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:25.305745 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44215d64-4030-4997-af2d-26ed313b09a3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:25.341137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6b258-cc90-4a31-8f27-e24717ee5556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:25.341805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6b258-cc90-4a31-8f27-e24717ee5556 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:25.342257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6b258-cc90-4a31-8f27-e24717ee5556 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:25.342539 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6b258-cc90-4a31-8f27-e24717ee5556 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:25.343372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6b258-cc90-4a31-8f27-e24717ee5556 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:25.343703 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6b258-cc90-4a31-8f27-e24717ee5556 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:25.345133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6b258-cc90-4a31-8f27-e24717ee5556 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:25.363710 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 306/615] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 17 16:57:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:25.372685 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ceeee-9760-457b-b7bc-d82903d00583 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:25.508678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ceeee-9760-457b-b7bc-d82903d00583 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:25.547110 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edee85-55a3-46e7-8c4f-8e98b981a3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:25.547939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edee85-55a3-46e7-8c4f-8e98b981a3ca None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:25.548271 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edee85-55a3-46e7-8c4f-8e98b981a3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:25.548550 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edee85-55a3-46e7-8c4f-8e98b981a3ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:25.561963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edee85-55a3-46e7-8c4f-8e98b981a3ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:25.563678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edee85-55a3-46e7-8c4f-8e98b981a3ca None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:25.589073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-07edee85-55a3-46e7-8c4f-8e98b981a3ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:25.589073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:25.589073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:25.589073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:25.589073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:25.589073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:25.589073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:25.589073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:25.589073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:25.589073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:25.589073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:25.589073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:25.589073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:25.589073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:25.589073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:25.590253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:25.592108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:25.592108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:25.592108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:25.592108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:25.592108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 310/616] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:25.597720 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6b258-cc90-4a31-8f27-e24717ee5556 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:25.731714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6b258-cc90-4a31-8f27-e24717ee5556 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:25.778818 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6b8e6-d56a-4e01-9ce8-ae383c8ad902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:25.779408 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6b8e6-d56a-4e01-9ce8-ae383c8ad902 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:25.779718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6b8e6-d56a-4e01-9ce8-ae383c8ad902 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:25.779996 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6b8e6-d56a-4e01-9ce8-ae383c8ad902 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:25.780710 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6b8e6-d56a-4e01-9ce8-ae383c8ad902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:25.781017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6b8e6-d56a-4e01-9ce8-ae383c8ad902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:25.782437 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6b8e6-d56a-4e01-9ce8-ae383c8ad902 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:25.797923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 307/617] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:25.803200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edee85-55a3-46e7-8c4f-8e98b981a3ca None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:25.911890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edee85-55a3-46e7-8c4f-8e98b981a3ca None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:25.951250 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b179c2d-a0c6-4dae-9259-0260379e6e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:25.952081 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b179c2d-a0c6-4dae-9259-0260379e6e24 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:25.952364 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b179c2d-a0c6-4dae-9259-0260379e6e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:25.952642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b179c2d-a0c6-4dae-9259-0260379e6e24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:25.962391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b179c2d-a0c6-4dae-9259-0260379e6e24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:25.963864 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b179c2d-a0c6-4dae-9259-0260379e6e24 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:25.981586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-2b179c2d-a0c6-4dae-9259-0260379e6e24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:25.981586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:25.981586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:25.981586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:25.981586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:25.981586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:25.981586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:25.981586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:25.981586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:25.981586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:25.981586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:25.981586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:25.981586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:25.981586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:25.981586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:25.982531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:25.983411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:25.983411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:25.983411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:25.983411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:25.983411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:25.983411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:25.983411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:25.983411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:25.983411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 311/618] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:25.988472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6b8e6-d56a-4e01-9ce8-ae383c8ad902 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:26.123856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6b8e6-d56a-4e01-9ce8-ae383c8ad902 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:26.168009 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e77df-6310-4bbf-816b-41f30d2d60ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:26.169061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e77df-6310-4bbf-816b-41f30d2d60ed None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:26.169548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e77df-6310-4bbf-816b-41f30d2d60ed None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:26.170022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e77df-6310-4bbf-816b-41f30d2d60ed None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:26.171024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e77df-6310-4bbf-816b-41f30d2d60ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:26.171532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e77df-6310-4bbf-816b-41f30d2d60ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:26.173191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e77df-6310-4bbf-816b-41f30d2d60ed None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:26.194412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 308/619] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:26.200662 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b179c2d-a0c6-4dae-9259-0260379e6e24 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:26.326636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b179c2d-a0c6-4dae-9259-0260379e6e24 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:26.363227 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f6e22-6a3a-4eae-b918-263c4cef0e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:26.364076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f6e22-6a3a-4eae-b918-263c4cef0e3e None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:26.364359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f6e22-6a3a-4eae-b918-263c4cef0e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:26.364637 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f6e22-6a3a-4eae-b918-263c4cef0e3e None admin] PATH_INFO: `/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/bc87aba3662244bea0428475bb0c9e8b/roles/958871a8463d49d89ddade803adb47c4` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:26.384283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f6e22-6a3a-4eae-b918-263c4cef0e3e None admin] RBAC: Authorizing `identity:create_grant(project_id=b2b356e72cf84d099f2ce8678103ecef, user_id=bc87aba3662244bea0428475bb0c9e8b, role_id=958871a8463d49d89ddade803adb47c4)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:26.385726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f6e22-6a3a-4eae-b918-263c4cef0e3e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:26.412983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 312/620] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:57:26 2022] PUT /identity/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/bc87aba3662244bea0428475bb0c9e8b/roles/958871a8463d49d89ddade803adb47c4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:57:26.498643 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88799ec5-271d-473f-8d29-18c36621935c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:26.499317 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88799ec5-271d-473f-8d29-18c36621935c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:26.499830 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88799ec5-271d-473f-8d29-18c36621935c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:26.501760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 309/621] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:26.507171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d81604-ed6a-45b4-aa46-25f4d4696320 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:26.507457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d81604-ed6a-45b4-aa46-25f4d4696320 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:26.507764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d81604-ed6a-45b4-aa46-25f4d4696320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:26.531169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-93d81604-ed6a-45b4-aa46-25f4d4696320 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:26.532441 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-93d81604-ed6a-45b4-aa46-25f4d4696320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:26.628381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 313/622] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:26.663715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88799ec5-271d-473f-8d29-18c36621935c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:26.805005 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88799ec5-271d-473f-8d29-18c36621935c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:26.857734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c1326-7a71-4956-b64f-20b5af96efc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:26.858545 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c1326-7a71-4956-b64f-20b5af96efc6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:26.858830 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c1326-7a71-4956-b64f-20b5af96efc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:26.859106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c1326-7a71-4956-b64f-20b5af96efc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:26.874173 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c1326-7a71-4956-b64f-20b5af96efc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-316c1326-7a71-4956-b64f-20b5af96efc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:26.882590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:26.883511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:26.884393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:26.884393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:26.884393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:26.884393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:26.884393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:26.884393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:26.884393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:26.884393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:26.884393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:26.884393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:26.884393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:26.884393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:26.891631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 310/623] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:26.896066 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d81604-ed6a-45b4-aa46-25f4d4696320 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:26.926002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448f367-c275-4320-9b1d-7ddec14515b4 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:26.926703 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448f367-c275-4320-9b1d-7ddec14515b4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:26.927191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448f367-c275-4320-9b1d-7ddec14515b4 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:26.929093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 311/624] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:26.936591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726924dd-c858-4f9d-b54e-1a9875576d02 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:26.937175 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726924dd-c858-4f9d-b54e-1a9875576d02 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:26.937892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726924dd-c858-4f9d-b54e-1a9875576d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:26.960790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-726924dd-c858-4f9d-b54e-1a9875576d02 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:26.967690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-726924dd-c858-4f9d-b54e-1a9875576d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:27.065103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d81604-ed6a-45b4-aa46-25f4d4696320 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:27.073331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 312/625] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:27.109837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566168-b8dc-44e8-843f-d005ae793ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:27.111202 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726924dd-c858-4f9d-b54e-1a9875576d02 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:27.112136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566168-b8dc-44e8-843f-d005ae793ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:27.114452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566168-b8dc-44e8-843f-d005ae793ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:27.115006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566168-b8dc-44e8-843f-d005ae793ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:27.116000 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4566168-b8dc-44e8-843f-d005ae793ab2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:27.116546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4566168-b8dc-44e8-843f-d005ae793ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:27.118374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4566168-b8dc-44e8-843f-d005ae793ab2 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:27.142631 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 314/626] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:27.149974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566168-b8dc-44e8-843f-d005ae793ab2 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:27.250205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726924dd-c858-4f9d-b54e-1a9875576d02 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:27.260213 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566168-b8dc-44e8-843f-d005ae793ab2 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:27.286157 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d8d8e-e7bc-40df-94b2-28868461b6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:27.286891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d8d8e-e7bc-40df-94b2-28868461b6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:27.287169 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d8d8e-e7bc-40df-94b2-28868461b6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:27.287441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d8d8e-e7bc-40df-94b2-28868461b6e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:27.299439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d8d8e-e7bc-40df-94b2-28868461b6e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:27.300647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf5421-c73e-45a5-b44d-e4ad3678f1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:27.301734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf5421-c73e-45a5-b44d-e4ad3678f1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:27.302300 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf5421-c73e-45a5-b44d-e4ad3678f1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:27.302785 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf5421-c73e-45a5-b44d-e4ad3678f1d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-550d8d8e-e7bc-40df-94b2-28868461b6e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:27.307581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:27.309791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:27.310652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:27.310652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:27.310652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:27.310652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:27.310652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:27.310652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:27.310652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:27.310652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:27.310652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:27.310652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:27.310652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:27.310652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:27.310652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 313/627] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:27.315235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d8d8e-e7bc-40df-94b2-28868461b6e7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:27.320129 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf5421-c73e-45a5-b44d-e4ad3678f1d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:27.321766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf5421-c73e-45a5-b44d-e4ad3678f1d8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:27.340749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-becf5421-c73e-45a5-b44d-e4ad3678f1d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:27.340749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:27.340749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:27.340749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:27.340749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:27.340749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:27.340749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:27.340749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:27.340749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:27.340749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:27.340749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:27.340749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:27.340749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:27.340749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:27.340749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:27.341853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:27.342930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:27.342930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:27.342930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:27.342930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:27.344891 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 315/628] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:27.350542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e926d-e052-421e-869d-7a3c47796961 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:27.351069 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e926d-e052-421e-869d-7a3c47796961 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:27.351517 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e926d-e052-421e-869d-7a3c47796961 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:27.353274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 316/629] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:27.354135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e926d-e052-421e-869d-7a3c47796961 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:27.422106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d8d8e-e7bc-40df-94b2-28868461b6e7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:27.463296 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef556f9a-f438-45f8-bcd0-60ca757ae2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:27.464303 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556f9a-f438-45f8-bcd0-60ca757ae2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:27.464303 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556f9a-f438-45f8-bcd0-60ca757ae2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:27.464917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556f9a-f438-45f8-bcd0-60ca757ae2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:27.465569 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef556f9a-f438-45f8-bcd0-60ca757ae2e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:27.465876 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef556f9a-f438-45f8-bcd0-60ca757ae2e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:27.468068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef556f9a-f438-45f8-bcd0-60ca757ae2e4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:27.474514 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e926d-e052-421e-869d-7a3c47796961 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:27.482910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 314/630] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:27.485109 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244328bd-3e63-4fc9-abd3-4f65ddf0e017 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:27.485401 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244328bd-3e63-4fc9-abd3-4f65ddf0e017 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:27.485697 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244328bd-3e63-4fc9-abd3-4f65ddf0e017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:27.509420 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-244328bd-3e63-4fc9-abd3-4f65ddf0e017 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:27.510850 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-244328bd-3e63-4fc9-abd3-4f65ddf0e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:27.517823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce80cd0-114d-44e2-a4ef-f05f2681b3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:27.518864 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce80cd0-114d-44e2-a4ef-f05f2681b3be None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:27.519332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce80cd0-114d-44e2-a4ef-f05f2681b3be None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:27.519896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce80cd0-114d-44e2-a4ef-f05f2681b3be None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:27.520828 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce80cd0-114d-44e2-a4ef-f05f2681b3be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:27.521359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce80cd0-114d-44e2-a4ef-f05f2681b3be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:27.522971 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce80cd0-114d-44e2-a4ef-f05f2681b3be None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:27.540830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 317/631] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:27.543004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce80cd0-114d-44e2-a4ef-f05f2681b3be None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:27.595701 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 315/632] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:27.596944 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244328bd-3e63-4fc9-abd3-4f65ddf0e017 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:27.666739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce80cd0-114d-44e2-a4ef-f05f2681b3be None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:27.702007 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd752b-367f-4ac5-94f4-2896259442a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:27.703122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd752b-367f-4ac5-94f4-2896259442a5 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:27.703483 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd752b-367f-4ac5-94f4-2896259442a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:27.703856 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd752b-367f-4ac5-94f4-2896259442a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:27.710287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244328bd-3e63-4fc9-abd3-4f65ddf0e017 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:27.715219 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd752b-367f-4ac5-94f4-2896259442a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:27.716793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd752b-367f-4ac5-94f4-2896259442a5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:27.734806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-21bd752b-367f-4ac5-94f4-2896259442a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:27.734806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:27.734806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:27.734806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:27.734806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:27.734806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:27.734806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:27.734806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:27.734806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:27.734806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:27.734806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:27.734806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:27.734806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:27.734806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:27.734806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:27.735944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:27.741548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:27.741548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:27.741548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:27.741548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:27.741548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 318/633] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:27.741548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd752b-367f-4ac5-94f4-2896259442a5 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:27.751156 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c406e-c441-4888-ac05-802426e7a466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:27.752071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c406e-c441-4888-ac05-802426e7a466 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:27.752422 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c406e-c441-4888-ac05-802426e7a466 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:27.752765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c406e-c441-4888-ac05-802426e7a466 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:27.759957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c406e-c441-4888-ac05-802426e7a466 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:27.762067 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c406e-c441-4888-ac05-802426e7a466 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-743c406e-c441-4888-ac05-802426e7a466 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:27.776307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:27.777476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:27.778636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:27.778636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:27.778636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:27.778636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:27.778636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:27.778636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:27.778636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:27.778636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:27.778636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 16:57:27.778636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:27.779211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 316/634] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 16:57:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:27.780274 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7198d06-e3de-46e6-a12c-999837e2abb2 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:27.780553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7198d06-e3de-46e6-a12c-999837e2abb2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:27.780826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7198d06-e3de-46e6-a12c-999837e2abb2 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:27.782211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 317/635] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:27.784312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7198d06-e3de-46e6-a12c-999837e2abb2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:27.848096 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd752b-367f-4ac5-94f4-2896259442a5 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:27.881997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7198d06-e3de-46e6-a12c-999837e2abb2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:27.884032 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5f202-c312-4fb9-be82-bc55f9b9a8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:27.884826 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5f202-c312-4fb9-be82-bc55f9b9a8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:27.885105 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5f202-c312-4fb9-be82-bc55f9b9a8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:27.885376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5f202-c312-4fb9-be82-bc55f9b9a8b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:27.895637 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5f202-c312-4fb9-be82-bc55f9b9a8b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-65f5f202-c312-4fb9-be82-bc55f9b9a8b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:27.903897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:27.904814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:27.905644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:27.905644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:27.905644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:27.905644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:27.905644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:27.905644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:27.905644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:27.905644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:27.905644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:27.905644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:27.905644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:27.905644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:27.905644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 319/636] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:27.906887 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5f202-c312-4fb9-be82-bc55f9b9a8b7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:27.920629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23d6dd-b4bd-4f0f-9027-0286c7342d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:27.921298 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23d6dd-b4bd-4f0f-9027-0286c7342d97 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:27.921579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23d6dd-b4bd-4f0f-9027-0286c7342d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:27.921861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23d6dd-b4bd-4f0f-9027-0286c7342d97 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:27.922581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23d6dd-b4bd-4f0f-9027-0286c7342d97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:27.922889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23d6dd-b4bd-4f0f-9027-0286c7342d97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:27.924301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23d6dd-b4bd-4f0f-9027-0286c7342d97 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:27.935462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 318/637] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:27.941097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d9dc1-0ef9-46ba-bf68-2ea9e6d650b8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:27.941389 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d9dc1-0ef9-46ba-bf68-2ea9e6d650b8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:27.941670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d9dc1-0ef9-46ba-bf68-2ea9e6d650b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:27.957748 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4d1d9dc1-0ef9-46ba-bf68-2ea9e6d650b8 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:27.958843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4d1d9dc1-0ef9-46ba-bf68-2ea9e6d650b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:28.005210 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5f202-c312-4fb9-be82-bc55f9b9a8b7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:28.025860 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 319/638] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:28.026805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d9dc1-0ef9-46ba-bf68-2ea9e6d650b8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:28.055124 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6e173-7a12-46ce-a18f-7874c921b0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:28.055844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6e173-7a12-46ce-a18f-7874c921b0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:28.056129 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6e173-7a12-46ce-a18f-7874c921b0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:28.056406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6e173-7a12-46ce-a18f-7874c921b0f6 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:28.057234 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6e173-7a12-46ce-a18f-7874c921b0f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:28.057547 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6e173-7a12-46ce-a18f-7874c921b0f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:28.059232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6e173-7a12-46ce-a18f-7874c921b0f6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:28.076833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 320/639] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 16:57:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:28.077649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6e173-7a12-46ce-a18f-7874c921b0f6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:28.133966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d9dc1-0ef9-46ba-bf68-2ea9e6d650b8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:28.168736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b918f-fe53-4c37-8bab-35f6ac0b2ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:28.169845 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b918f-fe53-4c37-8bab-35f6ac0b2ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:28.170134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b918f-fe53-4c37-8bab-35f6ac0b2ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:28.170409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b918f-fe53-4c37-8bab-35f6ac0b2ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:28.171438 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b918f-fe53-4c37-8bab-35f6ac0b2ab9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:28.171775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b918f-fe53-4c37-8bab-35f6ac0b2ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:28.173612 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b918f-fe53-4c37-8bab-35f6ac0b2ab9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:28.181232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6e173-7a12-46ce-a18f-7874c921b0f6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:28.185185 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 320/640] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:28.186144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b918f-fe53-4c37-8bab-35f6ac0b2ab9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:28.217971 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb352-38f0-4a4c-8b2e-9a8f08f1bae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:28.218884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb352-38f0-4a4c-8b2e-9a8f08f1bae7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:28.219455 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb352-38f0-4a4c-8b2e-9a8f08f1bae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:28.219764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb352-38f0-4a4c-8b2e-9a8f08f1bae7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:28.227142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bb352-38f0-4a4c-8b2e-9a8f08f1bae7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:28.228697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bb352-38f0-4a4c-8b2e-9a8f08f1bae7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-f82bb352-38f0-4a4c-8b2e-9a8f08f1bae7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:28.244073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:28.245023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:28.246054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:28.246054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:28.246054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:28.246054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:28.246054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:28.246054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:28.246054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:28.246054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:28.246054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 16:57:28.246054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:28.246054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 321/641] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:28.246054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb352-38f0-4a4c-8b2e-9a8f08f1bae7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:28.289911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b918f-fe53-4c37-8bab-35f6ac0b2ab9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:28.325144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246b46f-754d-403e-9402-b4fae1e20c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:28.325942 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246b46f-754d-403e-9402-b4fae1e20c7c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:28.326222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246b46f-754d-403e-9402-b4fae1e20c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:28.326495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246b46f-754d-403e-9402-b4fae1e20c7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:28.336527 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246b46f-754d-403e-9402-b4fae1e20c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-e246b46f-754d-403e-9402-b4fae1e20c7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:28.344899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:28.345883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:28.346726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:28.346726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:28.346726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:28.346726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:28.346726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:28.346726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:28.346726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:28.346726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:28.346726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:28.346726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:28.346726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:28.346726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:28.350810 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 321/642] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:28.351722 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246b46f-754d-403e-9402-b4fae1e20c7c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:28.352566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb352-38f0-4a4c-8b2e-9a8f08f1bae7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:28.386400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733093b7-30bf-4656-a87c-aa69b8a5af16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:28.387368 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733093b7-30bf-4656-a87c-aa69b8a5af16 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:28.387676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733093b7-30bf-4656-a87c-aa69b8a5af16 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:28.387953 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733093b7-30bf-4656-a87c-aa69b8a5af16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:28.448438 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246b46f-754d-403e-9402-b4fae1e20c7c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:28.452242 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733093b7-30bf-4656-a87c-aa69b8a5af16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:28.453696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733093b7-30bf-4656-a87c-aa69b8a5af16 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:28.482892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719d329-efa5-49f1-a1cd-8f0066f76fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:28.483620 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719d329-efa5-49f1-a1cd-8f0066f76fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:28.483929 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719d329-efa5-49f1-a1cd-8f0066f76fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:28.484200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719d329-efa5-49f1-a1cd-8f0066f76fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:28.494374 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719d329-efa5-49f1-a1cd-8f0066f76fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:28.495890 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719d329-efa5-49f1-a1cd-8f0066f76fa0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:28.512415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-2719d329-efa5-49f1-a1cd-8f0066f76fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:28.512415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:28.512415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:28.512415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:28.512415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:28.512415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:28.512415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:28.512415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:28.512415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:28.512415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:28.512415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:28.512415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:28.512415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:28.512415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:28.512415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:28.513509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:28.514872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:28.514872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:28.514872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:28.514872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:28.514872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 322/643] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:28.514872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719d329-efa5-49f1-a1cd-8f0066f76fa0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:28.559876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 322/644] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:28.559876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733093b7-30bf-4656-a87c-aa69b8a5af16 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:28.611120 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719d329-efa5-49f1-a1cd-8f0066f76fa0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:28.643432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7b60f-0095-47fa-9366-b65fe83742fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:28.644134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7b60f-0095-47fa-9366-b65fe83742fe None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:28.644415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7b60f-0095-47fa-9366-b65fe83742fe None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:28.644691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7b60f-0095-47fa-9366-b65fe83742fe None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:28.645526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7b60f-0095-47fa-9366-b65fe83742fe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:28.645829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7b60f-0095-47fa-9366-b65fe83742fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:28.647264 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7b60f-0095-47fa-9366-b65fe83742fe None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:28.655081 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733093b7-30bf-4656-a87c-aa69b8a5af16 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:28.669548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 323/645] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 17 16:57:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:28.669548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7b60f-0095-47fa-9366-b65fe83742fe None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:28.695371 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5f9b3-838b-4731-8918-bbae35e6f666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:28.696085 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5f9b3-838b-4731-8918-bbae35e6f666 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:28.696435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5f9b3-838b-4731-8918-bbae35e6f666 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:28.696778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5f9b3-838b-4731-8918-bbae35e6f666 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:28.697586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5f9b3-838b-4731-8918-bbae35e6f666 None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:28.697979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5f9b3-838b-4731-8918-bbae35e6f666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:28.699488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5f9b3-838b-4731-8918-bbae35e6f666 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:28.711963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 323/646] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:28.711963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5f9b3-838b-4731-8918-bbae35e6f666 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:28.769044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7b60f-0095-47fa-9366-b65fe83742fe None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:28.803259 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b533f2-2cda-4196-92dc-895fa0c80364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:28.803954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b533f2-2cda-4196-92dc-895fa0c80364 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:28.804234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b533f2-2cda-4196-92dc-895fa0c80364 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:28.804506 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b533f2-2cda-4196-92dc-895fa0c80364 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:28.805221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b533f2-2cda-4196-92dc-895fa0c80364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:28.805504 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5f9b3-838b-4731-8918-bbae35e6f666 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:28.805621 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b533f2-2cda-4196-92dc-895fa0c80364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:28.806916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b533f2-2cda-4196-92dc-895fa0c80364 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:28.819433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 324/647] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:28.819433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b533f2-2cda-4196-92dc-895fa0c80364 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:28.850781 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5823a-57f2-4ead-a185-872e0bbb87fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:28.853975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5823a-57f2-4ead-a185-872e0bbb87fb None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:28.854513 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5823a-57f2-4ead-a185-872e0bbb87fb None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:28.855472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5823a-57f2-4ead-a185-872e0bbb87fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:28.874967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5823a-57f2-4ead-a185-872e0bbb87fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:28.874967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5823a-57f2-4ead-a185-872e0bbb87fb None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:28.899163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-7cf5823a-57f2-4ead-a185-872e0bbb87fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:28.899163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:28.899163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:28.899163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:28.899163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:28.899163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:28.899163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:28.899163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:28.899163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:28.899163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:28.899163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:28.899163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:28.899163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:28.899163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:28.899163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:28.900401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:28.902154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:28.902154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:28.902154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:28.902154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:28.908863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 324/648] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:28.910180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5823a-57f2-4ead-a185-872e0bbb87fb None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:29.026140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5823a-57f2-4ead-a185-872e0bbb87fb None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:29.062369 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88478d45-4258-40e4-b4a5-d74a68bb80c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:29.063412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88478d45-4258-40e4-b4a5-d74a68bb80c4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:29.063716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88478d45-4258-40e4-b4a5-d74a68bb80c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:29.063994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88478d45-4258-40e4-b4a5-d74a68bb80c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:29.068515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b533f2-2cda-4196-92dc-895fa0c80364 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:29.074687 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88478d45-4258-40e4-b4a5-d74a68bb80c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:29.076170 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88478d45-4258-40e4-b4a5-d74a68bb80c4 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:29.093736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-88478d45-4258-40e4-b4a5-d74a68bb80c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:29.093736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:29.093736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:29.093736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:29.093736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:29.093736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:29.093736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:29.093736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:29.093736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:29.093736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:29.093736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:29.093736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:29.093736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:29.093736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:29.093736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:29.094748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:29.095868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:29.095868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:29.095868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:29.095868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:29.101653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 325/649] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:29.102612 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88478d45-4258-40e4-b4a5-d74a68bb80c4 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:29.114865 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23b0cb-2cfb-46e8-b252-ed7c351817b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:29.115707 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b0cb-2cfb-46e8-b252-ed7c351817b8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:29.116412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b0cb-2cfb-46e8-b252-ed7c351817b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:29.116788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b0cb-2cfb-46e8-b252-ed7c351817b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:29.202436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23b0cb-2cfb-46e8-b252-ed7c351817b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:29.204076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23b0cb-2cfb-46e8-b252-ed7c351817b8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:29.211874 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88478d45-4258-40e4-b4a5-d74a68bb80c4 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:29.246148 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20187e-85bc-4741-a488-c3c4d71ee150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:29.246945 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20187e-85bc-4741-a488-c3c4d71ee150 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:29.247239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20187e-85bc-4741-a488-c3c4d71ee150 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:29.247500 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20187e-85bc-4741-a488-c3c4d71ee150 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:29.254973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20187e-85bc-4741-a488-c3c4d71ee150 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:29.256457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20187e-85bc-4741-a488-c3c4d71ee150 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-7c20187e-85bc-4741-a488-c3c4d71ee150 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:29.270880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:29.272037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:29.273280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:29.273280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:29.273280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:29.273280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:29.273280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:29.273280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:29.273280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:29.273280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:29.273280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 16:57:29.273280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:29.273280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 326/650] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:29.273280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20187e-85bc-4741-a488-c3c4d71ee150 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:29.309410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 325/651] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:29.309410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23b0cb-2cfb-46e8-b252-ed7c351817b8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:29.366891 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20187e-85bc-4741-a488-c3c4d71ee150 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:29.396649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23b0cb-2cfb-46e8-b252-ed7c351817b8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:29.398294 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef2827-b1a7-4391-9226-9c9726f7b613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:29.398951 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef2827-b1a7-4391-9226-9c9726f7b613 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:29.399233 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef2827-b1a7-4391-9226-9c9726f7b613 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:29.399509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef2827-b1a7-4391-9226-9c9726f7b613 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:29.400279 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef2827-b1a7-4391-9226-9c9726f7b613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:29.400583 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef2827-b1a7-4391-9226-9c9726f7b613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:29.402690 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef2827-b1a7-4391-9226-9c9726f7b613 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:29.413836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 327/652] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:29.415055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ceda85-bbd4-44d0-84d0-1b695c12a569 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:29.415339 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ceda85-bbd4-44d0-84d0-1b695c12a569 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:29.415626 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ceda85-bbd4-44d0-84d0-1b695c12a569 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:29.416998 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 328/653] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:29.417641 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ceda85-bbd4-44d0-84d0-1b695c12a569 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:29.430491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c59da3-21ce-4b4c-ab2a-7900da2aab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:29.431152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c59da3-21ce-4b4c-ab2a-7900da2aab5b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:29.431428 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c59da3-21ce-4b4c-ab2a-7900da2aab5b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:29.431740 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c59da3-21ce-4b4c-ab2a-7900da2aab5b None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:29.432454 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c59da3-21ce-4b4c-ab2a-7900da2aab5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:29.432787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c59da3-21ce-4b4c-ab2a-7900da2aab5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:29.434146 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c59da3-21ce-4b4c-ab2a-7900da2aab5b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:29.445229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 326/654] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:29.446000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c59da3-21ce-4b4c-ab2a-7900da2aab5b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:29.516323 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ceda85-bbd4-44d0-84d0-1b695c12a569 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:29.538253 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c59da3-21ce-4b4c-ab2a-7900da2aab5b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:29.548282 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0811f2-31b6-4785-8ce3-751cb195cddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:29.548941 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0811f2-31b6-4785-8ce3-751cb195cddf None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:29.549222 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0811f2-31b6-4785-8ce3-751cb195cddf None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:29.549498 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0811f2-31b6-4785-8ce3-751cb195cddf None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:29.550318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0811f2-31b6-4785-8ce3-751cb195cddf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:29.550625 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0811f2-31b6-4785-8ce3-751cb195cddf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:29.552064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0811f2-31b6-4785-8ce3-751cb195cddf None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:29.568435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 329/655] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 17 16:57:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:29.569156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0811f2-31b6-4785-8ce3-751cb195cddf None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:29.572499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c5a43-0133-4e8e-a384-eb94a9b5219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:29.574041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c5a43-0133-4e8e-a384-eb94a9b5219b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:29.574325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c5a43-0133-4e8e-a384-eb94a9b5219b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:29.574595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c5a43-0133-4e8e-a384-eb94a9b5219b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:29.584947 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c5a43-0133-4e8e-a384-eb94a9b5219b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:29.586371 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c5a43-0133-4e8e-a384-eb94a9b5219b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:29.603094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-2c8c5a43-0133-4e8e-a384-eb94a9b5219b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:29.603094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:29.603094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:29.603094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:29.603094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:29.603094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:29.603094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:29.603094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:29.603094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:29.603094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:29.603094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:29.603094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:29.603094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:29.603094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:29.603094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:29.604008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:29.605106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:29.605106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:29.605106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:29.605106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:29.605106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 327/656] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:29.606013 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32848c-2eb7-4066-8b11-39766009e3b4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:29.606124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32848c-2eb7-4066-8b11-39766009e3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:29.606315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32848c-2eb7-4066-8b11-39766009e3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:29.621733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ec32848c-2eb7-4066-8b11-39766009e3b4 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:29.622990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ec32848c-2eb7-4066-8b11-39766009e3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:29.665529 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0811f2-31b6-4785-8ce3-751cb195cddf None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:29.686148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 328/657] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:29.686975 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32848c-2eb7-4066-8b11-39766009e3b4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:29.697331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0b8a7-9426-46e1-ac24-85296c0e3c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:29.698112 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0b8a7-9426-46e1-ac24-85296c0e3c78 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:29.699232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0b8a7-9426-46e1-ac24-85296c0e3c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:29.699508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0b8a7-9426-46e1-ac24-85296c0e3c78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:29.705954 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0b8a7-9426-46e1-ac24-85296c0e3c78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:29.707379 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0b8a7-9426-46e1-ac24-85296c0e3c78 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:29.720742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-5db0b8a7-9426-46e1-ac24-85296c0e3c78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:29.720742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:29.720742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:29.720742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:29.720742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:29.720742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:29.720742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:29.720742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:29.720742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:29.720742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:29.720742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:29.720742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:29.720742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:29.720742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:29.720742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:29.721800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:29.727811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:29.727811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:29.727811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:29.727811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:29.727811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:29.727811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:29.727811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:29.727811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:29.727811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 330/658] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:29.727811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0b8a7-9426-46e1-ac24-85296c0e3c78 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:29.780495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32848c-2eb7-4066-8b11-39766009e3b4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:29.812916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc713a-8dcc-4632-b9b3-6a3388a329fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:29.813956 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc713a-8dcc-4632-b9b3-6a3388a329fa None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:29.814233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc713a-8dcc-4632-b9b3-6a3388a329fa None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:29.814504 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc713a-8dcc-4632-b9b3-6a3388a329fa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:29.821305 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc713a-8dcc-4632-b9b3-6a3388a329fa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:29.821700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0b8a7-9426-46e1-ac24-85296c0e3c78 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:29.822690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc713a-8dcc-4632-b9b3-6a3388a329fa None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-57bc713a-8dcc-4632-b9b3-6a3388a329fa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:29.837631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:29.838767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:29.839990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:29.839990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:29.839990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:29.839990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:29.839990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:29.839990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:29.839990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:29.839990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:29.839990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 16:57:29.839990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:29.839990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 329/659] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:29.839990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc713a-8dcc-4632-b9b3-6a3388a329fa None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:29.857357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07392bf1-ad10-440a-8511-8841c8ec4325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:29.857995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07392bf1-ad10-440a-8511-8841c8ec4325 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:29.858274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07392bf1-ad10-440a-8511-8841c8ec4325 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:29.858548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07392bf1-ad10-440a-8511-8841c8ec4325 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:29.921698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07392bf1-ad10-440a-8511-8841c8ec4325 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:29.923130 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07392bf1-ad10-440a-8511-8841c8ec4325 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:29.930819 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc713a-8dcc-4632-b9b3-6a3388a329fa None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:29.962763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fcff1-7dfd-4fd8-9285-eae1a790c44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:29.963407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fcff1-7dfd-4fd8-9285-eae1a790c44b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:29.963717 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fcff1-7dfd-4fd8-9285-eae1a790c44b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:29.964035 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fcff1-7dfd-4fd8-9285-eae1a790c44b None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:29.964741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fcff1-7dfd-4fd8-9285-eae1a790c44b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:29.965130 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fcff1-7dfd-4fd8-9285-eae1a790c44b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:29.966475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fcff1-7dfd-4fd8-9285-eae1a790c44b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:29.977416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 330/660] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:29.978188 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fcff1-7dfd-4fd8-9285-eae1a790c44b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:30.019807 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 331/661] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:30.020636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07392bf1-ad10-440a-8511-8841c8ec4325 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:30.073183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fcff1-7dfd-4fd8-9285-eae1a790c44b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:30.105153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bc5be-d9eb-4bd7-95ee-64f0f1a57789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:30.105984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bc5be-d9eb-4bd7-95ee-64f0f1a57789 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:30.106257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bc5be-d9eb-4bd7-95ee-64f0f1a57789 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:30.106525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bc5be-d9eb-4bd7-95ee-64f0f1a57789 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:30.113378 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07392bf1-ad10-440a-8511-8841c8ec4325 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:30.116175 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bc5be-d9eb-4bd7-95ee-64f0f1a57789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b99bc5be-d9eb-4bd7-95ee-64f0f1a57789 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:30.124272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:30.125402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:30.126331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:30.126331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:30.126331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:30.126331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:30.126331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:30.126331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:30.126331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:30.126331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:30.126331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:30.126331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:30.126331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:30.126331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:30.126331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 331/662] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:30.126331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bc5be-d9eb-4bd7-95ee-64f0f1a57789 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:30.153244 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02e716-a147-4cd8-88b9-7bdf4c4eb967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:30.154048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e716-a147-4cd8-88b9-7bdf4c4eb967 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:30.154150 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e716-a147-4cd8-88b9-7bdf4c4eb967 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:30.154411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e716-a147-4cd8-88b9-7bdf4c4eb967 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:30.155185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02e716-a147-4cd8-88b9-7bdf4c4eb967 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:30.155484 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02e716-a147-4cd8-88b9-7bdf4c4eb967 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:30.156961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02e716-a147-4cd8-88b9-7bdf4c4eb967 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:30.168487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 332/663] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:30.169261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02e716-a147-4cd8-88b9-7bdf4c4eb967 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:30.220533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bc5be-d9eb-4bd7-95ee-64f0f1a57789 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:30.253248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9faf21-e57a-4831-b0f4-1484b61b78b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:30.253907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9faf21-e57a-4831-b0f4-1484b61b78b2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:30.254181 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9faf21-e57a-4831-b0f4-1484b61b78b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:30.254449 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9faf21-e57a-4831-b0f4-1484b61b78b2 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:30.255268 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9faf21-e57a-4831-b0f4-1484b61b78b2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:30.255569 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9faf21-e57a-4831-b0f4-1484b61b78b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:30.257014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9faf21-e57a-4831-b0f4-1484b61b78b2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:30.266456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02e716-a147-4cd8-88b9-7bdf4c4eb967 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:30.273338 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 332/664] 10.222.0.48 () {56 vars in 1139 bytes} [Tue May 17 16:57:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:30.274123 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9faf21-e57a-4831-b0f4-1484b61b78b2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:30.298136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9cc28-1672-4d21-9f97-ea26af702b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:30.298915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9cc28-1672-4d21-9f97-ea26af702b7b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:30.299190 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9cc28-1672-4d21-9f97-ea26af702b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:30.299458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9cc28-1672-4d21-9f97-ea26af702b7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:30.305814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9cc28-1672-4d21-9f97-ea26af702b7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:30.307230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9cc28-1672-4d21-9f97-ea26af702b7b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:30.321468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-45c9cc28-1672-4d21-9f97-ea26af702b7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:30.321468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:30.321468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:30.321468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:30.321468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:30.321468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:30.321468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:30.321468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:30.321468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:30.321468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:30.321468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:30.321468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:30.321468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:30.321468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:30.321468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:30.322511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:30.323987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:30.323987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:30.323987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:30.323987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:30.323987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:30.323987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:30.323987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:30.323987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:30.323987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 333/665] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:30.323987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9cc28-1672-4d21-9f97-ea26af702b7b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:30.367507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9faf21-e57a-4831-b0f4-1484b61b78b2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:30.399298 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265473be-bfc2-44e3-92ab-97eeee198c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:30.400210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265473be-bfc2-44e3-92ab-97eeee198c45 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:30.400490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265473be-bfc2-44e3-92ab-97eeee198c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:30.400763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265473be-bfc2-44e3-92ab-97eeee198c45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:30.410990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265473be-bfc2-44e3-92ab-97eeee198c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:30.412443 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265473be-bfc2-44e3-92ab-97eeee198c45 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:30.418125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9cc28-1672-4d21-9f97-ea26af702b7b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:30.429854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-265473be-bfc2-44e3-92ab-97eeee198c45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:30.429854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:30.429854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:30.429854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:30.429854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:30.429854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:30.429854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:30.429854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:30.429854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:30.429854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:30.429854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:30.429854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:30.429854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:30.429854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:30.429854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:30.430937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:30.431893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:30.431893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:30.431893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:30.431893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:30.431893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 333/666] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:30.431893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265473be-bfc2-44e3-92ab-97eeee198c45 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:30.453008 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486d048-ed32-4a6c-8c68-91596d870707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:30.453664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486d048-ed32-4a6c-8c68-91596d870707 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:30.453942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486d048-ed32-4a6c-8c68-91596d870707 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:30.454214 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486d048-ed32-4a6c-8c68-91596d870707 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:30.454942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486d048-ed32-4a6c-8c68-91596d870707 None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:30.455242 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486d048-ed32-4a6c-8c68-91596d870707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:30.456626 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486d048-ed32-4a6c-8c68-91596d870707 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:30.464970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 334/667] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:30.466177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486d048-ed32-4a6c-8c68-91596d870707 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:30.526117 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265473be-bfc2-44e3-92ab-97eeee198c45 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:30.558139 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2118662-aec4-4e0c-b76d-beeb9a80de35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:30.558425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486d048-ed32-4a6c-8c68-91596d870707 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:30.558779 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2118662-aec4-4e0c-b76d-beeb9a80de35 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:30.559062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2118662-aec4-4e0c-b76d-beeb9a80de35 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:30.559334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2118662-aec4-4e0c-b76d-beeb9a80de35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:30.560203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2118662-aec4-4e0c-b76d-beeb9a80de35 None admin] RBAC: Adding query filter params (role.id=958871a8463d49d89ddade803adb47c4, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=5becb135afbd43e9bc0b1347ba04e2b5) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:30.560515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2118662-aec4-4e0c-b76d-beeb9a80de35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:30.561941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2118662-aec4-4e0c-b76d-beeb9a80de35 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:30.567857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 334/668] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:30 2022] GET /identity/v3/role_assignments?user.id=5becb135afbd43e9bc0b1347ba04e2b5&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=958871a8463d49d89ddade803adb47c4 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:30.568631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2118662-aec4-4e0c-b76d-beeb9a80de35 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:30.604878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8d885-2601-4cc0-9922-f605b0206466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:30.605440 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8d885-2601-4cc0-9922-f605b0206466 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:30.605717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8d885-2601-4cc0-9922-f605b0206466 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:30.605992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8d885-2601-4cc0-9922-f605b0206466 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:30.671818 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2118662-aec4-4e0c-b76d-beeb9a80de35 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:30.676038 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8d885-2601-4cc0-9922-f605b0206466 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:30.677510 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8d885-2601-4cc0-9922-f605b0206466 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:30.707055 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc895c-b037-40cf-98bf-38e47a5c8f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:30.707760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc895c-b037-40cf-98bf-38e47a5c8f99 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:30.708045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc895c-b037-40cf-98bf-38e47a5c8f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:30.708320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc895c-b037-40cf-98bf-38e47a5c8f99 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:30.709117 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc895c-b037-40cf-98bf-38e47a5c8f99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:30.709428 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc895c-b037-40cf-98bf-38e47a5c8f99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:30.710908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc895c-b037-40cf-98bf-38e47a5c8f99 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:30.725560 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 335/669] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:30.732062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc895c-b037-40cf-98bf-38e47a5c8f99 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:30.781983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 335/670] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:30.782830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8d885-2601-4cc0-9922-f605b0206466 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:30.837099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc895c-b037-40cf-98bf-38e47a5c8f99 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:30.872379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adaeb0-4099-4b5a-849b-895250f5ab89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:30.872964 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adaeb0-4099-4b5a-849b-895250f5ab89 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:30.873245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adaeb0-4099-4b5a-849b-895250f5ab89 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:30.873520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adaeb0-4099-4b5a-849b-895250f5ab89 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:30.874235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adaeb0-4099-4b5a-849b-895250f5ab89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:30.874540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adaeb0-4099-4b5a-849b-895250f5ab89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:30.875935 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adaeb0-4099-4b5a-849b-895250f5ab89 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:30.887335 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 336/671] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:30.891866 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adaeb0-4099-4b5a-849b-895250f5ab89 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:30.902029 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8d885-2601-4cc0-9922-f605b0206466 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:30.936742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73f5a0-d8da-4080-ab6f-69b63ab9c01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:30.938452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73f5a0-d8da-4080-ab6f-69b63ab9c01c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:30.938756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73f5a0-d8da-4080-ab6f-69b63ab9c01c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:30.939032 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73f5a0-d8da-4080-ab6f-69b63ab9c01c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:30.949195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73f5a0-d8da-4080-ab6f-69b63ab9c01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:30.950636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73f5a0-d8da-4080-ab6f-69b63ab9c01c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:30.968094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-1d73f5a0-d8da-4080-ab6f-69b63ab9c01c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:30.968094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:30.968094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:30.968094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:30.968094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:30.968094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:30.968094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:30.968094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:30.968094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:30.968094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:30.968094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:30.968094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:30.968094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:30.968094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:30.968094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:30.969183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:30.974744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:30.974744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:30.974744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:30.974744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:30.974744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 336/672] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:30.974744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73f5a0-d8da-4080-ab6f-69b63ab9c01c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:30.995270 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adaeb0-4099-4b5a-849b-895250f5ab89 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:31.031034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1352bd4-bada-4057-9403-d7bf894a6775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:31.031998 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1352bd4-bada-4057-9403-d7bf894a6775 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:31.032432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1352bd4-bada-4057-9403-d7bf894a6775 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:31.032840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1352bd4-bada-4057-9403-d7bf894a6775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:31.033811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1352bd4-bada-4057-9403-d7bf894a6775 None admin] RBAC: Adding query filter params (role.id=958871a8463d49d89ddade803adb47c4, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=97e0aa0cdd8544ca9e16d1af3bff411f) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:31.034267 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1352bd4-bada-4057-9403-d7bf894a6775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:31.035895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1352bd4-bada-4057-9403-d7bf894a6775 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:31.042875 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 337/673] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:30 2022] GET /identity/v3/role_assignments?user.id=97e0aa0cdd8544ca9e16d1af3bff411f&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=958871a8463d49d89ddade803adb47c4 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:31.044028 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1352bd4-bada-4057-9403-d7bf894a6775 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:31.086304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73f5a0-d8da-4080-ab6f-69b63ab9c01c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:31.135569 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9584869-8533-409f-b562-bcde650792c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:31.136845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9584869-8533-409f-b562-bcde650792c1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:31.137272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9584869-8533-409f-b562-bcde650792c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:31.137677 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9584869-8533-409f-b562-bcde650792c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:31.149955 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9584869-8533-409f-b562-bcde650792c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:31.152880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9584869-8533-409f-b562-bcde650792c1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:31.154626 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1352bd4-bada-4057-9403-d7bf894a6775 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:31.178001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-b9584869-8533-409f-b562-bcde650792c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:31.178001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:31.178001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:31.178001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:31.178001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:31.178001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:31.178001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:31.178001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:31.178001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:31.178001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:31.178001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:31.178001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:31.178001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:31.178001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:31.178001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:31.179120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:31.180217 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:31.180217 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:31.180217 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:31.180217 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:31.182131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 337/674] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:31.183282 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9584869-8533-409f-b562-bcde650792c1 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:31.196231 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fda47-6832-40a4-ac52-77666e9a6879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:31.197051 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fda47-6832-40a4-ac52-77666e9a6879 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:31.197342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fda47-6832-40a4-ac52-77666e9a6879 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:31.197607 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fda47-6832-40a4-ac52-77666e9a6879 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:31.205614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fda47-6832-40a4-ac52-77666e9a6879 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:31.207114 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fda47-6832-40a4-ac52-77666e9a6879 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:31.223177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-cb4fda47-6832-40a4-ac52-77666e9a6879 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:31.223177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:31.223177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:31.223177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:31.223177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:31.223177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:31.223177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:31.223177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:31.223177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:31.223177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:31.223177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:31.223177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:31.223177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:31.223177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:31.223177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:31.224352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:31.225553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:31.225553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:31.225553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:31.225553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:31.225553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:31.225553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:31.225553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:31.225553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:31.225553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 338/675] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:31.225553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fda47-6832-40a4-ac52-77666e9a6879 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:31.304469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9584869-8533-409f-b562-bcde650792c1 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:31.331074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fda47-6832-40a4-ac52-77666e9a6879 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:31.339487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ac496-e3e6-4692-807c-5c553ebb9c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:31.340456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ac496-e3e6-4692-807c-5c553ebb9c2b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:31.340839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ac496-e3e6-4692-807c-5c553ebb9c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:31.341213 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ac496-e3e6-4692-807c-5c553ebb9c2b None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:31.342034 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ac496-e3e6-4692-807c-5c553ebb9c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:31.342457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ac496-e3e6-4692-807c-5c553ebb9c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:31.344186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ac496-e3e6-4692-807c-5c553ebb9c2b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:31.361232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 338/676] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:31.364610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ac496-e3e6-4692-807c-5c553ebb9c2b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:31.369418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb6c9c-c251-4c7a-a5ee-42a623fc6dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:31.370604 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb6c9c-c251-4c7a-a5ee-42a623fc6dcd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:31.371080 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb6c9c-c251-4c7a-a5ee-42a623fc6dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:31.371363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb6c9c-c251-4c7a-a5ee-42a623fc6dcd None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:31.372133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb6c9c-c251-4c7a-a5ee-42a623fc6dcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:31.372436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb6c9c-c251-4c7a-a5ee-42a623fc6dcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:31.373813 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb6c9c-c251-4c7a-a5ee-42a623fc6dcd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:31.385957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 339/677] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:31.386749 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb6c9c-c251-4c7a-a5ee-42a623fc6dcd None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:31.463001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ac496-e3e6-4692-807c-5c553ebb9c2b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:31.493287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb6c9c-c251-4c7a-a5ee-42a623fc6dcd None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:31.497275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5c88b-9f51-4d81-92d4-53cbd97fafca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:31.498027 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5c88b-9f51-4d81-92d4-53cbd97fafca None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:31.498400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5c88b-9f51-4d81-92d4-53cbd97fafca None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:31.498748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5c88b-9f51-4d81-92d4-53cbd97fafca None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:31.499623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5c88b-9f51-4d81-92d4-53cbd97fafca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:31.500012 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5c88b-9f51-4d81-92d4-53cbd97fafca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:31.501529 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5c88b-9f51-4d81-92d4-53cbd97fafca None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:31.514905 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 339/678] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:31.515899 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5c88b-9f51-4d81-92d4-53cbd97fafca None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:31.533477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd37a92-0f84-49f8-a5a9-e776718eb984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:31.534283 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd37a92-0f84-49f8-a5a9-e776718eb984 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:31.534568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd37a92-0f84-49f8-a5a9-e776718eb984 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:31.534846 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd37a92-0f84-49f8-a5a9-e776718eb984 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:31.544040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd37a92-0f84-49f8-a5a9-e776718eb984 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:31.545491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd37a92-0f84-49f8-a5a9-e776718eb984 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-dbd37a92-0f84-49f8-a5a9-e776718eb984 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:31.560232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:31.562669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:31.565216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:31.565216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:31.565216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:31.565216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:31.565216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:31.565216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:31.565216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:31.565216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:31.565216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 16:57:31.565216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:31.565216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 340/679] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:57:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:31.565216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd37a92-0f84-49f8-a5a9-e776718eb984 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:31.614868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5c88b-9f51-4d81-92d4-53cbd97fafca None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:31.650576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999db80-c9ea-4493-825d-847072082575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:31.651372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999db80-c9ea-4493-825d-847072082575 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:31.651870 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999db80-c9ea-4493-825d-847072082575 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:31.652153 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999db80-c9ea-4493-825d-847072082575 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:31.658979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999db80-c9ea-4493-825d-847072082575 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:31.660452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999db80-c9ea-4493-825d-847072082575 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:31.662005 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd37a92-0f84-49f8-a5a9-e776718eb984 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:31.675236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-3999db80-c9ea-4493-825d-847072082575 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:31.675236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:31.675236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:31.675236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:31.675236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:31.675236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:31.675236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:31.675236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:31.675236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:31.675236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:31.675236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:31.675236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:31.675236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:31.675236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:31.675236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:31.677457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:31.679560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:31.679560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:31.679560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:31.679560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:31.679560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:31.679560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:31.679560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:31.679560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:31.679560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 340/680] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:31.679560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999db80-c9ea-4493-825d-847072082575 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:31.697319 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c39ce9-54a8-4f06-8ff5-4ce8005f6c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:31.697979 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c39ce9-54a8-4f06-8ff5-4ce8005f6c1a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:31.698296 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c39ce9-54a8-4f06-8ff5-4ce8005f6c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:31.698572 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c39ce9-54a8-4f06-8ff5-4ce8005f6c1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:31.699401 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c39ce9-54a8-4f06-8ff5-4ce8005f6c1a None admin] RBAC: Adding query filter params (role.id=958871a8463d49d89ddade803adb47c4, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=b25519cdc25244a0b039ce3097c328d8) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:31.699743 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c39ce9-54a8-4f06-8ff5-4ce8005f6c1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:31.701191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c39ce9-54a8-4f06-8ff5-4ce8005f6c1a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:31.707353 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 341/681] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:31 2022] GET /identity/v3/role_assignments?user.id=b25519cdc25244a0b039ce3097c328d8&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=958871a8463d49d89ddade803adb47c4 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:31.708185 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c39ce9-54a8-4f06-8ff5-4ce8005f6c1a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:31.781523 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999db80-c9ea-4493-825d-847072082575 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:31.817684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a248a01-c45d-4c74-b693-98eb3491cb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:31.818090 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c39ce9-54a8-4f06-8ff5-4ce8005f6c1a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:31.818375 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a248a01-c45d-4c74-b693-98eb3491cb13 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:31.818657 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a248a01-c45d-4c74-b693-98eb3491cb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:31.818933 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a248a01-c45d-4c74-b693-98eb3491cb13 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:31.819846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a248a01-c45d-4c74-b693-98eb3491cb13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:31.820161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a248a01-c45d-4c74-b693-98eb3491cb13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:31.821689 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a248a01-c45d-4c74-b693-98eb3491cb13 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:31.842929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 341/682] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 17 16:57:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:31.852708 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a248a01-c45d-4c74-b693-98eb3491cb13 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:31.859725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cab0f-673e-4fb8-b248-26e3655d1b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:31.860424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cab0f-673e-4fb8-b248-26e3655d1b1d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:31.860679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cab0f-673e-4fb8-b248-26e3655d1b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:31.860954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cab0f-673e-4fb8-b248-26e3655d1b1d None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:31.861757 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cab0f-673e-4fb8-b248-26e3655d1b1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:31.862067 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cab0f-673e-4fb8-b248-26e3655d1b1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:31.863545 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cab0f-673e-4fb8-b248-26e3655d1b1d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:31.877840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 342/683] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:31.888770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cab0f-673e-4fb8-b248-26e3655d1b1d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:31.967849 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a248a01-c45d-4c74-b693-98eb3491cb13 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:31.996459 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cab0f-673e-4fb8-b248-26e3655d1b1d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:32.004144 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68972146-193a-45c4-987f-c1139d711dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:32.004796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68972146-193a-45c4-987f-c1139d711dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:32.005077 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68972146-193a-45c4-987f-c1139d711dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:32.005352 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68972146-193a-45c4-987f-c1139d711dd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:32.032088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706c8e7-5b3b-4178-ae8d-e7cf9142e87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:32.032746 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706c8e7-5b3b-4178-ae8d-e7cf9142e87e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:32.033086 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706c8e7-5b3b-4178-ae8d-e7cf9142e87e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:32.033364 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706c8e7-5b3b-4178-ae8d-e7cf9142e87e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:32.034249 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706c8e7-5b3b-4178-ae8d-e7cf9142e87e None admin] RBAC: Adding query filter params (role.id=958871a8463d49d89ddade803adb47c4, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=5819e022286b454e9e2f23d975c6e921) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:32.034560 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706c8e7-5b3b-4178-ae8d-e7cf9142e87e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:32.036080 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706c8e7-5b3b-4178-ae8d-e7cf9142e87e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:32.043223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 343/684] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:31 2022] GET /identity/v3/role_assignments?user.id=5819e022286b454e9e2f23d975c6e921&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=958871a8463d49d89ddade803adb47c4 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:32.079668 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68972146-193a-45c4-987f-c1139d711dd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:32.081157 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68972146-193a-45c4-987f-c1139d711dd0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:32.191547 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 342/685] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:32.196851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706c8e7-5b3b-4178-ae8d-e7cf9142e87e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:32.314503 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706c8e7-5b3b-4178-ae8d-e7cf9142e87e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:32.349680 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3242e1f-14cb-43f9-8088-2643460d71f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:32.350481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3242e1f-14cb-43f9-8088-2643460d71f8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:32.350775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3242e1f-14cb-43f9-8088-2643460d71f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:32.351090 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3242e1f-14cb-43f9-8088-2643460d71f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:32.362614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3242e1f-14cb-43f9-8088-2643460d71f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:32.364100 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3242e1f-14cb-43f9-8088-2643460d71f8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:32.381256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-d3242e1f-14cb-43f9-8088-2643460d71f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:32.381256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:32.381256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:32.381256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:32.381256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:32.381256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:32.381256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:32.381256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:32.381256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:32.381256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:32.381256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:32.381256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:32.381256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:32.381256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:32.381256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:32.382186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:32.383119 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:32.383119 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:32.383119 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:32.383119 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:32.383119 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 344/686] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:32.388956 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68972146-193a-45c4-987f-c1139d711dd0 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:32.491734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68972146-193a-45c4-987f-c1139d711dd0 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:32.527711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d344b38-d48a-4be5-b61c-047418fe8e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:32.528385 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d344b38-d48a-4be5-b61c-047418fe8e8a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:32.528668 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d344b38-d48a-4be5-b61c-047418fe8e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:32.528943 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d344b38-d48a-4be5-b61c-047418fe8e8a None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:32.529666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d344b38-d48a-4be5-b61c-047418fe8e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:32.529997 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d344b38-d48a-4be5-b61c-047418fe8e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:32.531341 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d344b38-d48a-4be5-b61c-047418fe8e8a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:32.543961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 343/687] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:32.549340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3242e1f-14cb-43f9-8088-2643460d71f8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:32.654646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3242e1f-14cb-43f9-8088-2643460d71f8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:32.689397 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54390-74b3-4fd1-9b4e-198cf860874c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:32.690204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54390-74b3-4fd1-9b4e-198cf860874c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:32.690482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54390-74b3-4fd1-9b4e-198cf860874c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:32.690754 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54390-74b3-4fd1-9b4e-198cf860874c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:32.697594 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d54390-74b3-4fd1-9b4e-198cf860874c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:32.699234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d54390-74b3-4fd1-9b4e-198cf860874c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:32.712968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-94d54390-74b3-4fd1-9b4e-198cf860874c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:32.712968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:32.712968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:32.712968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:32.712968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:32.712968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:32.712968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:32.712968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:32.712968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:32.712968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:32.712968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:32.712968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:32.712968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:32.712968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:32.712968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:32.715640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:32.717857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:32.717857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:32.717857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:32.717857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:32.717857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:32.717857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:32.717857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:32.717857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:32.717857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 345/688] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:32.721172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d344b38-d48a-4be5-b61c-047418fe8e8a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:32.822850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d344b38-d48a-4be5-b61c-047418fe8e8a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:32.857187 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab755423-fd35-4daa-b530-3c9d0b2d5be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:32.857854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755423-fd35-4daa-b530-3c9d0b2d5be2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:32.858135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755423-fd35-4daa-b530-3c9d0b2d5be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:32.858411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab755423-fd35-4daa-b530-3c9d0b2d5be2 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:32.859259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab755423-fd35-4daa-b530-3c9d0b2d5be2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:32.859632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab755423-fd35-4daa-b530-3c9d0b2d5be2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:32.861070 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab755423-fd35-4daa-b530-3c9d0b2d5be2 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:32.874065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 344/689] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:32.879966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54390-74b3-4fd1-9b4e-198cf860874c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:32.986377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54390-74b3-4fd1-9b4e-198cf860874c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:33.020302 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6c031-c76d-443b-8996-ece7e77a471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:33.020955 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6c031-c76d-443b-8996-ece7e77a471d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:33.021236 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6c031-c76d-443b-8996-ece7e77a471d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:33.021512 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6c031-c76d-443b-8996-ece7e77a471d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:33.022332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6c031-c76d-443b-8996-ece7e77a471d None admin] RBAC: Adding query filter params (role.id=958871a8463d49d89ddade803adb47c4, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=bc87aba3662244bea0428475bb0c9e8b) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:33.022640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6c031-c76d-443b-8996-ece7e77a471d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:33.024086 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6c031-c76d-443b-8996-ece7e77a471d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:33.030642 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 346/690] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:32 2022] GET /identity/v3/role_assignments?user.id=bc87aba3662244bea0428475bb0c9e8b&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=958871a8463d49d89ddade803adb47c4 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:33.184932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23953b2-7983-470d-b5a0-71f8690a2f4b None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:33.185280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23953b2-7983-470d-b5a0-71f8690a2f4b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:33.185526 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23953b2-7983-470d-b5a0-71f8690a2f4b None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:33.187207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 345/691] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:33.193225 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae301dab-57d6-415d-8110-3cf345f9e52d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:33.193495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae301dab-57d6-415d-8110-3cf345f9e52d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:33.193777 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae301dab-57d6-415d-8110-3cf345f9e52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:33.215140 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ae301dab-57d6-415d-8110-3cf345f9e52d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:33.216360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ae301dab-57d6-415d-8110-3cf345f9e52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:33.305939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 347/692] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:33.331526 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23953b2-7983-470d-b5a0-71f8690a2f4b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:33.450894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23953b2-7983-470d-b5a0-71f8690a2f4b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:33.486049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a25f99-951f-4133-991a-a5aba56cbe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:33.486846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a25f99-951f-4133-991a-a5aba56cbe8d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:33.487128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a25f99-951f-4133-991a-a5aba56cbe8d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:33.487401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a25f99-951f-4133-991a-a5aba56cbe8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:33.498472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a25f99-951f-4133-991a-a5aba56cbe8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-29a25f99-951f-4133-991a-a5aba56cbe8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:33.506345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:33.507308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:33.508216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:33.508216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:33.508216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:33.508216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:33.508216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:33.508216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:33.508216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:33.508216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:33.508216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:33.508216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:33.508216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:33.508216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:33.508216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 346/693] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:57:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:33.514592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae301dab-57d6-415d-8110-3cf345f9e52d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:33.629606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae301dab-57d6-415d-8110-3cf345f9e52d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:33.671648 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf399b-3526-408a-831b-677152aa8cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:33.672708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf399b-3526-408a-831b-677152aa8cad None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:33.673193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf399b-3526-408a-831b-677152aa8cad None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:33.673685 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf399b-3526-408a-831b-677152aa8cad None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:33.674630 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf399b-3526-408a-831b-677152aa8cad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:33.675143 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf399b-3526-408a-831b-677152aa8cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:33.676846 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf399b-3526-408a-831b-677152aa8cad None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:33.686472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 348/694] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:33.692412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a25f99-951f-4133-991a-a5aba56cbe8d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:33.831515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a25f99-951f-4133-991a-a5aba56cbe8d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:33.881751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87973e-342e-491f-8c12-7e6a8e54c4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:33.882479 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87973e-342e-491f-8c12-7e6a8e54c4cb None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:33.882766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87973e-342e-491f-8c12-7e6a8e54c4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:33.883042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87973e-342e-491f-8c12-7e6a8e54c4cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:33.895662 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87973e-342e-491f-8c12-7e6a8e54c4cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:33.897110 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87973e-342e-491f-8c12-7e6a8e54c4cb None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:33.918966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-df87973e-342e-491f-8c12-7e6a8e54c4cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:33.918966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:33.918966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:33.918966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:33.918966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:33.918966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:33.918966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:33.918966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:33.918966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:33.918966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:33.918966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:33.918966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:33.918966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:33.918966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:33.918966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:33.919915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:33.920791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:33.920791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:33.920791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:33.920791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:33.920791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 347/695] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:33.925829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf399b-3526-408a-831b-677152aa8cad None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:33.976811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf4d24-5ac7-46e8-afe6-53f603fe6799 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:33.977136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf4d24-5ac7-46e8-afe6-53f603fe6799 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:33.977377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf4d24-5ac7-46e8-afe6-53f603fe6799 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:33.978963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 348/696] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:33.984796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7c355-1ac4-4dd9-b500-1b18274d2cc0 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:33.985087 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7c355-1ac4-4dd9-b500-1b18274d2cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:33.985369 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7c355-1ac4-4dd9-b500-1b18274d2cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:34.016603 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d7a7c355-1ac4-4dd9-b500-1b18274d2cc0 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:34.017801 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d7a7c355-1ac4-4dd9-b500-1b18274d2cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:34.049739 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf399b-3526-408a-831b-677152aa8cad None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:34.083981 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ae118-7057-4a7e-86ef-94aca123ee93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:34.085031 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ae118-7057-4a7e-86ef-94aca123ee93 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:34.085517 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ae118-7057-4a7e-86ef-94aca123ee93 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:34.086009 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ae118-7057-4a7e-86ef-94aca123ee93 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:34.086945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ae118-7057-4a7e-86ef-94aca123ee93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:34.087454 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ae118-7057-4a7e-86ef-94aca123ee93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:34.089664 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ae118-7057-4a7e-86ef-94aca123ee93 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:34.103063 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 349/697] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:34.109884 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ae118-7057-4a7e-86ef-94aca123ee93 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:34.161049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 349/698] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:34.205228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7c355-1ac4-4dd9-b500-1b18274d2cc0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:34.315054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7c355-1ac4-4dd9-b500-1b18274d2cc0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:34.317703 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ae118-7057-4a7e-86ef-94aca123ee93 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:34.352769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac765e-b486-4162-8b75-4a88b857399d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:34.354536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac765e-b486-4162-8b75-4a88b857399d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:34.356112 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac765e-b486-4162-8b75-4a88b857399d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:34.356400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac765e-b486-4162-8b75-4a88b857399d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:34.357069 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac765e-b486-4162-8b75-4a88b857399d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:34.358445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac765e-b486-4162-8b75-4a88b857399d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-1aac765e-b486-4162-8b75-4a88b857399d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:34.378487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:34.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:34.380470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:34.380470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:34.380470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:34.380470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:34.380470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:34.380470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:34.380470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:34.380470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:34.380470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:34.380470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:34.380470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:34.380470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:57:34.380470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:34.380470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 16:57:34.380470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:34.390751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 350/699] 10.222.0.48 () {56 vars in 1129 bytes} [Tue May 17 16:57:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:34.395240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ec8b0-9171-4e4c-8b9a-7a4d5db40417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:34.396320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ec8b0-9171-4e4c-8b9a-7a4d5db40417 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:34.397431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac765e-b486-4162-8b75-4a88b857399d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:34.398305 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ec8b0-9171-4e4c-8b9a-7a4d5db40417 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:34.399174 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ec8b0-9171-4e4c-8b9a-7a4d5db40417 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:34.416187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ec8b0-9171-4e4c-8b9a-7a4d5db40417 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:34.418045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ec8b0-9171-4e4c-8b9a-7a4d5db40417 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ce6ec8b0-9171-4e4c-8b9a-7a4d5db40417 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:34.445518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:34.446520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:34.447439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:34.447439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:34.447439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:34.447439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:34.447439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:34.447439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:34.447439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:34.447439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:34.447439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 16:57:34.447439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:34.454505 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 350/700] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 16:57:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:34.464808 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ec8b0-9171-4e4c-8b9a-7a4d5db40417 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:34.537443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac765e-b486-4162-8b75-4a88b857399d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:34.583622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2a7f9-d76a-41e2-b6c5-03a2f869d102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:34.584372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a7f9-d76a-41e2-b6c5-03a2f869d102 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:34.584649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a7f9-d76a-41e2-b6c5-03a2f869d102 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:34.584921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a7f9-d76a-41e2-b6c5-03a2f869d102 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:34.585628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2a7f9-d76a-41e2-b6c5-03a2f869d102 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:34.585932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2a7f9-d76a-41e2-b6c5-03a2f869d102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:34.587356 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2a7f9-d76a-41e2-b6c5-03a2f869d102 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:34.600121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 351/701] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 17 16:57:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:34.607237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2a7f9-d76a-41e2-b6c5-03a2f869d102 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:34.617314 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ec8b0-9171-4e4c-8b9a-7a4d5db40417 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:34.651782 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b1300-6d0c-4b9a-b5e1-d694c248b716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:34.652465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b1300-6d0c-4b9a-b5e1-d694c248b716 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:34.652747 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b1300-6d0c-4b9a-b5e1-d694c248b716 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:34.653023 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b1300-6d0c-4b9a-b5e1-d694c248b716 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:34.653892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b1300-6d0c-4b9a-b5e1-d694c248b716 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:34.654156 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b1300-6d0c-4b9a-b5e1-d694c248b716 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:34.655666 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b1300-6d0c-4b9a-b5e1-d694c248b716 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:34.676427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 351/702] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 16:57:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:34.683768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b1300-6d0c-4b9a-b5e1-d694c248b716 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:34.765636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2a7f9-d76a-41e2-b6c5-03a2f869d102 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:34.837567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8412f6-2827-44ce-871f-18e6ed1e2104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:34.838244 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8412f6-2827-44ce-871f-18e6ed1e2104 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:34.838510 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8412f6-2827-44ce-871f-18e6ed1e2104 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:34.838937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8412f6-2827-44ce-871f-18e6ed1e2104 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:34.839769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8412f6-2827-44ce-871f-18e6ed1e2104 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:34.840074 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8412f6-2827-44ce-871f-18e6ed1e2104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:34.841477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8412f6-2827-44ce-871f-18e6ed1e2104 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:34.841598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b1300-6d0c-4b9a-b5e1-d694c248b716 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:34.856755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 352/703] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 17 16:57:34 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:34.879482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12606f21-2ac9-4ea6-a619-8b1a5883efa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:34.880191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12606f21-2ac9-4ea6-a619-8b1a5883efa3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:34.880471 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12606f21-2ac9-4ea6-a619-8b1a5883efa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:34.880740 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12606f21-2ac9-4ea6-a619-8b1a5883efa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:34.953846 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12606f21-2ac9-4ea6-a619-8b1a5883efa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:34.955227 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12606f21-2ac9-4ea6-a619-8b1a5883efa3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:35.011828 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7e4a4-1a84-43f4-a9d6-a78a3747e33d None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:35.012151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7e4a4-1a84-43f4-a9d6-a78a3747e33d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:35.012396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7e4a4-1a84-43f4-a9d6-a78a3747e33d None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:35.014128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 353/704] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:35.020057 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81e055-4787-4ce6-962d-5f94937dea77 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:35.020658 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81e055-4787-4ce6-962d-5f94937dea77 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:35.021145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81e055-4787-4ce6-962d-5f94937dea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:35.061785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 352/705] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 16:57:35.064201 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-fa81e055-4787-4ce6-962d-5f94937dea77 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:35.065606 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-fa81e055-4787-4ce6-962d-5f94937dea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:35.067149 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12606f21-2ac9-4ea6-a619-8b1a5883efa3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:35.192173 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12606f21-2ac9-4ea6-a619-8b1a5883efa3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:35.193130 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 354/706] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:35.195053 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83641f-b728-4226-83df-44c6c8623280 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:35.195340 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83641f-b728-4226-83df-44c6c8623280 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:35.195647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83641f-b728-4226-83df-44c6c8623280 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:35.197211 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 355/707] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:35.205078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e292-5c94-4d2a-9777-4322081015a5 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:35.205336 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e292-5c94-4d2a-9777-4322081015a5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:35.205565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e292-5c94-4d2a-9777-4322081015a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:35.225612 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c737e292-5c94-4d2a-9777-4322081015a5 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:35.227018 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c737e292-5c94-4d2a-9777-4322081015a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:35.230821 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b3c02-802f-49e5-b146-1ec1b44fcb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:35.231811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3c02-802f-49e5-b146-1ec1b44fcb73 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:35.232099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3c02-802f-49e5-b146-1ec1b44fcb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:35.232375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3c02-802f-49e5-b146-1ec1b44fcb73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:35.242784 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b3c02-802f-49e5-b146-1ec1b44fcb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:35.244273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b3c02-802f-49e5-b146-1ec1b44fcb73 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:35.266238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8d5b3c02-802f-49e5-b146-1ec1b44fcb73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:35.266238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:35.266238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:35.266238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:35.266238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:35.266238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:35.266238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:35.266238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:35.266238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:35.266238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:35.266238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:35.266238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:35.266238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:35.266238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:35.266238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:35.267177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:35.268535 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:35.268535 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:35.268535 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:35.268535 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:35.268535 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 353/708] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:35.268828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b3c02-802f-49e5-b146-1ec1b44fcb73 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:35.310643 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 356/709] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 16:57:35.311940 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e292-5c94-4d2a-9777-4322081015a5 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:35.386736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b3c02-802f-49e5-b146-1ec1b44fcb73 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:35.421354 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02b80a-01ed-419f-b55d-96c46eeb1b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:35.422162 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02b80a-01ed-419f-b55d-96c46eeb1b24 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:35.422442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02b80a-01ed-419f-b55d-96c46eeb1b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:35.422717 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02b80a-01ed-419f-b55d-96c46eeb1b24 None admin] PATH_INFO: `/v3/services/network` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:35.423366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02b80a-01ed-419f-b55d-96c46eeb1b24 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:35.424608 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e292-5c94-4d2a-9777-4322081015a5 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:35.424810 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02b80a-01ed-419f-b55d-96c46eeb1b24 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-7d02b80a-01ed-419f-b55d-96c46eeb1b24 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:35.438985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:35.440095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:35.441362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:35.441362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:35.441362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:35.441362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:35.441362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:35.441362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:35.441362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:35.441362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:35.441362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:35.441362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:35.441362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:57:35.441362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:35.441362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 16:57:35.441362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:35.441362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 354/710] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:35 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:35.442206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02b80a-01ed-419f-b55d-96c46eeb1b24 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:35.467067 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70e608-2f33-4f4e-84da-93ec180b966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:35.468134 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70e608-2f33-4f4e-84da-93ec180b966a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:35.468650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70e608-2f33-4f4e-84da-93ec180b966a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:35.469417 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70e608-2f33-4f4e-84da-93ec180b966a None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:35.470400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70e608-2f33-4f4e-84da-93ec180b966a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:35.470958 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70e608-2f33-4f4e-84da-93ec180b966a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:35.472667 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70e608-2f33-4f4e-84da-93ec180b966a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:35.485308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 357/711] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:35.486436 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70e608-2f33-4f4e-84da-93ec180b966a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:35.564523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02b80a-01ed-419f-b55d-96c46eeb1b24 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:35.599374 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c84b9d-ce33-419c-9f33-e0af26ea9514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:35.600009 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c84b9d-ce33-419c-9f33-e0af26ea9514 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:35.600289 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c84b9d-ce33-419c-9f33-e0af26ea9514 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:35.600556 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c84b9d-ce33-419c-9f33-e0af26ea9514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:35.603038 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70e608-2f33-4f4e-84da-93ec180b966a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:35.611838 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c84b9d-ce33-419c-9f33-e0af26ea9514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:35.613529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c84b9d-ce33-419c-9f33-e0af26ea9514 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:35.631698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a3c84b9d-ce33-419c-9f33-e0af26ea9514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:35.631698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:35.631698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:35.631698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:35.631698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:35.631698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:35.631698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:35.631698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:35.631698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:35.631698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:35.631698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:35.631698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:35.631698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:35.631698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:35.631698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:35.632700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:35.634223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:35.634223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:35.634223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:35.634223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:35.634223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 355/712] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:35.634223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c84b9d-ce33-419c-9f33-e0af26ea9514 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:35.648573 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41caf2d0-9992-44e6-8119-487f3801239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:35.648823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41caf2d0-9992-44e6-8119-487f3801239a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:35.649061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41caf2d0-9992-44e6-8119-487f3801239a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:35.649297 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41caf2d0-9992-44e6-8119-487f3801239a None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:35.650011 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41caf2d0-9992-44e6-8119-487f3801239a None admin] RBAC: Adding query filter params (name=network) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:35.650316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41caf2d0-9992-44e6-8119-487f3801239a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:35.652372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41caf2d0-9992-44e6-8119-487f3801239a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:35.657645 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 358/713] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 16:57:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:35.658710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41caf2d0-9992-44e6-8119-487f3801239a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:35.748034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c84b9d-ce33-419c-9f33-e0af26ea9514 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:35.761934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41caf2d0-9992-44e6-8119-487f3801239a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:35.783292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6b22e-46bd-4325-b513-b963eaec021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:35.784510 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6b22e-46bd-4325-b513-b963eaec021d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:35.785004 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6b22e-46bd-4325-b513-b963eaec021d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:35.785481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6b22e-46bd-4325-b513-b963eaec021d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:35.793327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6b22e-46bd-4325-b513-b963eaec021d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:35.795045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6b22e-46bd-4325-b513-b963eaec021d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:35.796986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dfbcb-a53a-433b-8c4b-b426f8f9df34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:35.797645 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dfbcb-a53a-433b-8c4b-b426f8f9df34 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:35.797921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dfbcb-a53a-433b-8c4b-b426f8f9df34 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:35.798211 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dfbcb-a53a-433b-8c4b-b426f8f9df34 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:35.798900 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dfbcb-a53a-433b-8c4b-b426f8f9df34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:35.799199 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dfbcb-a53a-433b-8c4b-b426f8f9df34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:35.800610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dfbcb-a53a-433b-8c4b-b426f8f9df34 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:35.811849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-71b6b22e-46bd-4325-b513-b963eaec021d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:35.811849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:35.811849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:35.811849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:35.811849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:35.811849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:35.811849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:35.811849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:35.811849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:35.811849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:35.811849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:35.811849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:35.811849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:35.811849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:35.811849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:35.812769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:35.813921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:35.813921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:35.813921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:35.813921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:35.813921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:35.813921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:35.813921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:35.813921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:35.816596 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 356/714] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:35.817794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6b22e-46bd-4325-b513-b963eaec021d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:35.818124 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 359/715] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:35.819117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dfbcb-a53a-433b-8c4b-b426f8f9df34 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:35.915803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6b22e-46bd-4325-b513-b963eaec021d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:35.918461 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dfbcb-a53a-433b-8c4b-b426f8f9df34 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:35.950263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd835b2-b5e8-4421-92c1-3906aa2b0d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:35.950930 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd835b2-b5e8-4421-92c1-3906aa2b0d0f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:35.951208 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd835b2-b5e8-4421-92c1-3906aa2b0d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:35.951480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd835b2-b5e8-4421-92c1-3906aa2b0d0f None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:35.952077 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec7540-3f41-420f-950c-2e4a77d12c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:35.952214 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd835b2-b5e8-4421-92c1-3906aa2b0d0f None admin] RBAC: Adding query filter params (type=network) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:35.952502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd835b2-b5e8-4421-92c1-3906aa2b0d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:35.952759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec7540-3f41-420f-950c-2e4a77d12c43 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:35.953040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec7540-3f41-420f-950c-2e4a77d12c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:35.953312 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec7540-3f41-420f-950c-2e4a77d12c43 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:35.953874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd835b2-b5e8-4421-92c1-3906aa2b0d0f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:35.954299 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec7540-3f41-420f-950c-2e4a77d12c43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:35.955394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec7540-3f41-420f-950c-2e4a77d12c43 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:35.964398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 357/716] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 16:57:35 2022] GET /identity/v3/services?type=network => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:35.964398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd835b2-b5e8-4421-92c1-3906aa2b0d0f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:35.987868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 360/717] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:57:35 2022] POST /identity/v3/users => generated 254 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:57:35.989359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e258c5-0a84-4e69-ad87-d2c371282414 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:35.989658 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e258c5-0a84-4e69-ad87-d2c371282414 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:35.990443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e258c5-0a84-4e69-ad87-d2c371282414 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:35.992433 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 361/718] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:35.998404 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4430d-92cd-4b43-9c66-80f4a7dc02af None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:35.998598 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4430d-92cd-4b43-9c66-80f4a7dc02af None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:35.998868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4430d-92cd-4b43-9c66-80f4a7dc02af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:36.021642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-73f4430d-92cd-4b43-9c66-80f4a7dc02af None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:36.022901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-73f4430d-92cd-4b43-9c66-80f4a7dc02af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:36.131998 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd835b2-b5e8-4421-92c1-3906aa2b0d0f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:36.150035 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 362/719] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:36.199395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aa73f-6294-40b4-867d-1db5d8a1ab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:36.200155 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aa73f-6294-40b4-867d-1db5d8a1ab25 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:36.200433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aa73f-6294-40b4-867d-1db5d8a1ab25 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:36.200706 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aa73f-6294-40b4-867d-1db5d8a1ab25 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:36.201537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584aa73f-6294-40b4-867d-1db5d8a1ab25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:36.201846 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584aa73f-6294-40b4-867d-1db5d8a1ab25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:36.203374 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584aa73f-6294-40b4-867d-1db5d8a1ab25 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:36.208866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4430d-92cd-4b43-9c66-80f4a7dc02af None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:36.231076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 358/720] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:36.236661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aa73f-6294-40b4-867d-1db5d8a1ab25 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:36.347860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4430d-92cd-4b43-9c66-80f4a7dc02af None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:36.366718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aa73f-6294-40b4-867d-1db5d8a1ab25 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:36.385307 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3794f56-ddcf-4904-aa74-2b7794190cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:36.386237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3794f56-ddcf-4904-aa74-2b7794190cec None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:36.386412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3794f56-ddcf-4904-aa74-2b7794190cec None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:36.386689 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3794f56-ddcf-4904-aa74-2b7794190cec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:36.397275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3794f56-ddcf-4904-aa74-2b7794190cec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-e3794f56-ddcf-4904-aa74-2b7794190cec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:36.405633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:36.406546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:36.407372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:36.407372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:36.407372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:36.407372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:36.407372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:36.407372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:36.407372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:36.407372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:36.407372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:36.407372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:36.407372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:36.407372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:36.407372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 363/721] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:57:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:36.412353 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3794f56-ddcf-4904-aa74-2b7794190cec None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:36.412844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f37ae-4ab3-47f0-a8a4-92b86b65d9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:36.413510 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f37ae-4ab3-47f0-a8a4-92b86b65d9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:36.413790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f37ae-4ab3-47f0-a8a4-92b86b65d9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:36.414064 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f37ae-4ab3-47f0-a8a4-92b86b65d9c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:36.414889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f37ae-4ab3-47f0-a8a4-92b86b65d9c7 None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=5becb135afbd43e9bc0b1347ba04e2b5) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:36.415199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f37ae-4ab3-47f0-a8a4-92b86b65d9c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:36.417151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f37ae-4ab3-47f0-a8a4-92b86b65d9c7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:36.423508 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 359/722] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:36 2022] GET /identity/v3/role_assignments?user.id=5becb135afbd43e9bc0b1347ba04e2b5&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:36.532547 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3794f56-ddcf-4904-aa74-2b7794190cec None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:36.570833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47075bda-ddb2-489a-8873-b5ea6ed23a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:36.571919 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47075bda-ddb2-489a-8873-b5ea6ed23a99 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:36.572564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47075bda-ddb2-489a-8873-b5ea6ed23a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:36.573113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47075bda-ddb2-489a-8873-b5ea6ed23a99 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:36.574572 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47075bda-ddb2-489a-8873-b5ea6ed23a99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:36.575020 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47075bda-ddb2-489a-8873-b5ea6ed23a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:36.576665 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47075bda-ddb2-489a-8873-b5ea6ed23a99 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:36.585937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 364/723] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:36.591368 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f37ae-4ab3-47f0-a8a4-92b86b65d9c7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:36.745206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f37ae-4ab3-47f0-a8a4-92b86b65d9c7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:36.778725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540a79b-a7ef-43e9-b55d-a6f59610ef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:36.779521 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540a79b-a7ef-43e9-b55d-a6f59610ef37 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:36.779822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540a79b-a7ef-43e9-b55d-a6f59610ef37 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:36.780100 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540a79b-a7ef-43e9-b55d-a6f59610ef37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:36.790759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540a79b-a7ef-43e9-b55d-a6f59610ef37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:36.793130 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540a79b-a7ef-43e9-b55d-a6f59610ef37 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:36.810558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-9540a79b-a7ef-43e9-b55d-a6f59610ef37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:36.810558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:36.810558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:36.810558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:36.810558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:36.810558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:36.810558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:36.810558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:36.810558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:36.810558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:36.810558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:36.810558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:36.810558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:36.810558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:36.810558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:36.811532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:36.812476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:36.812476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:36.812476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:36.812476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:36.812476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 360/724] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:36.817477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47075bda-ddb2-489a-8873-b5ea6ed23a99 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:36.919928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47075bda-ddb2-489a-8873-b5ea6ed23a99 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:36.954429 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3c191-ffc1-4405-bd08-8d47550525a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:36.955089 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3c191-ffc1-4405-bd08-8d47550525a7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:36.955369 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3c191-ffc1-4405-bd08-8d47550525a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:36.955659 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3c191-ffc1-4405-bd08-8d47550525a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:36.956380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3c191-ffc1-4405-bd08-8d47550525a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:36.956683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3c191-ffc1-4405-bd08-8d47550525a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:36.958043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3c191-ffc1-4405-bd08-8d47550525a7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:36.971590 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 365/725] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:36.976684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540a79b-a7ef-43e9-b55d-a6f59610ef37 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:37.119080 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540a79b-a7ef-43e9-b55d-a6f59610ef37 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:37.170850 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d2f9a-3c6e-4f5f-b552-3288bf687272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:37.171667 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d2f9a-3c6e-4f5f-b552-3288bf687272 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:37.171949 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d2f9a-3c6e-4f5f-b552-3288bf687272 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:37.172264 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d2f9a-3c6e-4f5f-b552-3288bf687272 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:37.183887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d2f9a-3c6e-4f5f-b552-3288bf687272 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:37.185334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d2f9a-3c6e-4f5f-b552-3288bf687272 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-838d2f9a-3c6e-4f5f-b552-3288bf687272 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:37.207297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:37.208320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:37.209260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:37.209260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:37.209260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:37.209260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:37.209260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:37.209260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:37.209260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:37.209260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:37.209260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 16:57:37.209260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:37.209260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 361/726] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:57:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:37.214401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3c191-ffc1-4405-bd08-8d47550525a7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:37.334819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3c191-ffc1-4405-bd08-8d47550525a7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:37.368384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095b3ed-0a08-4d65-9a2e-b88c9fd12103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:37.368966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095b3ed-0a08-4d65-9a2e-b88c9fd12103 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:37.369274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095b3ed-0a08-4d65-9a2e-b88c9fd12103 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:37.369559 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095b3ed-0a08-4d65-9a2e-b88c9fd12103 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:37.371045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095b3ed-0a08-4d65-9a2e-b88c9fd12103 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:37.371346 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095b3ed-0a08-4d65-9a2e-b88c9fd12103 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:37.372798 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095b3ed-0a08-4d65-9a2e-b88c9fd12103 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:37.390126 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 366/727] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 17 16:57:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:37.395190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d2f9a-3c6e-4f5f-b552-3288bf687272 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:37.560374 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d2f9a-3c6e-4f5f-b552-3288bf687272 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:37.612306 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28088a-220e-4b6f-b617-7c2f361728ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:37.613238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28088a-220e-4b6f-b617-7c2f361728ca None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:37.613667 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28088a-220e-4b6f-b617-7c2f361728ca None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:37.614104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28088a-220e-4b6f-b617-7c2f361728ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:37.699311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42314eec-04f3-458e-9d40-7e67a03b047f None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:37.699721 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42314eec-04f3-458e-9d40-7e67a03b047f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:37.700124 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42314eec-04f3-458e-9d40-7e67a03b047f None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:37.701767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28088a-220e-4b6f-b617-7c2f361728ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:37.701897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 367/728] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:37.703330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28088a-220e-4b6f-b617-7c2f361728ca None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:37.706725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9e7f3-e14a-4caf-8bbe-5eb0c99d2061 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:37.707008 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9e7f3-e14a-4caf-8bbe-5eb0c99d2061 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:37.707282 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9e7f3-e14a-4caf-8bbe-5eb0c99d2061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:37.743428 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a9b9e7f3-e14a-4caf-8bbe-5eb0c99d2061 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:37.744640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a9b9e7f3-e14a-4caf-8bbe-5eb0c99d2061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:37.800972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 362/729] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 16:57:37.806229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28088a-220e-4b6f-b617-7c2f361728ca None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:37.904239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28088a-220e-4b6f-b617-7c2f361728ca None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:37.909060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 368/730] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:37.938554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb1d39-0173-4c42-a090-555252ff1794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:37.939353 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb1d39-0173-4c42-a090-555252ff1794 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:37.939655 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb1d39-0173-4c42-a090-555252ff1794 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:37.939936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb1d39-0173-4c42-a090-555252ff1794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:37.945041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9e7f3-e14a-4caf-8bbe-5eb0c99d2061 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:37.963555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb1d39-0173-4c42-a090-555252ff1794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:37.964964 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb1d39-0173-4c42-a090-555252ff1794 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:37.993509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-cfeb1d39-0173-4c42-a090-555252ff1794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:37.993509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:37.993509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:37.993509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:37.993509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:37.993509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:37.993509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:37.993509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:37.993509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:37.993509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:37.993509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:37.993509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:37.993509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:37.993509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:37.993509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:37.996775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:37.998861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:37.998861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:37.998861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:37.998861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:37.998861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 363/731] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:38.008795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb1d39-0173-4c42-a090-555252ff1794 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:38.127244 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9e7f3-e14a-4caf-8bbe-5eb0c99d2061 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:38.184232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12457eb-dce3-4d54-9225-873a4bdde89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:38.185412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12457eb-dce3-4d54-9225-873a4bdde89a None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:38.185833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12457eb-dce3-4d54-9225-873a4bdde89a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:38.186110 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12457eb-dce3-4d54-9225-873a4bdde89a None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:38.186995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12457eb-dce3-4d54-9225-873a4bdde89a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:38.188662 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12457eb-dce3-4d54-9225-873a4bdde89a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:38.202125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb1d39-0173-4c42-a090-555252ff1794 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:38.219449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 369/732] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 16:57:37 2022] POST /identity/v3/services => generated 251 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:57:38.256072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62d79e-2183-4952-9bad-ba3623e5c9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:38.256859 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62d79e-2183-4952-9bad-ba3623e5c9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:38.257152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62d79e-2183-4952-9bad-ba3623e5c9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:38.257432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62d79e-2183-4952-9bad-ba3623e5c9c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:38.258176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62d79e-2183-4952-9bad-ba3623e5c9c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:38.258483 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62d79e-2183-4952-9bad-ba3623e5c9c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:38.261104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62d79e-2183-4952-9bad-ba3623e5c9c3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:38.275781 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 364/733] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:38.281565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12457eb-dce3-4d54-9225-873a4bdde89a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:38.425319 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12457eb-dce3-4d54-9225-873a4bdde89a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:38.463752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cceb8-6ce4-4150-b0a0-bc6c1fcf5168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:38.464752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cceb8-6ce4-4150-b0a0-bc6c1fcf5168 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:38.465036 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cceb8-6ce4-4150-b0a0-bc6c1fcf5168 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:38.465364 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cceb8-6ce4-4150-b0a0-bc6c1fcf5168 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:38.472223 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5cceb8-6ce4-4150-b0a0-bc6c1fcf5168 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:38.473593 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5cceb8-6ce4-4150-b0a0-bc6c1fcf5168 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:38.488437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-8d5cceb8-6ce4-4150-b0a0-bc6c1fcf5168 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:38.488437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:38.488437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:38.488437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:38.488437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:38.488437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:38.488437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:38.488437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:38.488437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:38.488437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:38.488437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:38.488437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:38.488437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:38.488437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:38.488437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:38.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:38.492710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:38.492710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:38.492710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:38.492710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:38.492710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:38.492710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:38.492710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:38.492710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:38.492710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 370/734] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:38.499623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62d79e-2183-4952-9bad-ba3623e5c9c3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:38.611554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62d79e-2183-4952-9bad-ba3623e5c9c3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:38.649942 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2920a-116b-491a-b137-3653fcf6f08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:38.650613 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2920a-116b-491a-b137-3653fcf6f08e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:38.650896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2920a-116b-491a-b137-3653fcf6f08e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:38.651729 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2920a-116b-491a-b137-3653fcf6f08e None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:38.652660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2920a-116b-491a-b137-3653fcf6f08e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:38.652970 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2920a-116b-491a-b137-3653fcf6f08e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:38.654464 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2920a-116b-491a-b137-3653fcf6f08e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:38.667059 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 365/735] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:38.672399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cceb8-6ce4-4150-b0a0-bc6c1fcf5168 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:38.738801 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08348be2-66e4-43b5-9969-134751f67f18 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:38.739099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08348be2-66e4-43b5-9969-134751f67f18 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:38.739260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08348be2-66e4-43b5-9969-134751f67f18 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:38.740722 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 366/736] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:57:38.746621 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355a296-8d61-4730-ba3f-1afc40ea1da1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:38.746903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355a296-8d61-4730-ba3f-1afc40ea1da1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:38.747162 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355a296-8d61-4730-ba3f-1afc40ea1da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:38.772719 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a355a296-8d61-4730-ba3f-1afc40ea1da1 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:38.773889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a355a296-8d61-4730-ba3f-1afc40ea1da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:38.828227 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cceb8-6ce4-4150-b0a0-bc6c1fcf5168 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:38.863006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c597e15-f4dc-445c-81b5-c2931125a5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:38.863592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c597e15-f4dc-445c-81b5-c2931125a5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:38.863897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c597e15-f4dc-445c-81b5-c2931125a5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:38.864167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c597e15-f4dc-445c-81b5-c2931125a5b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:38.864987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c597e15-f4dc-445c-81b5-c2931125a5b8 None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=bc87aba3662244bea0428475bb0c9e8b) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:38.865295 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c597e15-f4dc-445c-81b5-c2931125a5b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:38.865562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 367/737] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 16:57:38.866836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c597e15-f4dc-445c-81b5-c2931125a5b8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:38.867053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7bfb1-efbf-41d6-b949-370007f70f71 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:38.867223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7bfb1-efbf-41d6-b949-370007f70f71 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:38.867506 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7bfb1-efbf-41d6-b949-370007f70f71 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:38.869292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 368/738] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:38.876985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38bdc1-1896-4ffa-ade9-309ff3db7429 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:38.877266 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38bdc1-1896-4ffa-ade9-309ff3db7429 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:38.877540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38bdc1-1896-4ffa-ade9-309ff3db7429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:38.882051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 371/739] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:38 2022] GET /identity/v3/role_assignments?user.id=bc87aba3662244bea0428475bb0c9e8b&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:38.888976 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c597e15-f4dc-445c-81b5-c2931125a5b8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:38.913520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5f38bdc1-1896-4ffa-ade9-309ff3db7429 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:38.914684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5f38bdc1-1896-4ffa-ade9-309ff3db7429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:39.004100 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c597e15-f4dc-445c-81b5-c2931125a5b8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:39.043431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8d84b-43dc-4ee5-b275-5a11ad2e998b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:39.044149 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8d84b-43dc-4ee5-b275-5a11ad2e998b None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:39.044426 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8d84b-43dc-4ee5-b275-5a11ad2e998b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:39.045218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8d84b-43dc-4ee5-b275-5a11ad2e998b None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:39.046267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8d84b-43dc-4ee5-b275-5a11ad2e998b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:39.047892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8d84b-43dc-4ee5-b275-5a11ad2e998b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:39.066228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 372/740] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 16:57:38 2022] POST /identity/v3/services => generated 240 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:57:39.083737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 369/741] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:39.107946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8d84b-43dc-4ee5-b275-5a11ad2e998b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:39.224231 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8d84b-43dc-4ee5-b275-5a11ad2e998b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:39.263594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edc9b7-2926-4e30-9e0f-c70e94f26916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:39.264437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edc9b7-2926-4e30-9e0f-c70e94f26916 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:39.264720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edc9b7-2926-4e30-9e0f-c70e94f26916 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:39.265145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edc9b7-2926-4e30-9e0f-c70e94f26916 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:39.278580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edc9b7-2926-4e30-9e0f-c70e94f26916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-01edc9b7-2926-4e30-9e0f-c70e94f26916 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:39.286565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:39.288884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:39.290907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:39.290907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:39.290907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:39.290907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:39.290907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:39.290907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:39.290907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:39.290907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:39.290907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:39.290907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:39.290907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:39.290907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:39.290907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 373/742] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:39.294076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38bdc1-1896-4ffa-ade9-309ff3db7429 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:39.464828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38bdc1-1896-4ffa-ade9-309ff3db7429 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:39.518964 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd81f74-b6e0-42bd-8ae3-4608313ee52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:39.519629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd81f74-b6e0-42bd-8ae3-4608313ee52e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:39.519986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd81f74-b6e0-42bd-8ae3-4608313ee52e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:39.520270 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd81f74-b6e0-42bd-8ae3-4608313ee52e None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:39.521023 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd81f74-b6e0-42bd-8ae3-4608313ee52e None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:39.521328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd81f74-b6e0-42bd-8ae3-4608313ee52e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:39.522708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd81f74-b6e0-42bd-8ae3-4608313ee52e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:39.530866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe53c3-7d6a-4a9a-a188-0dc7df27751c None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:39.531474 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe53c3-7d6a-4a9a-a188-0dc7df27751c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:39.531972 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe53c3-7d6a-4a9a-a188-0dc7df27751c None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:39.532599 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 370/743] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:39.534098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 374/744] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:39.538155 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd81f74-b6e0-42bd-8ae3-4608313ee52e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:39.539612 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e504e3a-743f-4e65-9770-00779b66ebcc None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:39.540122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e504e3a-743f-4e65-9770-00779b66ebcc None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:39.540594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e504e3a-743f-4e65-9770-00779b66ebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:39.561810 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5e504e3a-743f-4e65-9770-00779b66ebcc None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:39.563568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5e504e3a-743f-4e65-9770-00779b66ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:39.632395 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 375/745] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:57:39.641674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd81f74-b6e0-42bd-8ae3-4608313ee52e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:39.674895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e504e3a-743f-4e65-9770-00779b66ebcc None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:39.688844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373dd78-c115-470c-9e12-c5bb196665ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:39.690013 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373dd78-c115-470c-9e12-c5bb196665ca None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:39.691467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373dd78-c115-470c-9e12-c5bb196665ca None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:39.692449 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373dd78-c115-470c-9e12-c5bb196665ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:39.717157 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373dd78-c115-470c-9e12-c5bb196665ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:39.719792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373dd78-c115-470c-9e12-c5bb196665ca None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:39.754492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6373dd78-c115-470c-9e12-c5bb196665ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:39.754492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:39.754492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:39.754492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:39.754492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:39.754492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:39.754492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:39.754492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:39.754492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:39.754492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:39.754492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:39.754492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:39.754492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:39.754492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:39.754492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:39.755530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:39.756493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:39.756493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:39.756493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:39.756493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:39.759422 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 371/746] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:39.770168 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373dd78-c115-470c-9e12-c5bb196665ca None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:39.824048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e504e3a-743f-4e65-9770-00779b66ebcc None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:39.864999 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4b46-4326-43ed-8816-c1165d18998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:39.865810 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4b46-4326-43ed-8816-c1165d18998e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:39.866091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4b46-4326-43ed-8816-c1165d18998e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:39.866366 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4b46-4326-43ed-8816-c1165d18998e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:39.883430 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd4b46-4326-43ed-8816-c1165d18998e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-e6bd4b46-4326-43ed-8816-c1165d18998e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:39.891758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:39.892700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:39.893528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:39.893528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:39.893528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:39.893528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:39.893528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:39.893528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:39.893528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:39.893528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:39.893528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:39.893528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:39.893528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:39.893528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:39.893528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 376/747] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:57:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:39.900996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4b46-4326-43ed-8816-c1165d18998e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:39.935249 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373dd78-c115-470c-9e12-c5bb196665ca None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:39.984357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bb477-c1e1-4aa2-b128-0f3ad0eeb693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:39.985423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bb477-c1e1-4aa2-b128-0f3ad0eeb693 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:39.985904 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bb477-c1e1-4aa2-b128-0f3ad0eeb693 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:39.986375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bb477-c1e1-4aa2-b128-0f3ad0eeb693 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:39.987317 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bb477-c1e1-4aa2-b128-0f3ad0eeb693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:39.987856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bb477-c1e1-4aa2-b128-0f3ad0eeb693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:39.989436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bb477-c1e1-4aa2-b128-0f3ad0eeb693 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:40.002339 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 372/748] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:40.014656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bb477-c1e1-4aa2-b128-0f3ad0eeb693 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:40.081719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4b46-4326-43ed-8816-c1165d18998e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:40.115524 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bb477-c1e1-4aa2-b128-0f3ad0eeb693 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:40.149370 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7f169-a844-44b4-9c58-0a7260c0b99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:40.150179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7f169-a844-44b4-9c58-0a7260c0b99f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:40.150453 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7f169-a844-44b4-9c58-0a7260c0b99f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:40.150717 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7f169-a844-44b4-9c58-0a7260c0b99f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:40.158363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7f169-a844-44b4-9c58-0a7260c0b99f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:40.159820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7f169-a844-44b4-9c58-0a7260c0b99f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:40.168351 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837bea7-f3fd-4e95-8464-95e7f17e718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:40.169040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837bea7-f3fd-4e95-8464-95e7f17e718c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:40.169325 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837bea7-f3fd-4e95-8464-95e7f17e718c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:40.169606 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837bea7-f3fd-4e95-8464-95e7f17e718c None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:40.170361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837bea7-f3fd-4e95-8464-95e7f17e718c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:40.170671 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837bea7-f3fd-4e95-8464-95e7f17e718c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:40.172082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837bea7-f3fd-4e95-8464-95e7f17e718c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-9ef7f169-a844-44b4-9c58-0a7260c0b99f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:40.175300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:40.176237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:40.177179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:40.177179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:40.177179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:40.177179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:40.177179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:40.177179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:40.177179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:40.177179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:40.177179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 16:57:40.177179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:40.177179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 373/749] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 16:57:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:40.187398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7f169-a844-44b4-9c58-0a7260c0b99f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:40.192492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 377/750] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:40.196704 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837bea7-f3fd-4e95-8464-95e7f17e718c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:40.361840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7f169-a844-44b4-9c58-0a7260c0b99f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:40.366359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837bea7-f3fd-4e95-8464-95e7f17e718c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:40.421712 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209b807-49d5-49d2-b2a6-faa5748024d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:40.422509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209b807-49d5-49d2-b2a6-faa5748024d8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:40.422792 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209b807-49d5-49d2-b2a6-faa5748024d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:40.423069 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209b807-49d5-49d2-b2a6-faa5748024d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:40.424735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c50e33-9d1a-43a2-ae2f-4391f79e4c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:40.425396 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c50e33-9d1a-43a2-ae2f-4391f79e4c7c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:40.425670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c50e33-9d1a-43a2-ae2f-4391f79e4c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:40.425936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c50e33-9d1a-43a2-ae2f-4391f79e4c7c None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:40.426774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c50e33-9d1a-43a2-ae2f-4391f79e4c7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:40.427081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c50e33-9d1a-43a2-ae2f-4391f79e4c7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:40.428534 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c50e33-9d1a-43a2-ae2f-4391f79e4c7c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:40.455536 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 374/751] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 17 16:57:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:40.461664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209b807-49d5-49d2-b2a6-faa5748024d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:40.462927 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c50e33-9d1a-43a2-ae2f-4391f79e4c7c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:40.464407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209b807-49d5-49d2-b2a6-faa5748024d8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:40.500751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-e209b807-49d5-49d2-b2a6-faa5748024d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:40.500751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:40.500751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:40.500751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:40.500751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:40.500751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:40.500751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:40.500751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:40.500751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:40.500751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:40.500751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:40.500751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:40.500751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:40.500751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:40.500751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:40.501698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:40.502571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:40.502571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:40.502571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:40.502571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:40.504576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 378/752] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:40.510158 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209b807-49d5-49d2-b2a6-faa5748024d8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:40.567199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c50e33-9d1a-43a2-ae2f-4391f79e4c7c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:40.609656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cabdf-8aa0-404f-bd64-e1c8db20231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:40.610310 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cabdf-8aa0-404f-bd64-e1c8db20231d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:40.610589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cabdf-8aa0-404f-bd64-e1c8db20231d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:40.615336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cabdf-8aa0-404f-bd64-e1c8db20231d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:40.727440 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cabdf-8aa0-404f-bd64-e1c8db20231d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:40.728930 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cabdf-8aa0-404f-bd64-e1c8db20231d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:40.744721 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209b807-49d5-49d2-b2a6-faa5748024d8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:40.808536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2a073-13d5-4df5-bd9c-91904a4867c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:40.809221 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2a073-13d5-4df5-bd9c-91904a4867c9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:40.809505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2a073-13d5-4df5-bd9c-91904a4867c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:40.809778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2a073-13d5-4df5-bd9c-91904a4867c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:40.810503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2a073-13d5-4df5-bd9c-91904a4867c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:40.810804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2a073-13d5-4df5-bd9c-91904a4867c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:40.812213 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2a073-13d5-4df5-bd9c-91904a4867c9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:40.830247 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 375/753] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 16:57:40.833221 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 379/754] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:40.835557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cabdf-8aa0-404f-bd64-e1c8db20231d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:40.838673 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2a073-13d5-4df5-bd9c-91904a4867c9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:40.934783 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cabdf-8aa0-404f-bd64-e1c8db20231d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:40.940767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2a073-13d5-4df5-bd9c-91904a4867c9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:40.970176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98441e30-1cc1-493c-b69e-58b476f254fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:40.970973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98441e30-1cc1-493c-b69e-58b476f254fd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:40.971248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98441e30-1cc1-493c-b69e-58b476f254fd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:40.971697 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98441e30-1cc1-493c-b69e-58b476f254fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:40.974669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdd59b-7255-4db3-af35-a07e651d3426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:40.975459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdd59b-7255-4db3-af35-a07e651d3426 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:40.975770 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdd59b-7255-4db3-af35-a07e651d3426 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:40.976046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdd59b-7255-4db3-af35-a07e651d3426 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:40.983021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98441e30-1cc1-493c-b69e-58b476f254fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:40.983563 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdd59b-7255-4db3-af35-a07e651d3426 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:40.984496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98441e30-1cc1-493c-b69e-58b476f254fd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:40.985081 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdd59b-7255-4db3-af35-a07e651d3426 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-26bdd59b-7255-4db3-af35-a07e651d3426 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:41.000161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:41.002420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:41.004711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:41.004711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:41.004711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:41.004711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:41.004711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:41.004711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:41.004711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:41.004711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:41.004711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 16:57:41.004711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:41.004711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 380/755] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 16:57:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:41.006104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-98441e30-1cc1-493c-b69e-58b476f254fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:41.006104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:41.006104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:41.006104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:41.006104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:41.006104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:41.006104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:41.006104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:41.006104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:41.006104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:41.006104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:41.006104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:41.006104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:41.006104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:41.006104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:41.012349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:41.014482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:41.014482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:41.014482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:41.014482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:41.014482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 376/756] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:41.015129 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdd59b-7255-4db3-af35-a07e651d3426 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:41.015275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98441e30-1cc1-493c-b69e-58b476f254fd None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:41.171662 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98441e30-1cc1-493c-b69e-58b476f254fd None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:41.178448 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdd59b-7255-4db3-af35-a07e651d3426 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:41.216262 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7615c3-ddff-4b83-abd3-a1d2a90810e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:41.216590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ded162-467d-4592-a73a-3fd8b824ecbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:41.217270 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ded162-467d-4592-a73a-3fd8b824ecbe None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:41.217547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ded162-467d-4592-a73a-3fd8b824ecbe None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:41.217823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ded162-467d-4592-a73a-3fd8b824ecbe None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:41.218149 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7615c3-ddff-4b83-abd3-a1d2a90810e1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:41.218542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ded162-467d-4592-a73a-3fd8b824ecbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:41.218846 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ded162-467d-4592-a73a-3fd8b824ecbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:41.219038 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7615c3-ddff-4b83-abd3-a1d2a90810e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:41.219511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7615c3-ddff-4b83-abd3-a1d2a90810e1 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:41.220241 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ded162-467d-4592-a73a-3fd8b824ecbe None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:41.220892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7615c3-ddff-4b83-abd3-a1d2a90810e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:41.221419 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7615c3-ddff-4b83-abd3-a1d2a90810e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:41.223049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7615c3-ddff-4b83-abd3-a1d2a90810e1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:41.235322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 377/757] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:41.242102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ded162-467d-4592-a73a-3fd8b824ecbe None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:41.243577 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 381/758] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 16:57:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:41.252674 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7615c3-ddff-4b83-abd3-a1d2a90810e1 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:41.349396 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ded162-467d-4592-a73a-3fd8b824ecbe None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:41.364737 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7615c3-ddff-4b83-abd3-a1d2a90810e1 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:41.386958 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f524b6-ca5b-4572-8bd2-ed7da8591fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:41.388348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f524b6-ca5b-4572-8bd2-ed7da8591fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:41.388880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f524b6-ca5b-4572-8bd2-ed7da8591fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:41.389366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f524b6-ca5b-4572-8bd2-ed7da8591fd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:41.397504 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f524b6-ca5b-4572-8bd2-ed7da8591fd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:41.399349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f524b6-ca5b-4572-8bd2-ed7da8591fd6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:41.404917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3b2f9-9e66-4902-b117-7a3c3af8bf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:41.405717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3b2f9-9e66-4902-b117-7a3c3af8bf92 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:41.406000 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3b2f9-9e66-4902-b117-7a3c3af8bf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:41.406270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3b2f9-9e66-4902-b117-7a3c3af8bf92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:41.417696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3b2f9-9e66-4902-b117-7a3c3af8bf92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:41.418062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-07f524b6-ca5b-4572-8bd2-ed7da8591fd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:41.418062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:41.418062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:41.418062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:41.418062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:41.418062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:41.418062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:41.418062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:41.418062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:41.418062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:41.418062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:41.418062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:41.418062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:41.418062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:41.418062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:41.418923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:41.420203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:41.420203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:41.420203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:41.420203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:41.420203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:41.420203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:41.420203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:41.420203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:41.420626 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3b2f9-9e66-4902-b117-7a3c3af8bf92 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:41.422487 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 378/759] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:41.424050 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e02b03-007c-415e-b13e-cd1586118c06 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:41.424575 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e02b03-007c-415e-b13e-cd1586118c06 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:41.425053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e02b03-007c-415e-b13e-cd1586118c06 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:41.426525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 379/760] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:41.428830 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e02b03-007c-415e-b13e-cd1586118c06 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:41.442823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-08c3b2f9-9e66-4902-b117-7a3c3af8bf92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:41.442823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:41.442823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:41.442823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:41.442823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:41.442823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:41.442823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:41.442823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:41.442823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:41.442823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:41.442823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:41.442823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:41.442823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:41.442823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:41.442823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:41.443824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:41.444724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:41.444724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:41.444724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:41.444724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:41.444724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 382/761] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:41.446288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a849a-582d-4356-862e-c092984a2f7c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:41.446565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a849a-582d-4356-862e-c092984a2f7c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:41.446836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a849a-582d-4356-862e-c092984a2f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:41.463774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-704a849a-582d-4356-862e-c092984a2f7c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:41.464928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-704a849a-582d-4356-862e-c092984a2f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:41.535940 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 383/762] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:57:41.536761 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a849a-582d-4356-862e-c092984a2f7c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:41.538828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e02b03-007c-415e-b13e-cd1586118c06 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:41.578736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a3c87-f18f-4f4a-b456-796517b0778f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:41.579859 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a3c87-f18f-4f4a-b456-796517b0778f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:41.580373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a3c87-f18f-4f4a-b456-796517b0778f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:41.580865 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a3c87-f18f-4f4a-b456-796517b0778f None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:41.581724 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a3c87-f18f-4f4a-b456-796517b0778f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:41.582045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a3c87-f18f-4f4a-b456-796517b0778f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:41.583486 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a3c87-f18f-4f4a-b456-796517b0778f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:41.595640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 380/763] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:41.596483 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a3c87-f18f-4f4a-b456-796517b0778f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:41.657374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a849a-582d-4356-862e-c092984a2f7c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:41.693797 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a3c87-f18f-4f4a-b456-796517b0778f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:41.694820 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677fca3-a35c-4695-a45b-7bf3d60811b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:41.695779 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677fca3-a35c-4695-a45b-7bf3d60811b6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:41.696068 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677fca3-a35c-4695-a45b-7bf3d60811b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:41.697274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677fca3-a35c-4695-a45b-7bf3d60811b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:41.698298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677fca3-a35c-4695-a45b-7bf3d60811b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:41.698609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677fca3-a35c-4695-a45b-7bf3d60811b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:41.700071 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677fca3-a35c-4695-a45b-7bf3d60811b6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:41.713152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 384/764] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:41.715335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e2dee-6997-4afd-b39d-0555d47ba67c None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:41.715636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e2dee-6997-4afd-b39d-0555d47ba67c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:41.715914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e2dee-6997-4afd-b39d-0555d47ba67c None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:41.717430 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 385/765] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:41.718011 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e2dee-6997-4afd-b39d-0555d47ba67c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:41.736290 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166a9c5-e3c2-4e64-beb5-e836e4d388d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:41.737098 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166a9c5-e3c2-4e64-beb5-e836e4d388d7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:41.737373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166a9c5-e3c2-4e64-beb5-e836e4d388d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:41.737641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166a9c5-e3c2-4e64-beb5-e836e4d388d7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:41.738286 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166a9c5-e3c2-4e64-beb5-e836e4d388d7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:41.739665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166a9c5-e3c2-4e64-beb5-e836e4d388d7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b166a9c5-e3c2-4e64-beb5-e836e4d388d7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:41.751854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:41.752894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:41.753737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 381/766] 10.222.0.48 () {56 vars in 1129 bytes} [Tue May 17 16:57:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:41.755212 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166a9c5-e3c2-4e64-beb5-e836e4d388d7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:41.824857 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e2dee-6997-4afd-b39d-0555d47ba67c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:41.858622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166a9c5-e3c2-4e64-beb5-e836e4d388d7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:41.860607 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c7063-7aa9-4581-be2d-dc7e726afd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:41.861273 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c7063-7aa9-4581-be2d-dc7e726afd03 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:41.861557 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c7063-7aa9-4581-be2d-dc7e726afd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:41.861836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c7063-7aa9-4581-be2d-dc7e726afd03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:41.862665 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c7063-7aa9-4581-be2d-dc7e726afd03 None admin] RBAC: Adding query filter params (role.id=958871a8463d49d89ddade803adb47c4, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=c0b16bc0880a4e12879ebb512ebb848b) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:41.862978 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c7063-7aa9-4581-be2d-dc7e726afd03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:41.864420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c7063-7aa9-4581-be2d-dc7e726afd03 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:41.872385 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 386/767] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:41 2022] GET /identity/v3/role_assignments?user.id=c0b16bc0880a4e12879ebb512ebb848b&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=958871a8463d49d89ddade803adb47c4 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:41.873879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad9eb1-f762-4093-adf6-e1b0a2209507 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:41.874232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad9eb1-f762-4093-adf6-e1b0a2209507 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:41.874575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad9eb1-f762-4093-adf6-e1b0a2209507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:41.892929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-27ad9eb1-f762-4093-adf6-e1b0a2209507 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:41.894259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-27ad9eb1-f762-4093-adf6-e1b0a2209507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:41.906920 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40bd62-5f23-45bd-8ede-d995572cd2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:41.907784 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40bd62-5f23-45bd-8ede-d995572cd2ec None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:41.908066 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40bd62-5f23-45bd-8ede-d995572cd2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:41.908341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40bd62-5f23-45bd-8ede-d995572cd2ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:41.915773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40bd62-5f23-45bd-8ede-d995572cd2ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:41.917289 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40bd62-5f23-45bd-8ede-d995572cd2ec None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:41.932790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-de40bd62-5f23-45bd-8ede-d995572cd2ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:41.932790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:41.932790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:41.932790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:41.932790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:41.932790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:41.932790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:41.932790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:41.932790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:41.932790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:41.932790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:41.932790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:41.932790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:41.932790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:41.932790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:41.933759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:41.934632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:41.934632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:41.934632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:41.934632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:41.934632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:41.934632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:41.934632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:41.934632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:41.934632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 382/768] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:41.935103 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40bd62-5f23-45bd-8ede-d995572cd2ec None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:41.969074 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 387/769] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:41.970555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7e6fa-9220-4ec6-a99d-ba8a6dcbcbfb None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:41.970929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7e6fa-9220-4ec6-a99d-ba8a6dcbcbfb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:41.971275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7e6fa-9220-4ec6-a99d-ba8a6dcbcbfb None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:41.972865 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 388/770] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:41.977733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7e6fa-9220-4ec6-a99d-ba8a6dcbcbfb None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:42.052862 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40bd62-5f23-45bd-8ede-d995572cd2ec None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:42.093193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7e6fa-9220-4ec6-a99d-ba8a6dcbcbfb None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:42.093449 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e88382-a6a1-40ec-bf47-d8774899e057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:42.094077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e88382-a6a1-40ec-bf47-d8774899e057 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:42.094359 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e88382-a6a1-40ec-bf47-d8774899e057 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:42.094798 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e88382-a6a1-40ec-bf47-d8774899e057 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:42.095525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e88382-a6a1-40ec-bf47-d8774899e057 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:42.095875 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e88382-a6a1-40ec-bf47-d8774899e057 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:42.097253 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e88382-a6a1-40ec-bf47-d8774899e057 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:42.101883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 383/771] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 17 16:57:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:42.103102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f40dde-0e96-42ae-a093-c74fc9c5300a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:42.103386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f40dde-0e96-42ae-a093-c74fc9c5300a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:42.103694 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f40dde-0e96-42ae-a093-c74fc9c5300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:42.119558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a7f40dde-0e96-42ae-a093-c74fc9c5300a None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:42.120781 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a7f40dde-0e96-42ae-a093-c74fc9c5300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:42.133853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c558a-925b-4975-bc5a-1ba89b1addb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:42.134516 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c558a-925b-4975-bc5a-1ba89b1addb9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:42.134797 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c558a-925b-4975-bc5a-1ba89b1addb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:42.135071 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c558a-925b-4975-bc5a-1ba89b1addb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:42.136430 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c558a-925b-4975-bc5a-1ba89b1addb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:42.136738 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c558a-925b-4975-bc5a-1ba89b1addb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:42.138166 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c558a-925b-4975-bc5a-1ba89b1addb9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:42.149670 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 389/772] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:42.150459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c558a-925b-4975-bc5a-1ba89b1addb9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:42.203160 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 384/773] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:42.203160 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f40dde-0e96-42ae-a093-c74fc9c5300a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:42.311711 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f40dde-0e96-42ae-a093-c74fc9c5300a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:42.347834 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16977d7f-58e5-4e2b-bfca-8361f2a949a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:42.348419 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16977d7f-58e5-4e2b-bfca-8361f2a949a2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:42.348700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16977d7f-58e5-4e2b-bfca-8361f2a949a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:42.348974 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16977d7f-58e5-4e2b-bfca-8361f2a949a2 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:42.349684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16977d7f-58e5-4e2b-bfca-8361f2a949a2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:42.349988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16977d7f-58e5-4e2b-bfca-8361f2a949a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:42.351360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16977d7f-58e5-4e2b-bfca-8361f2a949a2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:42.361262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 385/774] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 17 16:57:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:42.361262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16977d7f-58e5-4e2b-bfca-8361f2a949a2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:42.382714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c558a-925b-4975-bc5a-1ba89b1addb9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:42.422974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1197b6e-5c4f-4dd8-b247-f81774aae4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:42.424027 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1197b6e-5c4f-4dd8-b247-f81774aae4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:42.424312 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1197b6e-5c4f-4dd8-b247-f81774aae4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:42.424590 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1197b6e-5c4f-4dd8-b247-f81774aae4b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:42.439625 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1197b6e-5c4f-4dd8-b247-f81774aae4b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-c1197b6e-5c4f-4dd8-b247-f81774aae4b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:42.444408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:42.445363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:42.446225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:42.446225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:42.446225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:42.446225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:42.446225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:42.446225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:42.446225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:42.446225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:42.446225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:42.446225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:42.446225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:42.446225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:42.446225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 390/775] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:57:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:42.448409 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1197b6e-5c4f-4dd8-b247-f81774aae4b6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:42.462462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16977d7f-58e5-4e2b-bfca-8361f2a949a2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:42.497411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2951f-035a-4d05-a85a-37ae47325c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:42.498312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2951f-035a-4d05-a85a-37ae47325c7b None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:42.498597 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2951f-035a-4d05-a85a-37ae47325c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:42.498874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2951f-035a-4d05-a85a-37ae47325c7b None admin] PATH_INFO: `/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/5becb135afbd43e9bc0b1347ba04e2b5/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:42.500876 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2951f-035a-4d05-a85a-37ae47325c7b None admin] RBAC: Authorizing `identity:create_grant(project_id=b2b356e72cf84d099f2ce8678103ecef, user_id=5becb135afbd43e9bc0b1347ba04e2b5, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:42.502310 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2951f-035a-4d05-a85a-37ae47325c7b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:42.516212 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 386/776] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:57:42 2022] PUT /identity/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/5becb135afbd43e9bc0b1347ba04e2b5/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:57:42.517344 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2951f-035a-4d05-a85a-37ae47325c7b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:42.572491 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1197b6e-5c4f-4dd8-b247-f81774aae4b6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:42.616937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07178bab-21e1-408f-84eb-693c5c162ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:42.618257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07178bab-21e1-408f-84eb-693c5c162ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:42.618776 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07178bab-21e1-408f-84eb-693c5c162ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:42.619293 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07178bab-21e1-408f-84eb-693c5c162ad8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:42.620421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07178bab-21e1-408f-84eb-693c5c162ad8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:42.622420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07178bab-21e1-408f-84eb-693c5c162ad8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-07178bab-21e1-408f-84eb-693c5c162ad8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:42.636135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:42.637257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:42.638082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:42.638082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:42.638082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:42.638082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:42.638082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:42.638082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:42.638082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:42.638082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:42.638082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:42.638082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:42.638082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:57:42.638082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:42.638082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 16:57:42.638082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:42.641199 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 391/777] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:42 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:42.642872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07178bab-21e1-408f-84eb-693c5c162ad8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:42.645979 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2951f-035a-4d05-a85a-37ae47325c7b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:42.694434 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51734758-48dd-420e-8aff-448a82a79506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:42.695126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51734758-48dd-420e-8aff-448a82a79506 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:42.695463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51734758-48dd-420e-8aff-448a82a79506 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:42.695777 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51734758-48dd-420e-8aff-448a82a79506 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:42.696584 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51734758-48dd-420e-8aff-448a82a79506 None admin] RBAC: Adding query filter params (interface=public, service_id=0c6a516ee45a4349b4f8a6de87fc071f, region_id=RegionOne) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:42.696895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51734758-48dd-420e-8aff-448a82a79506 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:42.699817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51734758-48dd-420e-8aff-448a82a79506 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:42.709236 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 387/778] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 16:57:42 2022] GET /identity/v3/endpoints?service_id=0c6a516ee45a4349b4f8a6de87fc071f&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:42.710446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51734758-48dd-420e-8aff-448a82a79506 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:42.758499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07178bab-21e1-408f-84eb-693c5c162ad8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:42.794329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c856e-9ec3-441c-b63d-5e47b1139034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:42.795436 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c856e-9ec3-441c-b63d-5e47b1139034 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:42.795973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c856e-9ec3-441c-b63d-5e47b1139034 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:42.796481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c856e-9ec3-441c-b63d-5e47b1139034 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:42.797422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c856e-9ec3-441c-b63d-5e47b1139034 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:42.797927 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c856e-9ec3-441c-b63d-5e47b1139034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:42.799478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c856e-9ec3-441c-b63d-5e47b1139034 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:42.809018 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 392/779] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:42.810219 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c856e-9ec3-441c-b63d-5e47b1139034 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:42.812786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51734758-48dd-420e-8aff-448a82a79506 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:42.847296 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64047b5e-70a6-4ea4-96d0-d5abfbdd7577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:42.847994 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64047b5e-70a6-4ea4-96d0-d5abfbdd7577 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:42.848273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64047b5e-70a6-4ea4-96d0-d5abfbdd7577 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:42.848548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64047b5e-70a6-4ea4-96d0-d5abfbdd7577 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:42.849254 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64047b5e-70a6-4ea4-96d0-d5abfbdd7577 None admin] RBAC: Adding query filter params (name=network) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:42.849559 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64047b5e-70a6-4ea4-96d0-d5abfbdd7577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:42.850934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64047b5e-70a6-4ea4-96d0-d5abfbdd7577 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:42.855879 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 388/780] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 16:57:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:42.856921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64047b5e-70a6-4ea4-96d0-d5abfbdd7577 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:42.914103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c856e-9ec3-441c-b63d-5e47b1139034 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:42.950094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d402f91-caf7-4e89-aaab-9a770caf1982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:42.951161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d402f91-caf7-4e89-aaab-9a770caf1982 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:42.951700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d402f91-caf7-4e89-aaab-9a770caf1982 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:42.952179 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d402f91-caf7-4e89-aaab-9a770caf1982 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:42.953051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d402f91-caf7-4e89-aaab-9a770caf1982 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:42.954611 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d402f91-caf7-4e89-aaab-9a770caf1982 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:42.960505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 393/781] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 16:57:42 2022] GET /identity/v3/services => generated 772 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:42.960751 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64047b5e-70a6-4ea4-96d0-d5abfbdd7577 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:42.961742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d402f91-caf7-4e89-aaab-9a770caf1982 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:43.030907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6cd81-0cca-4b9b-b09d-16e83752cac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:43.033829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6cd81-0cca-4b9b-b09d-16e83752cac4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:43.033829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6cd81-0cca-4b9b-b09d-16e83752cac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:43.034032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6cd81-0cca-4b9b-b09d-16e83752cac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:43.058523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6cd81-0cca-4b9b-b09d-16e83752cac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:43.060019 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6cd81-0cca-4b9b-b09d-16e83752cac4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:43.077226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d402f91-caf7-4e89-aaab-9a770caf1982 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:43.081240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-69b6cd81-0cca-4b9b-b09d-16e83752cac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:43.081240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:43.081240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:43.081240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:43.081240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:43.081240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:43.081240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:43.081240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:43.081240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:43.081240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:43.081240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:43.081240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:43.081240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:43.081240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:43.081240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:43.082118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:43.083653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:43.083653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:43.083653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:43.083653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:43.083653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 389/782] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:43.089170 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6cd81-0cca-4b9b-b09d-16e83752cac4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:43.119874 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96fe8c-9787-4a26-80ec-32ae2e21ea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:43.120954 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96fe8c-9787-4a26-80ec-32ae2e21ea07 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:43.121438 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96fe8c-9787-4a26-80ec-32ae2e21ea07 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:43.121909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96fe8c-9787-4a26-80ec-32ae2e21ea07 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:43.122826 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96fe8c-9787-4a26-80ec-32ae2e21ea07 None admin] RBAC: Adding query filter params (type=network) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:43.123376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96fe8c-9787-4a26-80ec-32ae2e21ea07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:43.125041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96fe8c-9787-4a26-80ec-32ae2e21ea07 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:43.131436 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 394/783] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 16:57:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:43.138864 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96fe8c-9787-4a26-80ec-32ae2e21ea07 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:43.259412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96fe8c-9787-4a26-80ec-32ae2e21ea07 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:43.297800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab8e8a-8165-451e-8981-e8b46148b219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:43.298846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab8e8a-8165-451e-8981-e8b46148b219 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:43.299347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab8e8a-8165-451e-8981-e8b46148b219 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:43.300010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab8e8a-8165-451e-8981-e8b46148b219 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:43.300994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab8e8a-8165-451e-8981-e8b46148b219 None admin] RBAC: Adding query filter params (interface=public, service_id=74e2548217a4449781565a9dbb39beb0, region_id=RegionOne) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:43.301579 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab8e8a-8165-451e-8981-e8b46148b219 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:43.303380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab8e8a-8165-451e-8981-e8b46148b219 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:43.313384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 395/784] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 16:57:43 2022] GET /identity/v3/endpoints?service_id=74e2548217a4449781565a9dbb39beb0&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:43.315356 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6cd81-0cca-4b9b-b09d-16e83752cac4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:43.321819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab8e8a-8165-451e-8981-e8b46148b219 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:43.354192 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50466a48-baf7-40b4-8f5c-0cc40cb21562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:43.354740 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50466a48-baf7-40b4-8f5c-0cc40cb21562 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:43.355024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50466a48-baf7-40b4-8f5c-0cc40cb21562 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:43.355302 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50466a48-baf7-40b4-8f5c-0cc40cb21562 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:43.356056 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50466a48-baf7-40b4-8f5c-0cc40cb21562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:43.356356 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50466a48-baf7-40b4-8f5c-0cc40cb21562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:43.357725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50466a48-baf7-40b4-8f5c-0cc40cb21562 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:43.370496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 390/785] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:43.376686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50466a48-baf7-40b4-8f5c-0cc40cb21562 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:43.442355 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab8e8a-8165-451e-8981-e8b46148b219 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:43.486589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50466a48-baf7-40b4-8f5c-0cc40cb21562 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:43.491048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21678ad-d37d-400f-ae8f-b1733a95594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:43.491752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21678ad-d37d-400f-ae8f-b1733a95594f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:43.492037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21678ad-d37d-400f-ae8f-b1733a95594f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:43.492315 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21678ad-d37d-400f-ae8f-b1733a95594f None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:43.493001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21678ad-d37d-400f-ae8f-b1733a95594f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:43.494364 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21678ad-d37d-400f-ae8f-b1733a95594f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:43.508055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 396/786] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 16:57:43 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:43.522941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b1bd-cf84-4bd0-bcb8-18a6eaf54067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:43.523796 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b1bd-cf84-4bd0-bcb8-18a6eaf54067 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:43.524084 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b1bd-cf84-4bd0-bcb8-18a6eaf54067 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:43.524361 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31b1bd-cf84-4bd0-bcb8-18a6eaf54067 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:43.532866 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31b1bd-cf84-4bd0-bcb8-18a6eaf54067 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:43.534507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31b1bd-cf84-4bd0-bcb8-18a6eaf54067 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-df31b1bd-cf84-4bd0-bcb8-18a6eaf54067 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:43.551489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:43.552523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:43.554494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:43.554494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:43.554494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:43.554494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:43.554494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:43.554494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:43.554494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:43.554494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:43.554494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 16:57:43.554494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:43.554494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 391/787] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:57:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:43.558855 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21678ad-d37d-400f-ae8f-b1733a95594f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:43.669473 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21678ad-d37d-400f-ae8f-b1733a95594f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:43.705986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d8a61-7a60-4f9d-a382-8a41e371b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:43.706675 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d8a61-7a60-4f9d-a382-8a41e371b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:43.706961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d8a61-7a60-4f9d-a382-8a41e371b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:43.707241 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d8a61-7a60-4f9d-a382-8a41e371b6d1 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:43.708132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d8a61-7a60-4f9d-a382-8a41e371b6d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:43.708463 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d8a61-7a60-4f9d-a382-8a41e371b6d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:43.709895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d8a61-7a60-4f9d-a382-8a41e371b6d1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:43.742013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 397/788] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 17 16:57:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:43.747581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b1bd-cf84-4bd0-bcb8-18a6eaf54067 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:43.856598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31b1bd-cf84-4bd0-bcb8-18a6eaf54067 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:43.892400 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a056e47-6432-44f2-9f80-040f3f844aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:43.893213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a056e47-6432-44f2-9f80-040f3f844aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:43.893496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a056e47-6432-44f2-9f80-040f3f844aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:43.893774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a056e47-6432-44f2-9f80-040f3f844aa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:43.904995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a056e47-6432-44f2-9f80-040f3f844aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:43.906517 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a056e47-6432-44f2-9f80-040f3f844aa9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:43.925423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5a056e47-6432-44f2-9f80-040f3f844aa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:43.925423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:43.925423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:43.925423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:43.925423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:43.925423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:43.925423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:43.925423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:43.925423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:43.925423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:43.925423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:43.925423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:43.925423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:43.925423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:43.925423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:43.927583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:43.929856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:43.929856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:43.929856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:43.929856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:43.929856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 392/789] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:43.932896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d8a61-7a60-4f9d-a382-8a41e371b6d1 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:44.048671 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d8a61-7a60-4f9d-a382-8a41e371b6d1 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:44.096260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3accf-b020-4b57-a0b6-6d54f5e1bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:44.096260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3accf-b020-4b57-a0b6-6d54f5e1bd26 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:44.096260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3accf-b020-4b57-a0b6-6d54f5e1bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:44.096260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3accf-b020-4b57-a0b6-6d54f5e1bd26 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:44.096644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3accf-b020-4b57-a0b6-6d54f5e1bd26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:44.096644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3accf-b020-4b57-a0b6-6d54f5e1bd26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:44.097201 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3accf-b020-4b57-a0b6-6d54f5e1bd26 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:44.109254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 398/790] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:44.114395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a056e47-6432-44f2-9f80-040f3f844aa9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:44.236701 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f46a3b-0747-4097-93df-82e7e6d907d9 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:44.237043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f46a3b-0747-4097-93df-82e7e6d907d9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:44.237283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f46a3b-0747-4097-93df-82e7e6d907d9 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:44.238937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 399/791] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:44.245057 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41e6b7-2ad2-4c0f-9ffc-141ce60f419d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:44.245268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41e6b7-2ad2-4c0f-9ffc-141ce60f419d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:44.245568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41e6b7-2ad2-4c0f-9ffc-141ce60f419d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:44.262928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-9f41e6b7-2ad2-4c0f-9ffc-141ce60f419d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:44.264125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9f41e6b7-2ad2-4c0f-9ffc-141ce60f419d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:44.286078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a056e47-6432-44f2-9f80-040f3f844aa9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:44.331469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 400/792] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:57:44.352928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460d92f-7f3f-4ac5-88be-5f51aa773f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:44.354913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460d92f-7f3f-4ac5-88be-5f51aa773f12 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:44.355202 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41e6b7-2ad2-4c0f-9ffc-141ce60f419d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:44.355719 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460d92f-7f3f-4ac5-88be-5f51aa773f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:44.356206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460d92f-7f3f-4ac5-88be-5f51aa773f12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:44.367791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460d92f-7f3f-4ac5-88be-5f51aa773f12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:44.369953 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460d92f-7f3f-4ac5-88be-5f51aa773f12 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:44.399363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-7460d92f-7f3f-4ac5-88be-5f51aa773f12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:44.399363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:44.399363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:44.399363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:44.399363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:44.399363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:44.399363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:44.399363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:44.399363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:44.399363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:44.399363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:44.399363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:44.399363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:44.399363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:44.399363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:44.400328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:44.401427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:44.401427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:44.401427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:44.401427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:44.401427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:44.401427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:44.401427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:44.401427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:44.405495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 393/793] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:44.411289 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460d92f-7f3f-4ac5-88be-5f51aa773f12 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:44.534812 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41e6b7-2ad2-4c0f-9ffc-141ce60f419d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:44.600856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460d92f-7f3f-4ac5-88be-5f51aa773f12 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:44.607635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ae77d-53ec-4677-aec2-22628b3b5055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:44.607635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ae77d-53ec-4677-aec2-22628b3b5055 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:44.607635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ae77d-53ec-4677-aec2-22628b3b5055 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:44.607635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ae77d-53ec-4677-aec2-22628b3b5055 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:44.625038 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ae77d-53ec-4677-aec2-22628b3b5055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-041ae77d-53ec-4677-aec2-22628b3b5055 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:44.633624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:44.634566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:44.635434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:44.635434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:44.635434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:44.635434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:44.635434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:44.635434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:44.635434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:44.635434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:44.635434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:44.635434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:44.635434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:44.635434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:44.641259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 401/794] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:44.646939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ae77d-53ec-4677-aec2-22628b3b5055 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:44.672632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8285d-06c1-4a16-9657-30ecbbc19832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:44.673299 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8285d-06c1-4a16-9657-30ecbbc19832 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:44.673578 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8285d-06c1-4a16-9657-30ecbbc19832 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:44.673849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8285d-06c1-4a16-9657-30ecbbc19832 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:44.674635 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8285d-06c1-4a16-9657-30ecbbc19832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:44.674940 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8285d-06c1-4a16-9657-30ecbbc19832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:44.676405 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8285d-06c1-4a16-9657-30ecbbc19832 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:44.699965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 394/795] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:44.704838 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8285d-06c1-4a16-9657-30ecbbc19832 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:44.824312 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ae77d-53ec-4677-aec2-22628b3b5055 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:44.874504 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8285d-06c1-4a16-9657-30ecbbc19832 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:44.885581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cdff9-a94f-423d-bec4-ec3d882f70c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:44.886222 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cdff9-a94f-423d-bec4-ec3d882f70c9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:44.886504 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cdff9-a94f-423d-bec4-ec3d882f70c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:44.886778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cdff9-a94f-423d-bec4-ec3d882f70c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:44.887517 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cdff9-a94f-423d-bec4-ec3d882f70c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:44.887917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cdff9-a94f-423d-bec4-ec3d882f70c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:44.889284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cdff9-a94f-423d-bec4-ec3d882f70c9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:44.903910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 402/796] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:44.911118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cdff9-a94f-423d-bec4-ec3d882f70c9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:44.942215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb1e03-05ff-4f77-980c-6df954b1a45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:44.943102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb1e03-05ff-4f77-980c-6df954b1a45c None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:44.943386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb1e03-05ff-4f77-980c-6df954b1a45c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:44.944457 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb1e03-05ff-4f77-980c-6df954b1a45c None admin] PATH_INFO: `/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/bc87aba3662244bea0428475bb0c9e8b/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:44.949190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb1e03-05ff-4f77-980c-6df954b1a45c None admin] RBAC: Authorizing `identity:create_grant(project_id=b2b356e72cf84d099f2ce8678103ecef, user_id=bc87aba3662244bea0428475bb0c9e8b, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:44.950691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb1e03-05ff-4f77-980c-6df954b1a45c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:44.972322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 395/797] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:57:44 2022] PUT /identity/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/bc87aba3662244bea0428475bb0c9e8b/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:57:45.061635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cdff9-a94f-423d-bec4-ec3d882f70c9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:45.113618 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a220a1-82d5-493c-b4c8-00a681d1af76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:45.114459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a220a1-82d5-493c-b4c8-00a681d1af76 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:45.114738 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a220a1-82d5-493c-b4c8-00a681d1af76 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:45.115012 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a220a1-82d5-493c-b4c8-00a681d1af76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:45.132006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a220a1-82d5-493c-b4c8-00a681d1af76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:45.133487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a220a1-82d5-493c-b4c8-00a681d1af76 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:45.158156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-66a220a1-82d5-493c-b4c8-00a681d1af76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:45.158156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:45.158156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:45.158156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:45.158156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:45.158156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:45.158156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:45.158156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:45.158156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:45.158156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:45.158156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:45.158156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:45.158156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:45.158156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:45.158156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:45.159079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:45.160092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:45.160092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:45.160092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:45.160092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:45.160092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 403/798] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:45.164987 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb1e03-05ff-4f77-980c-6df954b1a45c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:45.232480 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3b798-484e-4117-9d59-72ce34bb98bd None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:45.232816 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3b798-484e-4117-9d59-72ce34bb98bd None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:45.233018 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3b798-484e-4117-9d59-72ce34bb98bd None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:45.234785 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 404/799] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:45.240319 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743d49e-33a0-4eab-9565-ff02ac47418a None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:45.240699 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743d49e-33a0-4eab-9565-ff02ac47418a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:45.240952 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743d49e-33a0-4eab-9565-ff02ac47418a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:45.264586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e743d49e-33a0-4eab-9565-ff02ac47418a None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:45.265782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e743d49e-33a0-4eab-9565-ff02ac47418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:45.341156 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb1e03-05ff-4f77-980c-6df954b1a45c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:45.378167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 405/800] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:57:45.398614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e16346-bed7-4c80-a87a-3a27dff905c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:45.399344 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e16346-bed7-4c80-a87a-3a27dff905c4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:45.399643 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e16346-bed7-4c80-a87a-3a27dff905c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:45.399923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e16346-bed7-4c80-a87a-3a27dff905c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:45.402903 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743d49e-33a0-4eab-9565-ff02ac47418a None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:45.413268 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e16346-bed7-4c80-a87a-3a27dff905c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:45.413587 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e16346-bed7-4c80-a87a-3a27dff905c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:45.415005 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e16346-bed7-4c80-a87a-3a27dff905c4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:45.443058 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 396/801] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:45.448936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e16346-bed7-4c80-a87a-3a27dff905c4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:45.554436 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743d49e-33a0-4eab-9565-ff02ac47418a None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:45.602871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e16346-bed7-4c80-a87a-3a27dff905c4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:45.604384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7e72a-c109-47d0-ab8e-dda10edd8480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:45.605207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7e72a-c109-47d0-ab8e-dda10edd8480 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:45.605490 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7e72a-c109-47d0-ab8e-dda10edd8480 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:45.605765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7e72a-c109-47d0-ab8e-dda10edd8480 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:45.621156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7e72a-c109-47d0-ab8e-dda10edd8480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-66e7e72a-c109-47d0-ab8e-dda10edd8480 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:45.629151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:45.630141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:45.630960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:45.630960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:45.630960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:45.630960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:45.630960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:45.630960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:45.630960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:45.630960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:45.630960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:45.630960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:45.630960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:45.630960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:45.635789 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 406/802] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:57:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:45.637835 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7e72a-c109-47d0-ab8e-dda10edd8480 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:45.649462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97323a02-c95d-4343-9e35-4f1391bea2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:45.650292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97323a02-c95d-4343-9e35-4f1391bea2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:45.650571 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97323a02-c95d-4343-9e35-4f1391bea2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:45.650877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97323a02-c95d-4343-9e35-4f1391bea2f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:45.660575 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97323a02-c95d-4343-9e35-4f1391bea2f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:45.668305 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97323a02-c95d-4343-9e35-4f1391bea2f8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-97323a02-c95d-4343-9e35-4f1391bea2f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:45.697213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:45.700061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:45.702312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:45.702312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:45.702312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:45.702312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:45.702312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:45.702312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:45.702312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:45.702312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:45.702312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 16:57:45.702312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:45.702312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 397/803] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 16:57:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:45.714117 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97323a02-c95d-4343-9e35-4f1391bea2f8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:45.749858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7e72a-c109-47d0-ab8e-dda10edd8480 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:45.786315 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e0e6a-1849-4b70-b766-4a6f03414ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:45.786988 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e0e6a-1849-4b70-b766-4a6f03414ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:45.787268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e0e6a-1849-4b70-b766-4a6f03414ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:45.787542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e0e6a-1849-4b70-b766-4a6f03414ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:45.788316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e0e6a-1849-4b70-b766-4a6f03414ad5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:45.788619 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e0e6a-1849-4b70-b766-4a6f03414ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:45.789992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e0e6a-1849-4b70-b766-4a6f03414ad5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:45.806693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 407/804] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:45.813132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e0e6a-1849-4b70-b766-4a6f03414ad5 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:45.865886 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97323a02-c95d-4343-9e35-4f1391bea2f8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:45.907041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ed4c1-2fee-4e2d-a532-a9bdbeafc633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:45.908067 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ed4c1-2fee-4e2d-a532-a9bdbeafc633 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:45.908067 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ed4c1-2fee-4e2d-a532-a9bdbeafc633 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:45.908407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ed4c1-2fee-4e2d-a532-a9bdbeafc633 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:45.909175 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ed4c1-2fee-4e2d-a532-a9bdbeafc633 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:45.909482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ed4c1-2fee-4e2d-a532-a9bdbeafc633 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:45.910923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ed4c1-2fee-4e2d-a532-a9bdbeafc633 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:45.929451 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 398/805] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 17 16:57:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:45.930701 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975af0b-8264-4399-99ae-9055bf793d60 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:45.930987 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975af0b-8264-4399-99ae-9055bf793d60 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:45.931274 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975af0b-8264-4399-99ae-9055bf793d60 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:45.936434 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 399/806] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:45.936434 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975af0b-8264-4399-99ae-9055bf793d60 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:45.984332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e0e6a-1849-4b70-b766-4a6f03414ad5 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:46.024548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a5307-3831-457a-8e84-81376cf8c6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:46.025325 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a5307-3831-457a-8e84-81376cf8c6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:46.025621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a5307-3831-457a-8e84-81376cf8c6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:46.026429 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a5307-3831-457a-8e84-81376cf8c6c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:46.037279 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a5307-3831-457a-8e84-81376cf8c6c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:46.038801 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a5307-3831-457a-8e84-81376cf8c6c1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:46.055804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-b40a5307-3831-457a-8e84-81376cf8c6c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:46.055804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:46.055804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:46.055804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:46.055804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:46.055804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:46.055804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:46.055804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:46.055804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:46.055804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:46.055804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:46.055804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:46.055804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:46.055804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:46.055804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:46.056725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:46.057845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:46.057845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:46.057845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:46.057845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:46.057845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 408/807] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:46.058569 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01c383-919c-4074-b6e0-b887c1b926d7 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:46.058842 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01c383-919c-4074-b6e0-b887c1b926d7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:46.059153 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01c383-919c-4074-b6e0-b887c1b926d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:46.071142 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975af0b-8264-4399-99ae-9055bf793d60 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:46.076667 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3c01c383-919c-4074-b6e0-b887c1b926d7 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:46.077834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3c01c383-919c-4074-b6e0-b887c1b926d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:46.118288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149e2e4-5e4e-4c64-aae2-12ee8bc9d514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:46.119393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149e2e4-5e4e-4c64-aae2-12ee8bc9d514 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:46.120452 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149e2e4-5e4e-4c64-aae2-12ee8bc9d514 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:46.121434 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149e2e4-5e4e-4c64-aae2-12ee8bc9d514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:46.137114 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149e2e4-5e4e-4c64-aae2-12ee8bc9d514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:46.139156 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149e2e4-5e4e-4c64-aae2-12ee8bc9d514 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:46.163803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8149e2e4-5e4e-4c64-aae2-12ee8bc9d514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:46.163803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:46.163803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:46.163803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:46.163803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:46.163803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:46.163803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:46.163803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:46.163803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:46.163803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:46.163803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:46.163803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:46.163803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:46.163803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:46.163803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:46.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:46.166126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:46.166126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:46.166126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:46.166126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:46.166126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 400/809] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:46.166126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149e2e4-5e4e-4c64-aae2-12ee8bc9d514 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:46.166634 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 409/809] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:46.168134 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01c383-919c-4074-b6e0-b887c1b926d7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:46.280705 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149e2e4-5e4e-4c64-aae2-12ee8bc9d514 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:46.305600 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01c383-919c-4074-b6e0-b887c1b926d7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:46.315416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d17c62-73c0-4011-a219-b9ab92dbe378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:46.316387 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d17c62-73c0-4011-a219-b9ab92dbe378 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:46.316876 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d17c62-73c0-4011-a219-b9ab92dbe378 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:46.317378 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d17c62-73c0-4011-a219-b9ab92dbe378 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:46.318291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d17c62-73c0-4011-a219-b9ab92dbe378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:46.318802 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d17c62-73c0-4011-a219-b9ab92dbe378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:46.320458 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d17c62-73c0-4011-a219-b9ab92dbe378 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:46.334444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 401/810] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:46.335619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d17c62-73c0-4011-a219-b9ab92dbe378 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:46.346949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80320f0f-0f3d-4ab3-9d7e-5374fe034d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:46.347620 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80320f0f-0f3d-4ab3-9d7e-5374fe034d39 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:46.347920 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80320f0f-0f3d-4ab3-9d7e-5374fe034d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:46.348196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80320f0f-0f3d-4ab3-9d7e-5374fe034d39 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:46.348915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80320f0f-0f3d-4ab3-9d7e-5374fe034d39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:46.349219 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80320f0f-0f3d-4ab3-9d7e-5374fe034d39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:46.350577 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80320f0f-0f3d-4ab3-9d7e-5374fe034d39 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:46.362396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 410/811] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:46.363635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf9367-1eba-4f47-b91b-fc8fba9eba2f None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:46.363949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf9367-1eba-4f47-b91b-fc8fba9eba2f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:46.364224 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf9367-1eba-4f47-b91b-fc8fba9eba2f None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:46.365572 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 411/812] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:46.366114 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf9367-1eba-4f47-b91b-fc8fba9eba2f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:46.441866 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d17c62-73c0-4011-a219-b9ab92dbe378 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:46.467476 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf9367-1eba-4f47-b91b-fc8fba9eba2f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:46.476505 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a1ccb-b291-432b-990f-84fc0ead20ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:46.477324 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a1ccb-b291-432b-990f-84fc0ead20ec None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:46.477607 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a1ccb-b291-432b-990f-84fc0ead20ec None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:46.477881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a1ccb-b291-432b-990f-84fc0ead20ec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:46.478542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a1ccb-b291-432b-990f-84fc0ead20ec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:46.480233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a1ccb-b291-432b-990f-84fc0ead20ec None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-7c5a1ccb-b291-432b-990f-84fc0ead20ec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:46.492991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:46.494008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:46.495375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 402/813] 10.222.0.48 () {56 vars in 1129 bytes} [Tue May 17 16:57:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:46.498452 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a1ccb-b291-432b-990f-84fc0ead20ec None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:46.508080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87475484-d4cb-453a-ad2f-aff79e50a6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:46.508884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87475484-d4cb-453a-ad2f-aff79e50a6ca None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:46.509167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87475484-d4cb-453a-ad2f-aff79e50a6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:46.509442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87475484-d4cb-453a-ad2f-aff79e50a6ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:46.518381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87475484-d4cb-453a-ad2f-aff79e50a6ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:46.519852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87475484-d4cb-453a-ad2f-aff79e50a6ca None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-87475484-d4cb-453a-ad2f-aff79e50a6ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:46.534975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:46.536180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:46.537139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:46.537139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:46.537139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:46.537139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:46.537139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:46.537139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:46.537139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:46.537139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:46.537139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 16:57:46.537139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:46.537139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 412/814] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 16:57:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:46.537743 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3569a7-e88f-40c9-922d-0387d219bfe2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:46.537894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3569a7-e88f-40c9-922d-0387d219bfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:46.538172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3569a7-e88f-40c9-922d-0387d219bfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:46.555251 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6d3569a7-e88f-40c9-922d-0387d219bfe2 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:46.556449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6d3569a7-e88f-40c9-922d-0387d219bfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:46.613395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a1ccb-b291-432b-990f-84fc0ead20ec None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:46.623642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 413/815] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:46.624142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3569a7-e88f-40c9-922d-0387d219bfe2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:46.658116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8339405-6b28-4a80-b44e-c2985cdd578a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:46.658915 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8339405-6b28-4a80-b44e-c2985cdd578a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:46.659195 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8339405-6b28-4a80-b44e-c2985cdd578a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:46.659468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8339405-6b28-4a80-b44e-c2985cdd578a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:46.666763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8339405-6b28-4a80-b44e-c2985cdd578a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:46.668544 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8339405-6b28-4a80-b44e-c2985cdd578a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:46.683191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-d8339405-6b28-4a80-b44e-c2985cdd578a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:46.683191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:46.683191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:46.683191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:46.683191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:46.683191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:46.683191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:46.683191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:46.683191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:46.683191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:46.683191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:46.683191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:46.683191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:46.683191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:46.683191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:46.684102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:46.684985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:46.684985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:46.684985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:46.684985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:46.684985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:46.684985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:46.684985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:46.684985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:46.684985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 403/816] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:46.687314 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8339405-6b28-4a80-b44e-c2985cdd578a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:46.730766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3569a7-e88f-40c9-922d-0387d219bfe2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:46.764305 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f8c71-d90b-489e-b403-2a2e3b233c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:46.764970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f8c71-d90b-489e-b403-2a2e3b233c27 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:46.765252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f8c71-d90b-489e-b403-2a2e3b233c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:46.765531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f8c71-d90b-489e-b403-2a2e3b233c27 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:46.766232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f8c71-d90b-489e-b403-2a2e3b233c27 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:46.766540 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f8c71-d90b-489e-b403-2a2e3b233c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:46.767929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f8c71-d90b-489e-b403-2a2e3b233c27 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:46.772354 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 414/817] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 17 16:57:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:46.773124 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f8c71-d90b-489e-b403-2a2e3b233c27 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:46.790051 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8339405-6b28-4a80-b44e-c2985cdd578a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:46.824399 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea8515-d191-4cf5-bc38-04ff8840658a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:46.825080 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea8515-d191-4cf5-bc38-04ff8840658a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:46.825364 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea8515-d191-4cf5-bc38-04ff8840658a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:46.825644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea8515-d191-4cf5-bc38-04ff8840658a None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:46.826479 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea8515-d191-4cf5-bc38-04ff8840658a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:46.826971 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea8515-d191-4cf5-bc38-04ff8840658a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:46.828507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea8515-d191-4cf5-bc38-04ff8840658a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:46.848084 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 404/818] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 16:57:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:46.849260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea8515-d191-4cf5-bc38-04ff8840658a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:46.879899 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f8c71-d90b-489e-b403-2a2e3b233c27 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:46.920320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761958d8-7e83-410f-8637-34ac310c6fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:46.921124 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761958d8-7e83-410f-8637-34ac310c6fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:46.921412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761958d8-7e83-410f-8637-34ac310c6fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:46.921685 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761958d8-7e83-410f-8637-34ac310c6fa9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:46.922336 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761958d8-7e83-410f-8637-34ac310c6fa9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:46.923721 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761958d8-7e83-410f-8637-34ac310c6fa9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-761958d8-7e83-410f-8637-34ac310c6fa9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:46.935582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:46.936592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:46.937421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:46.937421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:46.937421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:46.937421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:46.937421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:46.937421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:46.937421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:46.937421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:46.937421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:46.937421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:46.937421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:57:46.937421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:46.937421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 16:57:46.937421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:46.937421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 415/819] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:46 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:46.939137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761958d8-7e83-410f-8637-34ac310c6fa9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:46.952975 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea8515-d191-4cf5-bc38-04ff8840658a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:46.987590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4a3c7-a61b-423e-afd6-06ab35748afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:46.988352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4a3c7-a61b-423e-afd6-06ab35748afd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:46.988639 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4a3c7-a61b-423e-afd6-06ab35748afd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:46.988910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4a3c7-a61b-423e-afd6-06ab35748afd None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:46.989697 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4a3c7-a61b-423e-afd6-06ab35748afd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:46.990002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4a3c7-a61b-423e-afd6-06ab35748afd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:46.991444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4a3c7-a61b-423e-afd6-06ab35748afd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:47.002751 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 405/820] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:47.003550 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4a3c7-a61b-423e-afd6-06ab35748afd None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:47.040990 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761958d8-7e83-410f-8637-34ac310c6fa9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:47.075837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a9719-61a7-4651-b592-ca927bd18f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:47.076498 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a9719-61a7-4651-b592-ca927bd18f87 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:47.076777 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a9719-61a7-4651-b592-ca927bd18f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:47.077049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a9719-61a7-4651-b592-ca927bd18f87 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:47.077737 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a9719-61a7-4651-b592-ca927bd18f87 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:47.078037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a9719-61a7-4651-b592-ca927bd18f87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:47.079400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a9719-61a7-4651-b592-ca927bd18f87 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:47.089150 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 416/821] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 17 16:57:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:47.089150 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a9719-61a7-4651-b592-ca927bd18f87 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:47.112856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4a3c7-a61b-423e-afd6-06ab35748afd None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:47.147019 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44510dcb-59c9-4fd2-affe-1df0177cbda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:47.147692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44510dcb-59c9-4fd2-affe-1df0177cbda9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:47.147972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44510dcb-59c9-4fd2-affe-1df0177cbda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:47.148247 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44510dcb-59c9-4fd2-affe-1df0177cbda9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:47.187017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a9719-61a7-4651-b592-ca927bd18f87 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:47.217151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44510dcb-59c9-4fd2-affe-1df0177cbda9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:47.218613 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44510dcb-59c9-4fd2-affe-1df0177cbda9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:47.221569 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c9300-a190-4997-bd65-95f084e1bda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:47.222229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c9300-a190-4997-bd65-95f084e1bda5 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:47.222523 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c9300-a190-4997-bd65-95f084e1bda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:47.222799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c9300-a190-4997-bd65-95f084e1bda5 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:47.223491 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c9300-a190-4997-bd65-95f084e1bda5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:47.223826 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c9300-a190-4997-bd65-95f084e1bda5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:47.225177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c9300-a190-4997-bd65-95f084e1bda5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:47.239347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 417/822] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 16:57:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:47.239347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c9300-a190-4997-bd65-95f084e1bda5 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:47.318934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 406/823] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 16:57:47.320223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44510dcb-59c9-4fd2-affe-1df0177cbda9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:47.345103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c9300-a190-4997-bd65-95f084e1bda5 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:47.381081 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527f270-9946-48e6-bacb-45f9fb132452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:47.381964 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527f270-9946-48e6-bacb-45f9fb132452 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:47.382243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527f270-9946-48e6-bacb-45f9fb132452 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:47.382517 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527f270-9946-48e6-bacb-45f9fb132452 None admin] PATH_INFO: `/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/c0b16bc0880a4e12879ebb512ebb848b/roles/958871a8463d49d89ddade803adb47c4` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:47.396841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527f270-9946-48e6-bacb-45f9fb132452 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2b356e72cf84d099f2ce8678103ecef, user_id=c0b16bc0880a4e12879ebb512ebb848b, role_id=958871a8463d49d89ddade803adb47c4)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:47.398289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527f270-9946-48e6-bacb-45f9fb132452 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:47.413240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 418/824] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:57:47 2022] PUT /identity/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/c0b16bc0880a4e12879ebb512ebb848b/roles/958871a8463d49d89ddade803adb47c4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:57:47.414296 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527f270-9946-48e6-bacb-45f9fb132452 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:47.434296 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44510dcb-59c9-4fd2-affe-1df0177cbda9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:47.479673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7318a-c92e-4672-8b2b-218bccc49a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:47.480523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7318a-c92e-4672-8b2b-218bccc49a4f None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:47.480655 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7318a-c92e-4672-8b2b-218bccc49a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:47.480985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7318a-c92e-4672-8b2b-218bccc49a4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:47.481844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7318a-c92e-4672-8b2b-218bccc49a4f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:47.484444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7318a-c92e-4672-8b2b-218bccc49a4f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:47.513485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 407/825] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 16:57:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:57:47.515119 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7318a-c92e-4672-8b2b-218bccc49a4f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:47.555026 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527f270-9946-48e6-bacb-45f9fb132452 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:47.606471 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0af21-e59c-406a-abc2-ac7311d5a919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:47.607098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0af21-e59c-406a-abc2-ac7311d5a919 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:47.607381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0af21-e59c-406a-abc2-ac7311d5a919 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:47.608322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0af21-e59c-406a-abc2-ac7311d5a919 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:47.608427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0af21-e59c-406a-abc2-ac7311d5a919 None admin] RBAC: Adding query filter params (type=network) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:47.609433 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0af21-e59c-406a-abc2-ac7311d5a919 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:47.610119 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0af21-e59c-406a-abc2-ac7311d5a919 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:47.620206 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 419/826] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 16:57:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:47.621840 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da57a03-482b-403b-bcad-f0c784c402fb None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:47.622135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da57a03-482b-403b-bcad-f0c784c402fb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:47.622416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da57a03-482b-403b-bcad-f0c784c402fb None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:47.626238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 420/827] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:47.627213 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da57a03-482b-403b-bcad-f0c784c402fb None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:47.648462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7318a-c92e-4672-8b2b-218bccc49a4f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:47.698603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267e5d7-f5f1-4426-a425-7d3c8d44a325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:47.699646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267e5d7-f5f1-4426-a425-7d3c8d44a325 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:47.699940 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267e5d7-f5f1-4426-a425-7d3c8d44a325 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:47.700215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267e5d7-f5f1-4426-a425-7d3c8d44a325 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:47.712050 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267e5d7-f5f1-4426-a425-7d3c8d44a325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:47.714412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267e5d7-f5f1-4426-a425-7d3c8d44a325 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:47.735880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-f267e5d7-f5f1-4426-a425-7d3c8d44a325 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:47.735880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:47.735880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:47.735880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:47.735880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:47.735880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:47.735880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:47.735880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:47.735880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:47.735880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:47.735880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:47.735880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:47.735880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:47.735880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:47.735880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:47.736997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:47.737928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:47.737928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:47.737928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:47.737928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:47.737928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 408/828] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:47.738826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ef98a-d833-4a1b-b2b8-509c57326890 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:47.739122 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ef98a-d833-4a1b-b2b8-509c57326890 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:47.739403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ef98a-d833-4a1b-b2b8-509c57326890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:47.757280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9f9ef98a-d833-4a1b-b2b8-509c57326890 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:47.758191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9f9ef98a-d833-4a1b-b2b8-509c57326890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:47.761434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da57a03-482b-403b-bcad-f0c784c402fb None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:47.800400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278642f-5d4e-45c2-a224-5080a4d6b47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:47.800400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278642f-5d4e-45c2-a224-5080a4d6b47b None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:47.800932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278642f-5d4e-45c2-a224-5080a4d6b47b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:47.801308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278642f-5d4e-45c2-a224-5080a4d6b47b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:47.802146 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278642f-5d4e-45c2-a224-5080a4d6b47b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:47.803635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278642f-5d4e-45c2-a224-5080a4d6b47b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:47.827284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 421/829] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 16:57:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:57:47.828411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278642f-5d4e-45c2-a224-5080a4d6b47b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:47.854925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 409/830] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:47.880317 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ef98a-d833-4a1b-b2b8-509c57326890 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:47.941295 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278642f-5d4e-45c2-a224-5080a4d6b47b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:47.977911 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f07ca6-9616-4c94-be61-5334ff9529fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:47.979428 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f07ca6-9616-4c94-be61-5334ff9529fe None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:47.979911 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f07ca6-9616-4c94-be61-5334ff9529fe None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:47.980561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f07ca6-9616-4c94-be61-5334ff9529fe None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:47.981521 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f07ca6-9616-4c94-be61-5334ff9529fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:47.981982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f07ca6-9616-4c94-be61-5334ff9529fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:47.983518 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f07ca6-9616-4c94-be61-5334ff9529fe None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:47.997520 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 422/831] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:48.003992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f07ca6-9616-4c94-be61-5334ff9529fe None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:48.077731 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ef98a-d833-4a1b-b2b8-509c57326890 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:48.122983 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a568bc0-aad1-464b-b3f1-0e9c5c8581cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:48.124303 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a568bc0-aad1-464b-b3f1-0e9c5c8581cb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:48.124794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a568bc0-aad1-464b-b3f1-0e9c5c8581cb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:48.125431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a568bc0-aad1-464b-b3f1-0e9c5c8581cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:48.142221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a568bc0-aad1-464b-b3f1-0e9c5c8581cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5a568bc0-aad1-464b-b3f1-0e9c5c8581cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:48.152712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:48.153675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:48.154537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:48.154537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:48.154537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:48.154537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:48.154537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:48.154537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:48.154537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:48.154537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:48.154537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:48.154537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:48.154537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:57:48.154537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:48.157628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 410/832] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:57:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:48.167624 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a568bc0-aad1-464b-b3f1-0e9c5c8581cb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:48.176054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f07ca6-9616-4c94-be61-5334ff9529fe None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:48.230372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0c47d-e107-4204-8fda-436905135dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:48.231173 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0c47d-e107-4204-8fda-436905135dfe None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:48.231450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0c47d-e107-4204-8fda-436905135dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:48.231748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0c47d-e107-4204-8fda-436905135dfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:48.242968 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0c47d-e107-4204-8fda-436905135dfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:48.245909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0c47d-e107-4204-8fda-436905135dfe None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:48.264001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-18b0c47d-e107-4204-8fda-436905135dfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:48.264001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:48.264001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:48.264001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:48.264001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:48.264001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:48.264001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:48.264001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:48.264001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:48.264001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:48.264001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:48.264001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:48.264001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:48.264001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:48.264001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:48.264994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:48.265895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:48.265895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:48.265895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:48.265895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:48.265895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:48.265895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:48.265895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:48.265895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:48.265895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 423/833] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:48.271241 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0c47d-e107-4204-8fda-436905135dfe None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:48.295623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a568bc0-aad1-464b-b3f1-0e9c5c8581cb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:48.338431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd97c0a-b4db-4c12-b50f-e4925fa375c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:48.339512 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd97c0a-b4db-4c12-b50f-e4925fa375c1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:48.339967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd97c0a-b4db-4c12-b50f-e4925fa375c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:48.340392 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd97c0a-b4db-4c12-b50f-e4925fa375c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:48.341150 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd97c0a-b4db-4c12-b50f-e4925fa375c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:48.341619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd97c0a-b4db-4c12-b50f-e4925fa375c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:48.343296 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd97c0a-b4db-4c12-b50f-e4925fa375c1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:48.358068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 411/834] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:57:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:48.363855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd97c0a-b4db-4c12-b50f-e4925fa375c1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:48.408611 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0c47d-e107-4204-8fda-436905135dfe None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:48.450736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f380a7e-ad83-469e-b964-6cfaa65e02da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:48.451413 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f380a7e-ad83-469e-b964-6cfaa65e02da None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:48.451727 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f380a7e-ad83-469e-b964-6cfaa65e02da None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:48.452005 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f380a7e-ad83-469e-b964-6cfaa65e02da None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:48.453265 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f380a7e-ad83-469e-b964-6cfaa65e02da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:48.453584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f380a7e-ad83-469e-b964-6cfaa65e02da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:48.455403 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f380a7e-ad83-469e-b964-6cfaa65e02da None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:48.469317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 424/835] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:48.474677 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f380a7e-ad83-469e-b964-6cfaa65e02da None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:48.485007 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd97c0a-b4db-4c12-b50f-e4925fa375c1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:48.528376 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca792f-3e5b-43bd-9abf-b481522d954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:48.529741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca792f-3e5b-43bd-9abf-b481522d954a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:48.530023 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca792f-3e5b-43bd-9abf-b481522d954a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:48.530295 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca792f-3e5b-43bd-9abf-b481522d954a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:48.544462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca792f-3e5b-43bd-9abf-b481522d954a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:48.545916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca792f-3e5b-43bd-9abf-b481522d954a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:48.569883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5aca792f-3e5b-43bd-9abf-b481522d954a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:48.569883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:48.569883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:48.569883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:48.569883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:48.569883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:48.569883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:48.569883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:48.569883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:48.569883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:48.569883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:48.569883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:48.569883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:48.569883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:48.569883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:48.570816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:48.571753 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:48.571753 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:48.571753 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:48.571753 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:48.571976 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f380a7e-ad83-469e-b964-6cfaa65e02da None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:48.576139 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 412/836] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:48.577006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca792f-3e5b-43bd-9abf-b481522d954a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:48.611085 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b0189-6c6c-4f56-988b-efd7719d442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:48.611842 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b0189-6c6c-4f56-988b-efd7719d442a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:48.612265 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b0189-6c6c-4f56-988b-efd7719d442a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:48.612538 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b0189-6c6c-4f56-988b-efd7719d442a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:48.613357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b0189-6c6c-4f56-988b-efd7719d442a None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=5becb135afbd43e9bc0b1347ba04e2b5) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:48.613660 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b0189-6c6c-4f56-988b-efd7719d442a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:48.615078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b0189-6c6c-4f56-988b-efd7719d442a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:48.627759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 425/837] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:48 2022] GET /identity/v3/role_assignments?user.id=5becb135afbd43e9bc0b1347ba04e2b5&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:48.682274 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca792f-3e5b-43bd-9abf-b481522d954a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:48.720801 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5e6df-78cb-4448-8546-5ff3b0c9fc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:48.721490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5e6df-78cb-4448-8546-5ff3b0c9fc77 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:48.721772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5e6df-78cb-4448-8546-5ff3b0c9fc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:48.722045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5e6df-78cb-4448-8546-5ff3b0c9fc77 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:48.722804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5e6df-78cb-4448-8546-5ff3b0c9fc77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:48.723111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5e6df-78cb-4448-8546-5ff3b0c9fc77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:48.724630 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5e6df-78cb-4448-8546-5ff3b0c9fc77 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:48.739205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 413/838] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:48.745139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b0189-6c6c-4f56-988b-efd7719d442a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:48.848104 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b0189-6c6c-4f56-988b-efd7719d442a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:48.882892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc34989-d7b5-46e2-88c5-57b091a2fb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:48.883733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc34989-d7b5-46e2-88c5-57b091a2fb4d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:48.884014 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc34989-d7b5-46e2-88c5-57b091a2fb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:48.884376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc34989-d7b5-46e2-88c5-57b091a2fb4d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:48.893604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc34989-d7b5-46e2-88c5-57b091a2fb4d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:48.895089 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc34989-d7b5-46e2-88c5-57b091a2fb4d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-ccc34989-d7b5-46e2-88c5-57b091a2fb4d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:48.910863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:48.911935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:48.912878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:48.912878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:48.912878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:48.912878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:48.912878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:48.912878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:48.912878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:48.912878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:48.912878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 16:57:48.912878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:48.912878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 426/839] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:57:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:48.918504 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5e6df-78cb-4448-8546-5ff3b0c9fc77 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:49.020019 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5e6df-78cb-4448-8546-5ff3b0c9fc77 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:49.053951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8162f71-c702-4178-9c87-0289a3ad43cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:49.054624 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8162f71-c702-4178-9c87-0289a3ad43cf None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:49.054906 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8162f71-c702-4178-9c87-0289a3ad43cf None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:49.055181 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8162f71-c702-4178-9c87-0289a3ad43cf None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:49.056051 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8162f71-c702-4178-9c87-0289a3ad43cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:49.056358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8162f71-c702-4178-9c87-0289a3ad43cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:49.058369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8162f71-c702-4178-9c87-0289a3ad43cf None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:49.076581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 414/840] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 17 16:57:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:49.081687 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc34989-d7b5-46e2-88c5-57b091a2fb4d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:49.191615 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc34989-d7b5-46e2-88c5-57b091a2fb4d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:49.225086 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bca0b-f91b-4163-9237-74ad3e34be08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:49.225736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bca0b-f91b-4163-9237-74ad3e34be08 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:49.226014 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bca0b-f91b-4163-9237-74ad3e34be08 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:49.226283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bca0b-f91b-4163-9237-74ad3e34be08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:49.305785 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bca0b-f91b-4163-9237-74ad3e34be08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:49.308505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bca0b-f91b-4163-9237-74ad3e34be08 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:49.411834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 427/841] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:49 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 16:57:49.413717 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8162f71-c702-4178-9c87-0289a3ad43cf None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:49.514815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8162f71-c702-4178-9c87-0289a3ad43cf None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:49.553805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb36316-bb53-4120-86d3-c3cc46c6059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:49.554633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb36316-bb53-4120-86d3-c3cc46c6059b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:49.554898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb36316-bb53-4120-86d3-c3cc46c6059b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:49.555171 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb36316-bb53-4120-86d3-c3cc46c6059b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:49.566377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb36316-bb53-4120-86d3-c3cc46c6059b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:49.567789 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb36316-bb53-4120-86d3-c3cc46c6059b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:49.593375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-beb36316-bb53-4120-86d3-c3cc46c6059b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:49.593375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:49.593375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:49.593375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:49.593375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:49.593375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:49.593375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:49.593375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:49.593375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:49.593375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:49.593375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:49.593375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:49.593375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:49.593375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:49.593375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:49.594318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:49.595204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:49.595204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:49.595204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:49.595204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:49.595204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 415/842] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:49.601491 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bca0b-f91b-4163-9237-74ad3e34be08 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:49.706911 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bca0b-f91b-4163-9237-74ad3e34be08 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:49.742454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419ae35-bc96-4129-a4ca-ff321ab6ab91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:49.743461 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419ae35-bc96-4129-a4ca-ff321ab6ab91 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:49.744002 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419ae35-bc96-4129-a4ca-ff321ab6ab91 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:49.744503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419ae35-bc96-4129-a4ca-ff321ab6ab91 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:49.745574 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419ae35-bc96-4129-a4ca-ff321ab6ab91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:49.746098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419ae35-bc96-4129-a4ca-ff321ab6ab91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:49.747683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419ae35-bc96-4129-a4ca-ff321ab6ab91 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:49.759501 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 428/843] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:49.765944 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb36316-bb53-4120-86d3-c3cc46c6059b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:49.852143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2c565-3286-47e2-b7dd-0264978bd1b3 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:49.852756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2c565-3286-47e2-b7dd-0264978bd1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:49.853235 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2c565-3286-47e2-b7dd-0264978bd1b3 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:49.855087 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 429/844] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:57:49.865756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913599-d2cc-447d-95f2-a43a00ceb0e2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:49.866078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913599-d2cc-447d-95f2-a43a00ceb0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:49.866321 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913599-d2cc-447d-95f2-a43a00ceb0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:49.874872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb36316-bb53-4120-86d3-c3cc46c6059b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:49.887310 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c7913599-d2cc-447d-95f2-a43a00ceb0e2 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:49.889127 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c7913599-d2cc-447d-95f2-a43a00ceb0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:49.916774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c1d9d-7c88-43ed-8b85-a04c87abc80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:49.918278 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c1d9d-7c88-43ed-8b85-a04c87abc80a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:49.918970 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c1d9d-7c88-43ed-8b85-a04c87abc80a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:49.919951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c1d9d-7c88-43ed-8b85-a04c87abc80a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:49.930930 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c1d9d-7c88-43ed-8b85-a04c87abc80a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:49.933297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c1d9d-7c88-43ed-8b85-a04c87abc80a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:49.952044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-197c1d9d-7c88-43ed-8b85-a04c87abc80a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:49.952044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:49.952044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:49.952044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:49.952044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:49.952044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:49.952044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:49.952044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:49.952044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:49.952044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:49.952044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:49.952044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:49.952044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:49.952044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:49.952044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:49.953014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:49.953911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:49.953911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:49.953911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:49.953911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:49.953911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:49.953911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:49.953911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:49.953911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:49.955750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 416/845] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:49.960003 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c1d9d-7c88-43ed-8b85-a04c87abc80a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:49.983941 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 430/846] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:57:50.001115 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7913599-d2cc-447d-95f2-a43a00ceb0e2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:50.064811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c1d9d-7c88-43ed-8b85-a04c87abc80a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:50.099526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6ad01-9ffe-42ce-a010-221ff024c2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:50.100374 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6ad01-9ffe-42ce-a010-221ff024c2dc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:50.100862 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6ad01-9ffe-42ce-a010-221ff024c2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:50.101249 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6ad01-9ffe-42ce-a010-221ff024c2dc None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:50.102048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6ad01-9ffe-42ce-a010-221ff024c2dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:50.102479 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6ad01-9ffe-42ce-a010-221ff024c2dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:50.104034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6ad01-9ffe-42ce-a010-221ff024c2dc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:50.106922 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7913599-d2cc-447d-95f2-a43a00ceb0e2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:50.116224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 417/847] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:50.117634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea1b2e-62d5-4210-a837-470d34e6e31d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:50.117999 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea1b2e-62d5-4210-a837-470d34e6e31d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:50.118346 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea1b2e-62d5-4210-a837-470d34e6e31d None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:50.120464 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 418/848] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:50.124294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea1b2e-62d5-4210-a837-470d34e6e31d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:50.145655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50987e24-66a5-48bc-bfc0-6fa7aad9957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:50.146580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50987e24-66a5-48bc-bfc0-6fa7aad9957c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:50.146968 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50987e24-66a5-48bc-bfc0-6fa7aad9957c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:50.147350 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50987e24-66a5-48bc-bfc0-6fa7aad9957c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:50.158645 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50987e24-66a5-48bc-bfc0-6fa7aad9957c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-50987e24-66a5-48bc-bfc0-6fa7aad9957c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:50.166844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:50.168024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:50.169447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:50.169447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:50.169447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:50.169447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:50.169447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:50.169447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:50.169447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:50.169447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:50.169447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:50.169447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:50.169447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 16:57:50.169447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:50.169447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 431/849] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 16:57:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:50.170149 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75fb73-27e7-4f44-b033-d088117d7f82 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:50.170149 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75fb73-27e7-4f44-b033-d088117d7f82 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:50.170149 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75fb73-27e7-4f44-b033-d088117d7f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:50.189949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1d75fb73-27e7-4f44-b033-d088117d7f82 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:50.191740 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1d75fb73-27e7-4f44-b033-d088117d7f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:50.227578 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea1b2e-62d5-4210-a837-470d34e6e31d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:50.260863 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d8f94-1656-431f-986e-a939430bccf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:50.261506 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d8f94-1656-431f-986e-a939430bccf4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:50.261791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d8f94-1656-431f-986e-a939430bccf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:50.262060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d8f94-1656-431f-986e-a939430bccf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:50.262878 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d8f94-1656-431f-986e-a939430bccf4 None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=bc87aba3662244bea0428475bb0c9e8b) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:50.263190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d8f94-1656-431f-986e-a939430bccf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:50.264657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d8f94-1656-431f-986e-a939430bccf4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:50.270432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 419/850] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:50 2022] GET /identity/v3/role_assignments?user.id=bc87aba3662244bea0428475bb0c9e8b&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:50.271081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d8f94-1656-431f-986e-a939430bccf4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:50.279682 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 432/851] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:50.296712 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75fb73-27e7-4f44-b033-d088117d7f82 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:50.405472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d8f94-1656-431f-986e-a939430bccf4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:50.436285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75fb73-27e7-4f44-b033-d088117d7f82 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:50.448257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603c8a8-dfc6-4278-953a-10fb5841e054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:50.449758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603c8a8-dfc6-4278-953a-10fb5841e054 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:50.450407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603c8a8-dfc6-4278-953a-10fb5841e054 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:50.450935 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603c8a8-dfc6-4278-953a-10fb5841e054 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:50.451859 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603c8a8-dfc6-4278-953a-10fb5841e054 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:50.452473 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603c8a8-dfc6-4278-953a-10fb5841e054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:50.455573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603c8a8-dfc6-4278-953a-10fb5841e054 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:50.467976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 420/852] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 16:57:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:50.473682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603c8a8-dfc6-4278-953a-10fb5841e054 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:50.476648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda2514-7942-447f-a625-b9281d0e606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:50.477651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda2514-7942-447f-a625-b9281d0e606a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:50.477930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda2514-7942-447f-a625-b9281d0e606a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:50.478204 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda2514-7942-447f-a625-b9281d0e606a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:50.479419 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda2514-7942-447f-a625-b9281d0e606a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:50.481389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda2514-7942-447f-a625-b9281d0e606a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-eeda2514-7942-447f-a625-b9281d0e606a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:50.493487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:50.495229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:50.496425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:50.496425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:50.496425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:50.496425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:50.496425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:50.496425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:50.496425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:50.496425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:50.496425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:50.496425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:50.496425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:57:50.496425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:50.496425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 16:57:50.496425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:50.500256 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 433/853] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:57:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:50.502419 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda2514-7942-447f-a625-b9281d0e606a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:50.598973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603c8a8-dfc6-4278-953a-10fb5841e054 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:50.629790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda2514-7942-447f-a625-b9281d0e606a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:50.642698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1eb4-adf3-4682-95a8-447744a05a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:50.643749 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1eb4-adf3-4682-95a8-447744a05a60 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:50.644205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1eb4-adf3-4682-95a8-447744a05a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:50.644625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1eb4-adf3-4682-95a8-447744a05a60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:50.656798 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc1eb4-adf3-4682-95a8-447744a05a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:50.658444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc1eb4-adf3-4682-95a8-447744a05a60 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:50.664841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cb551-e498-4d8e-98c5-4ef574bada77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:50.665565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cb551-e498-4d8e-98c5-4ef574bada77 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:50.665822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cb551-e498-4d8e-98c5-4ef574bada77 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:50.666761 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cb551-e498-4d8e-98c5-4ef574bada77 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:50.667397 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cb551-e498-4d8e-98c5-4ef574bada77 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:50.667722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cb551-e498-4d8e-98c5-4ef574bada77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:50.669132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cb551-e498-4d8e-98c5-4ef574bada77 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:50.678093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-63dc1eb4-adf3-4682-95a8-447744a05a60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:50.678093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:50.678093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:50.678093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:50.678093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:50.678093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:50.678093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:50.678093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:50.678093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:50.678093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:50.678093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:50.678093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:50.678093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:50.678093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:50.678093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:50.679132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:50.680183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:50.680183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:50.680183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:50.680183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:50.680424 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 434/854] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:57:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:50.680424 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cb551-e498-4d8e-98c5-4ef574bada77 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:50.687267 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 421/855] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:50.688671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1eb4-adf3-4682-95a8-447744a05a60 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:50.781629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cb551-e498-4d8e-98c5-4ef574bada77 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:50.796523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1eb4-adf3-4682-95a8-447744a05a60 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:50.818985 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05debb5d-cec6-48e3-8de2-6b68daed5821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:50.819693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05debb5d-cec6-48e3-8de2-6b68daed5821 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:50.819977 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05debb5d-cec6-48e3-8de2-6b68daed5821 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:50.820250 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05debb5d-cec6-48e3-8de2-6b68daed5821 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:50.821328 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05debb5d-cec6-48e3-8de2-6b68daed5821 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:50.821328 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05debb5d-cec6-48e3-8de2-6b68daed5821 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:50.822866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05debb5d-cec6-48e3-8de2-6b68daed5821 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:50.834724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 435/856] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:57:50 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:50.838480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6b7ea-aa2b-4dc7-9d5c-b7071236c13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:50.840173 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6b7ea-aa2b-4dc7-9d5c-b7071236c13d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:50.840652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6b7ea-aa2b-4dc7-9d5c-b7071236c13d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:50.841082 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6b7ea-aa2b-4dc7-9d5c-b7071236c13d None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:50.841983 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6b7ea-aa2b-4dc7-9d5c-b7071236c13d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:50.842563 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6b7ea-aa2b-4dc7-9d5c-b7071236c13d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:50.844177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6b7ea-aa2b-4dc7-9d5c-b7071236c13d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:50.859030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 422/857] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:50.865391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05debb5d-cec6-48e3-8de2-6b68daed5821 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:50.980664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05debb5d-cec6-48e3-8de2-6b68daed5821 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:50.991665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff28968-81d4-4c09-aea1-cd21ea935ca5 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:50.992293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff28968-81d4-4c09-aea1-cd21ea935ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:50.992807 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff28968-81d4-4c09-aea1-cd21ea935ca5 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:50.995147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 423/858] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:51.002687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2686811-561c-47cd-90e4-65e2b40174c7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:51.002999 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2686811-561c-47cd-90e4-65e2b40174c7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:51.003242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2686811-561c-47cd-90e4-65e2b40174c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:51.022944 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c2686811-561c-47cd-90e4-65e2b40174c7 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:51.024715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c2686811-561c-47cd-90e4-65e2b40174c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:51.031862 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854266de-7e06-4d0f-95b0-71a22f281543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:51.033050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854266de-7e06-4d0f-95b0-71a22f281543 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:51.034144 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854266de-7e06-4d0f-95b0-71a22f281543 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:51.034704 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854266de-7e06-4d0f-95b0-71a22f281543 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:51.045763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854266de-7e06-4d0f-95b0-71a22f281543 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:51.047515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854266de-7e06-4d0f-95b0-71a22f281543 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-854266de-7e06-4d0f-95b0-71a22f281543 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:51.064228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:51.065431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:51.066584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:51.066584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:51.066584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:51.066584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:51.066584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:51.066584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:51.066584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:51.066584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:51.066584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 16:57:51.066584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:51.067372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 436/859] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 16:57:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:51.073759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854266de-7e06-4d0f-95b0-71a22f281543 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:51.122240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 424/860] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:57:51.148421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2686811-561c-47cd-90e4-65e2b40174c7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:51.203335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854266de-7e06-4d0f-95b0-71a22f281543 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:51.245845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3878be-0ff6-4324-9aac-a82828bdcd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:51.246956 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3878be-0ff6-4324-9aac-a82828bdcd4c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:51.247438 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3878be-0ff6-4324-9aac-a82828bdcd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:51.247932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3878be-0ff6-4324-9aac-a82828bdcd4c None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:51.248958 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3878be-0ff6-4324-9aac-a82828bdcd4c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:51.249507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3878be-0ff6-4324-9aac-a82828bdcd4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:51.252242 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3878be-0ff6-4324-9aac-a82828bdcd4c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:51.256279 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2686811-561c-47cd-90e4-65e2b40174c7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:51.278337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 437/861] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 17 16:57:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:51.287712 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3878be-0ff6-4324-9aac-a82828bdcd4c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:51.297204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72934126-e399-4ce5-b7de-3d0ad7f32d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:51.298048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72934126-e399-4ce5-b7de-3d0ad7f32d7f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:51.298326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72934126-e399-4ce5-b7de-3d0ad7f32d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:51.298599 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72934126-e399-4ce5-b7de-3d0ad7f32d7f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:51.299254 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72934126-e399-4ce5-b7de-3d0ad7f32d7f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:51.300952 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72934126-e399-4ce5-b7de-3d0ad7f32d7f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-72934126-e399-4ce5-b7de-3d0ad7f32d7f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:51.314712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:51.315771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:51.316900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 425/862] 10.222.0.48 () {56 vars in 1132 bytes} [Tue May 17 16:57:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:51.321549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72934126-e399-4ce5-b7de-3d0ad7f32d7f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:51.397718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3878be-0ff6-4324-9aac-a82828bdcd4c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:51.432985 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecd41b-ad6a-4a6a-898c-4c6690eaed0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:51.433978 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecd41b-ad6a-4a6a-898c-4c6690eaed0f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:51.434502 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecd41b-ad6a-4a6a-898c-4c6690eaed0f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:51.434976 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecd41b-ad6a-4a6a-898c-4c6690eaed0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:51.445494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72934126-e399-4ce5-b7de-3d0ad7f32d7f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:51.479539 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d97e1-4b73-43c9-b08f-e89cf65d3ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:51.480597 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d97e1-4b73-43c9-b08f-e89cf65d3ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:51.481076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d97e1-4b73-43c9-b08f-e89cf65d3ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:51.481562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d97e1-4b73-43c9-b08f-e89cf65d3ca2 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:51.482462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d97e1-4b73-43c9-b08f-e89cf65d3ca2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:51.483017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d97e1-4b73-43c9-b08f-e89cf65d3ca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:51.484670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d97e1-4b73-43c9-b08f-e89cf65d3ca2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:51.495355 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 426/863] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 16:57:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:51.496715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d97e1-4b73-43c9-b08f-e89cf65d3ca2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:51.519352 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecd41b-ad6a-4a6a-898c-4c6690eaed0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:51.521459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecd41b-ad6a-4a6a-898c-4c6690eaed0f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:51.609746 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d97e1-4b73-43c9-b08f-e89cf65d3ca2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:51.641614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 438/864] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:51 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 16:57:51.647187 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecd41b-ad6a-4a6a-898c-4c6690eaed0f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:51.649636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388a06f-7446-4c38-9b55-9a7ff7feb980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:51.651296 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388a06f-7446-4c38-9b55-9a7ff7feb980 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:51.651825 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388a06f-7446-4c38-9b55-9a7ff7feb980 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:51.652298 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388a06f-7446-4c38-9b55-9a7ff7feb980 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:51.653184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388a06f-7446-4c38-9b55-9a7ff7feb980 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:51.653668 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388a06f-7446-4c38-9b55-9a7ff7feb980 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:51.655700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388a06f-7446-4c38-9b55-9a7ff7feb980 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:51.661950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 427/865] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 16:57:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:51.760671 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecd41b-ad6a-4a6a-898c-4c6690eaed0f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:51.799035 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef29ca-bac9-48f7-afbe-f720b787e498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:51.799878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef29ca-bac9-48f7-afbe-f720b787e498 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:51.800163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef29ca-bac9-48f7-afbe-f720b787e498 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:51.800442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef29ca-bac9-48f7-afbe-f720b787e498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:51.812388 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef29ca-bac9-48f7-afbe-f720b787e498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:51.814118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef29ca-bac9-48f7-afbe-f720b787e498 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:51.834406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-63ef29ca-bac9-48f7-afbe-f720b787e498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:51.834406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:51.834406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:51.834406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:51.834406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:51.834406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:51.834406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:51.834406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:51.834406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:51.834406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:51.834406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:51.834406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:51.834406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:51.834406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:51.834406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:51.835389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:51.836320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:51.836320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:51.836320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:51.836320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:51.839693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 439/866] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:51.844708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388a06f-7446-4c38-9b55-9a7ff7feb980 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:51.952289 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388a06f-7446-4c38-9b55-9a7ff7feb980 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:51.985402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f6490-8043-4712-9d5b-77a0b248c67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:51.986391 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f6490-8043-4712-9d5b-77a0b248c67f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:51.986867 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f6490-8043-4712-9d5b-77a0b248c67f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:51.987336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f6490-8043-4712-9d5b-77a0b248c67f None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:51.988273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f6490-8043-4712-9d5b-77a0b248c67f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:51.988780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f6490-8043-4712-9d5b-77a0b248c67f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:51.990331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f6490-8043-4712-9d5b-77a0b248c67f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:52.007725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 428/867] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:52.010363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef29ca-bac9-48f7-afbe-f720b787e498 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:52.116658 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef29ca-bac9-48f7-afbe-f720b787e498 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:52.152293 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6847b-963a-4475-85fb-9d428bebdb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:52.153100 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6847b-963a-4475-85fb-9d428bebdb3d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:52.153383 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6847b-963a-4475-85fb-9d428bebdb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:52.153662 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6847b-963a-4475-85fb-9d428bebdb3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:52.160633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6847b-963a-4475-85fb-9d428bebdb3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:52.162131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6847b-963a-4475-85fb-9d428bebdb3d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:52.176632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-0bd6847b-963a-4475-85fb-9d428bebdb3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:52.176632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:52.176632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:52.176632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:52.176632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:52.176632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:52.176632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:52.176632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:52.176632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:52.176632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:52.176632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:52.176632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:52.176632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:52.176632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:52.176632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:52.177647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:52.178621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:52.178621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:52.178621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:52.178621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:52.178621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:52.178621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:52.178621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:52.178621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:52.183137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 440/868] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:52.184540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f6490-8043-4712-9d5b-77a0b248c67f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:52.285812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f6490-8043-4712-9d5b-77a0b248c67f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:52.320159 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba21bb-22a3-4c76-b2c5-f4bb4d548d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:52.320825 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba21bb-22a3-4c76-b2c5-f4bb4d548d58 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:52.321108 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba21bb-22a3-4c76-b2c5-f4bb4d548d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:52.321386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba21bb-22a3-4c76-b2c5-f4bb4d548d58 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:52.322196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba21bb-22a3-4c76-b2c5-f4bb4d548d58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:52.322631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba21bb-22a3-4c76-b2c5-f4bb4d548d58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:52.324132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba21bb-22a3-4c76-b2c5-f4bb4d548d58 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:52.339730 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 429/869] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:52.342771 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6847b-963a-4475-85fb-9d428bebdb3d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:52.449145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6847b-963a-4475-85fb-9d428bebdb3d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:52.484381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f24eb3-f618-48de-b7dd-449ec06e4e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:52.485091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f24eb3-f618-48de-b7dd-449ec06e4e7f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:52.485374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f24eb3-f618-48de-b7dd-449ec06e4e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:52.485650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f24eb3-f618-48de-b7dd-449ec06e4e7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:52.486537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f24eb3-f618-48de-b7dd-449ec06e4e7f None admin] RBAC: Adding query filter params (role.id=958871a8463d49d89ddade803adb47c4, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=c0b16bc0880a4e12879ebb512ebb848b) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:52.486855 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f24eb3-f618-48de-b7dd-449ec06e4e7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:52.488314 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f24eb3-f618-48de-b7dd-449ec06e4e7f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:52.499744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 441/870] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:52 2022] GET /identity/v3/role_assignments?user.id=c0b16bc0880a4e12879ebb512ebb848b&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=958871a8463d49d89ddade803adb47c4 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:52.628499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31136873-09d3-4a48-996d-586d3e9c3a7b None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:52.629200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31136873-09d3-4a48-996d-586d3e9c3a7b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:52.629200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31136873-09d3-4a48-996d-586d3e9c3a7b None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:52.630718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 430/871] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:52.637721 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48eca-1bb1-40d4-b129-a86903240e38 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:52.638158 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48eca-1bb1-40d4-b129-a86903240e38 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:52.638541 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48eca-1bb1-40d4-b129-a86903240e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:52.656656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-8ab48eca-1bb1-40d4-b129-a86903240e38 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:52.657851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8ab48eca-1bb1-40d4-b129-a86903240e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:52.730628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 442/872] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:52.753812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31136873-09d3-4a48-996d-586d3e9c3a7b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:52.862707 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31136873-09d3-4a48-996d-586d3e9c3a7b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:52.899647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3643783-1df9-4687-81db-789f19b14395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:52.901002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3643783-1df9-4687-81db-789f19b14395 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:52.901415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3643783-1df9-4687-81db-789f19b14395 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:52.901904 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3643783-1df9-4687-81db-789f19b14395 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:52.902675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3643783-1df9-4687-81db-789f19b14395 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:52.904146 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3643783-1df9-4687-81db-789f19b14395 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-e3643783-1df9-4687-81db-789f19b14395 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:52.917196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:52.919501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:52.921628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:52.921628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:52.921628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:52.921628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:52.921628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:52.921628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:52.921628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:52.921628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:52.921628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:52.921628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:52.921628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:57:52.921628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:52.921628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 16:57:52.921628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:52.921628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 431/873] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 16:57:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:52.927626 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48eca-1bb1-40d4-b129-a86903240e38 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:53.034502 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48eca-1bb1-40d4-b129-a86903240e38 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:53.074642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4509368-cb51-483b-8c0a-df190c5b1783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:53.075330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4509368-cb51-483b-8c0a-df190c5b1783 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:53.075624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4509368-cb51-483b-8c0a-df190c5b1783 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:53.075911 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4509368-cb51-483b-8c0a-df190c5b1783 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:53.076629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4509368-cb51-483b-8c0a-df190c5b1783 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:53.076933 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4509368-cb51-483b-8c0a-df190c5b1783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:53.078311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4509368-cb51-483b-8c0a-df190c5b1783 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:53.083833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 443/874] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 16:57:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:53.089039 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3643783-1df9-4687-81db-789f19b14395 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:53.191142 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3643783-1df9-4687-81db-789f19b14395 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:53.227536 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21da04b-7b56-49c3-a9e4-efacc8b54322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:53.228288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21da04b-7b56-49c3-a9e4-efacc8b54322 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:53.228674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21da04b-7b56-49c3-a9e4-efacc8b54322 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:53.228958 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21da04b-7b56-49c3-a9e4-efacc8b54322 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:53.229631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21da04b-7b56-49c3-a9e4-efacc8b54322 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:53.229932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21da04b-7b56-49c3-a9e4-efacc8b54322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:53.231289 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21da04b-7b56-49c3-a9e4-efacc8b54322 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:53.236223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 432/875] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 16:57:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:53.251361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4f41d-eed2-4cd6-9ff5-e8597309c00e None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:53.251361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4f41d-eed2-4cd6-9ff5-e8597309c00e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:53.251361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4f41d-eed2-4cd6-9ff5-e8597309c00e None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:53.251361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 444/876] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:53.258163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8147c2d-4c05-45b4-9cd5-2c0ff4dbf8b8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:53.258486 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8147c2d-4c05-45b4-9cd5-2c0ff4dbf8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:53.258700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8147c2d-4c05-45b4-9cd5-2c0ff4dbf8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:53.278934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b8147c2d-4c05-45b4-9cd5-2c0ff4dbf8b8 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:53.280172 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b8147c2d-4c05-45b4-9cd5-2c0ff4dbf8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:53.355234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 433/877] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:53.379024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4f41d-eed2-4cd6-9ff5-e8597309c00e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:53.486518 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4f41d-eed2-4cd6-9ff5-e8597309c00e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:53.520854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b322e4-ba2c-4047-b7f4-47ae6ef8968d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:53.521514 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b322e4-ba2c-4047-b7f4-47ae6ef8968d None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:53.521791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b322e4-ba2c-4047-b7f4-47ae6ef8968d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:53.522061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b322e4-ba2c-4047-b7f4-47ae6ef8968d None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:53.522788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b322e4-ba2c-4047-b7f4-47ae6ef8968d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:53.524177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b322e4-ba2c-4047-b7f4-47ae6ef8968d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:53.541800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 445/878] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 16:57:53 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:57:54.037116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40281a2-8847-475e-b73f-7b6bafa470b9 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:54.037673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40281a2-8847-475e-b73f-7b6bafa470b9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:54.037673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40281a2-8847-475e-b73f-7b6bafa470b9 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:54.039239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 434/879] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:54.045450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2a4d6-f137-46fa-8f0e-a37840898468 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:54.045909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2a4d6-f137-46fa-8f0e-a37840898468 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:54.046011 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2a4d6-f137-46fa-8f0e-a37840898468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:54.063405 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f5a2a4d6-f137-46fa-8f0e-a37840898468 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:54.064613 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f5a2a4d6-f137-46fa-8f0e-a37840898468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:54.147174 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 446/880] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:54.170146 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40281a2-8847-475e-b73f-7b6bafa470b9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:54.271162 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40281a2-8847-475e-b73f-7b6bafa470b9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:54.305958 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e09e4a-2008-4ad8-b5fd-f4a4745aa575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:54.306736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e09e4a-2008-4ad8-b5fd-f4a4745aa575 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:54.307015 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e09e4a-2008-4ad8-b5fd-f4a4745aa575 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:54.307289 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e09e4a-2008-4ad8-b5fd-f4a4745aa575 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:54.308086 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e09e4a-2008-4ad8-b5fd-f4a4745aa575 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:54.309507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e09e4a-2008-4ad8-b5fd-f4a4745aa575 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:54.328436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 435/881] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 16:57:54 2022] POST /identity/v3/services => generated 269 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:57:54.938125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e6b09-331a-4f68-8e7d-0b86d76d6dea None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:54.938507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e6b09-331a-4f68-8e7d-0b86d76d6dea None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:54.938711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e6b09-331a-4f68-8e7d-0b86d76d6dea None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:54.940303 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 447/882] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:54.946353 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc474e81-8cfe-46aa-b81b-fd4b576c8702 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:54.946866 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc474e81-8cfe-46aa-b81b-fd4b576c8702 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:54.947972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc474e81-8cfe-46aa-b81b-fd4b576c8702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:54.965314 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-dc474e81-8cfe-46aa-b81b-fd4b576c8702 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:54.966800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-dc474e81-8cfe-46aa-b81b-fd4b576c8702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:55.042321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 436/883] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:55.062440 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e6b09-331a-4f68-8e7d-0b86d76d6dea None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:55.168824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e6b09-331a-4f68-8e7d-0b86d76d6dea None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:55.205553 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3927f-0321-41e9-ac92-5ab99e4bbbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:55.206291 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3927f-0321-41e9-ac92-5ab99e4bbbb7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:55.206571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3927f-0321-41e9-ac92-5ab99e4bbbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:55.206847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3927f-0321-41e9-ac92-5ab99e4bbbb7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:55.217316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3927f-0321-41e9-ac92-5ab99e4bbbb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-5cf3927f-0321-41e9-ac92-5ab99e4bbbb7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:57:55.225450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:55.226394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:55.227261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:55.227261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:55.227261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:55.227261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:55.227261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:57:55.227261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:57:55.227261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:57:55.227261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:57:55.227261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:57:55.227261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:57:55.227261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 16:57:55.227261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:55.231541 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 448/884] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 17 16:57:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:55.232900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc474e81-8cfe-46aa-b81b-fd4b576c8702 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:55.336125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc474e81-8cfe-46aa-b81b-fd4b576c8702 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:55.370884 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5c604-0c98-4d87-b638-f3cd549b3e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:55.371548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5c604-0c98-4d87-b638-f3cd549b3e1e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:55.371858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5c604-0c98-4d87-b638-f3cd549b3e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:55.372125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5c604-0c98-4d87-b638-f3cd549b3e1e None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:55.372861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5c604-0c98-4d87-b638-f3cd549b3e1e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:55.373157 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5c604-0c98-4d87-b638-f3cd549b3e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:55.374522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5c604-0c98-4d87-b638-f3cd549b3e1e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:55.382773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 437/885] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 17 16:57:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:55.388240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3927f-0321-41e9-ac92-5ab99e4bbbb7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:55.494879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3927f-0321-41e9-ac92-5ab99e4bbbb7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:55.531408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d546c-4b35-41f9-bea7-947298f37533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:55.532590 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d546c-4b35-41f9-bea7-947298f37533 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:55.533099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d546c-4b35-41f9-bea7-947298f37533 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:55.533609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d546c-4b35-41f9-bea7-947298f37533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:55.544712 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d546c-4b35-41f9-bea7-947298f37533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:55.546454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d546c-4b35-41f9-bea7-947298f37533 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:55.563847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d22d546c-4b35-41f9-bea7-947298f37533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:55.563847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:55.563847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:55.563847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:55.563847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:55.563847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:55.563847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:55.563847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:55.563847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:55.563847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:55.563847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:55.563847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:55.563847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:55.563847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:55.563847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:55.564788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:55.565683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:55.565683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:55.565683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:55.565683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:55.571957 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 449/886] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:55.574371 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5c604-0c98-4d87-b638-f3cd549b3e1e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:55.657703 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb3ed9-c523-4d75-a02b-8519638c126d None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:55.658359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb3ed9-c523-4d75-a02b-8519638c126d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:55.658851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb3ed9-c523-4d75-a02b-8519638c126d None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:55.660716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 450/887] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:55.666873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2761003-8123-445d-826c-24c68163022d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:55.667414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2761003-8123-445d-826c-24c68163022d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:55.667948 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2761003-8123-445d-826c-24c68163022d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:55.683639 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5c604-0c98-4d87-b638-f3cd549b3e1e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:55.685136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a2761003-8123-445d-826c-24c68163022d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:55.686513 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a2761003-8123-445d-826c-24c68163022d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:55.718508 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4eb17f-a672-47df-830a-50449f31232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:55.719173 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4eb17f-a672-47df-830a-50449f31232d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:55.719452 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4eb17f-a672-47df-830a-50449f31232d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:55.719754 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4eb17f-a672-47df-830a-50449f31232d None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:55.720466 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4eb17f-a672-47df-830a-50449f31232d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:55.720767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4eb17f-a672-47df-830a-50449f31232d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:55.722135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4eb17f-a672-47df-830a-50449f31232d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:55.734642 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 438/888] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:55.746247 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4eb17f-a672-47df-830a-50449f31232d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:55.762537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 451/889] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:55.785454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2761003-8123-445d-826c-24c68163022d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:55.851368 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4eb17f-a672-47df-830a-50449f31232d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:55.881509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2761003-8123-445d-826c-24c68163022d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:55.886976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f57069-74c3-4f9e-b12c-3889b070e1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:55.887823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f57069-74c3-4f9e-b12c-3889b070e1af None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:55.888105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f57069-74c3-4f9e-b12c-3889b070e1af None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:55.888379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f57069-74c3-4f9e-b12c-3889b070e1af None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:55.895209 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f57069-74c3-4f9e-b12c-3889b070e1af None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:55.896678 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f57069-74c3-4f9e-b12c-3889b070e1af None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-e6f57069-74c3-4f9e-b12c-3889b070e1af None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:57:55.912248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:55.913199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:55.914141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:55.914141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:55.914141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:57:55.914141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:57:55.914141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:57:55.914141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:57:55.914141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:57:55.914141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:57:55.914141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 16:57:55.914141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:55.916175 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 439/890] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 16:57:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:55.916461 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b2c42-ab36-4bb6-b4cb-23230ce924fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:55.917201 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2c42-ab36-4bb6-b4cb-23230ce924fb None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:55.917490 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2c42-ab36-4bb6-b4cb-23230ce924fb None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:55.917762 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2c42-ab36-4bb6-b4cb-23230ce924fb None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:55.918177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605a93d-1e79-4385-a030-04032c8712bd None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:55.918476 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b2c42-ab36-4bb6-b4cb-23230ce924fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:55.918763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605a93d-1e79-4385-a030-04032c8712bd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:55.919162 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605a93d-1e79-4385-a030-04032c8712bd None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:55.919877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b2c42-ab36-4bb6-b4cb-23230ce924fb None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:55.924315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 440/891] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:55.924315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605a93d-1e79-4385-a030-04032c8712bd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:55.942691 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 452/892] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 16:57:55 2022] POST /identity/v3/services => generated 241 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:57:55.942691 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d5f66-e64b-4fba-964b-3baaa162a25e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:55.942691 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d5f66-e64b-4fba-964b-3baaa162a25e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:55.942691 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d5f66-e64b-4fba-964b-3baaa162a25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:55.960295 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-874d5f66-e64b-4fba-964b-3baaa162a25e None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:55.962195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-874d5f66-e64b-4fba-964b-3baaa162a25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:56.049423 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 453/893] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:56.059684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605a93d-1e79-4385-a030-04032c8712bd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:56.069861 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d5f66-e64b-4fba-964b-3baaa162a25e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:56.105531 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a394b-bcb2-4076-8b41-10126f2b9beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:56.106595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a394b-bcb2-4076-8b41-10126f2b9beb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:56.107176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a394b-bcb2-4076-8b41-10126f2b9beb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:56.107675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a394b-bcb2-4076-8b41-10126f2b9beb None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:56.108750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a394b-bcb2-4076-8b41-10126f2b9beb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:56.109288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a394b-bcb2-4076-8b41-10126f2b9beb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:56.110969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a394b-bcb2-4076-8b41-10126f2b9beb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:56.131488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 441/894] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 17 16:57:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:56.139038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a394b-bcb2-4076-8b41-10126f2b9beb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:56.192808 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d5f66-e64b-4fba-964b-3baaa162a25e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:56.235297 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcfde7-d62e-4849-84f6-ac3e0e2690b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:56.236137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcfde7-d62e-4849-84f6-ac3e0e2690b4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:56.236420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcfde7-d62e-4849-84f6-ac3e0e2690b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:56.237116 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcfde7-d62e-4849-84f6-ac3e0e2690b4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:56.237784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcfde7-d62e-4849-84f6-ac3e0e2690b4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:56.239537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcfde7-d62e-4849-84f6-ac3e0e2690b4 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-dafcfde7-d62e-4849-84f6-ac3e0e2690b4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:56.256317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:56.257604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:56.258894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:56.258894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:56.258894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:56.258894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:56.258894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:56.258894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:56.258894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:56.258894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:56.258894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:56.258894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:56.258894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:57:56.258894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:56.258894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 16:57:56.258894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:56.258894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 454/895] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:57:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:56.264390 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcfde7-d62e-4849-84f6-ac3e0e2690b4 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:56.268449 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a394b-bcb2-4076-8b41-10126f2b9beb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:56.304395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8ec89-f38a-4424-8ce7-b216be51bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:56.304969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8ec89-f38a-4424-8ce7-b216be51bd2f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:56.305250 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8ec89-f38a-4424-8ce7-b216be51bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:56.305744 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8ec89-f38a-4424-8ce7-b216be51bd2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:56.379523 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcfde7-d62e-4849-84f6-ac3e0e2690b4 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:56.389559 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8ec89-f38a-4424-8ce7-b216be51bd2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:56.391932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8ec89-f38a-4424-8ce7-b216be51bd2f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:56.422402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43138eb6-a845-4ca0-8b0e-dc268d0d8c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:56.423829 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43138eb6-a845-4ca0-8b0e-dc268d0d8c5c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:56.424264 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43138eb6-a845-4ca0-8b0e-dc268d0d8c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:56.424975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43138eb6-a845-4ca0-8b0e-dc268d0d8c5c None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:56.425979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43138eb6-a845-4ca0-8b0e-dc268d0d8c5c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:56.426458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43138eb6-a845-4ca0-8b0e-dc268d0d8c5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:56.428649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43138eb6-a845-4ca0-8b0e-dc268d0d8c5c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:56.435796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 455/896] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:57:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:56.444648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43138eb6-a845-4ca0-8b0e-dc268d0d8c5c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:56.514069 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 442/897] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:57:56 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 16:57:56.514988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8ec89-f38a-4424-8ce7-b216be51bd2f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:56.552000 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43138eb6-a845-4ca0-8b0e-dc268d0d8c5c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:56.585986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d3b02-6944-43ee-abdb-e774a8a968ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:56.586705 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d3b02-6944-43ee-abdb-e774a8a968ad None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:56.586987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d3b02-6944-43ee-abdb-e774a8a968ad None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:56.587259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d3b02-6944-43ee-abdb-e774a8a968ad None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:56.588046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d3b02-6944-43ee-abdb-e774a8a968ad None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:56.588352 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d3b02-6944-43ee-abdb-e774a8a968ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:56.589854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d3b02-6944-43ee-abdb-e774a8a968ad None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:56.599672 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 456/898] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:57:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:56.600546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d3b02-6944-43ee-abdb-e774a8a968ad None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:56.616408 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8ec89-f38a-4424-8ce7-b216be51bd2f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:56.652480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a47316-fa73-4608-bf4a-c3ec6fe6dc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:56.653281 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a47316-fa73-4608-bf4a-c3ec6fe6dc10 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:56.653565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a47316-fa73-4608-bf4a-c3ec6fe6dc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:56.653838 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a47316-fa73-4608-bf4a-c3ec6fe6dc10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:56.664014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a47316-fa73-4608-bf4a-c3ec6fe6dc10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:56.665461 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a47316-fa73-4608-bf4a-c3ec6fe6dc10 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:56.684815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-60a47316-fa73-4608-bf4a-c3ec6fe6dc10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:56.684815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:56.684815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:56.684815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:56.684815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:56.684815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:56.684815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:56.684815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:56.684815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:56.684815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:56.684815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:56.684815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:56.684815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:57:56.684815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:57:56.684815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:56.685774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:56.686653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:57:56.686653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:57:56.686653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:57:56.686653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:56.690744 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 443/899] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:56.692054 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9a13d-a232-43b0-881f-1b24deb504b7 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:56.692352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9a13d-a232-43b0-881f-1b24deb504b7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:56.692617 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9a13d-a232-43b0-881f-1b24deb504b7 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:56.695645 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 444/900] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:56.695645 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9a13d-a232-43b0-881f-1b24deb504b7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:56.707728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d3b02-6944-43ee-abdb-e774a8a968ad None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:56.741768 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d882364-85f9-4659-a2ae-5d0d38a0405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:56.742489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d882364-85f9-4659-a2ae-5d0d38a0405a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:56.742774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d882364-85f9-4659-a2ae-5d0d38a0405a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:56.743047 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d882364-85f9-4659-a2ae-5d0d38a0405a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:56.743877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d882364-85f9-4659-a2ae-5d0d38a0405a None admin] RBAC: Adding query filter params (interface=public, service_id=a6c0095fd91c4c4db917c385ebd7f146, region_id=RegionOne) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:56.744237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d882364-85f9-4659-a2ae-5d0d38a0405a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:56.745558 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d882364-85f9-4659-a2ae-5d0d38a0405a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:56.754868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 457/901] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 16:57:56 2022] GET /identity/v3/endpoints?service_id=a6c0095fd91c4c4db917c385ebd7f146&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:56.754868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcff529-72d7-4e7e-bfb5-2db412a351b6 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:56.754868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcff529-72d7-4e7e-bfb5-2db412a351b6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:56.754868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcff529-72d7-4e7e-bfb5-2db412a351b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:56.769911 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-efcff529-72d7-4e7e-bfb5-2db412a351b6 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:56.771139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-efcff529-72d7-4e7e-bfb5-2db412a351b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:56.800312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9a13d-a232-43b0-881f-1b24deb504b7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:56.834137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d18e8-01cc-48de-b047-f611494b53f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:56.834802 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d18e8-01cc-48de-b047-f611494b53f4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:56.835079 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d18e8-01cc-48de-b047-f611494b53f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:56.835348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d18e8-01cc-48de-b047-f611494b53f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:56.836139 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d18e8-01cc-48de-b047-f611494b53f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:56.836392 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d18e8-01cc-48de-b047-f611494b53f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:56.837943 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d18e8-01cc-48de-b047-f611494b53f4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:56.842081 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 458/902] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:56.843362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcff529-72d7-4e7e-bfb5-2db412a351b6 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:56.857632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 445/903] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:56.862716 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d18e8-01cc-48de-b047-f611494b53f4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:56.952909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcff529-72d7-4e7e-bfb5-2db412a351b6 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:56.960468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d18e8-01cc-48de-b047-f611494b53f4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:56.986145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4635b-ba57-4d54-80fd-046d3a54d55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:56.986939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4635b-ba57-4d54-80fd-046d3a54d55a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:56.987438 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4635b-ba57-4d54-80fd-046d3a54d55a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:56.987819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4635b-ba57-4d54-80fd-046d3a54d55a None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:56.988497 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4635b-ba57-4d54-80fd-046d3a54d55a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:56.989944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4635b-ba57-4d54-80fd-046d3a54d55a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:56.994301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00132f85-48a6-4f7e-a4eb-6a7ac3db562f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:56.995625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00132f85-48a6-4f7e-a4eb-6a7ac3db562f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:56.996089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00132f85-48a6-4f7e-a4eb-6a7ac3db562f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:56.996541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00132f85-48a6-4f7e-a4eb-6a7ac3db562f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:56.996898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 459/904] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 16:57:56 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:57:56.997667 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4635b-ba57-4d54-80fd-046d3a54d55a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:57.018259 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00132f85-48a6-4f7e-a4eb-6a7ac3db562f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:57.020772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00132f85-48a6-4f7e-a4eb-6a7ac3db562f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:57.042265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-00132f85-48a6-4f7e-a4eb-6a7ac3db562f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:57.042265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:57.042265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:57.042265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:57.042265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:57.042265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:57.042265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:57.042265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:57.042265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:57.042265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:57.042265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:57.042265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:57.042265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:57:57.042265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:57:57.042265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:57.043226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:57.044148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:57:57.044148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:57:57.044148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:57:57.044148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:57:57.044148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:57:57.044148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:57:57.044148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:57:57.044148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:57.047873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 446/905] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:57:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:57:57.057918 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00132f85-48a6-4f7e-a4eb-6a7ac3db562f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:57.133375 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4635b-ba57-4d54-80fd-046d3a54d55a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:57.176163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6375b9-706d-4106-9928-9e0f5d904e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:57.176940 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6375b9-706d-4106-9928-9e0f5d904e6f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:57.177226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6375b9-706d-4106-9928-9e0f5d904e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:57.177503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6375b9-706d-4106-9928-9e0f5d904e6f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:57.178162 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6375b9-706d-4106-9928-9e0f5d904e6f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:57.179550 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6375b9-706d-4106-9928-9e0f5d904e6f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:57.181387 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00132f85-48a6-4f7e-a4eb-6a7ac3db562f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-ca6375b9-706d-4106-9928-9e0f5d904e6f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:57.196407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:57.197984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:57.198879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 460/906] 10.222.0.48 () {56 vars in 1132 bytes} [Tue May 17 16:57:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:57.206169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6375b9-706d-4106-9928-9e0f5d904e6f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:57.225170 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668385b-bc9c-4be8-8d3b-1a557ca0f9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:57.225907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668385b-bc9c-4be8-8d3b-1a557ca0f9cf None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:57.226226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668385b-bc9c-4be8-8d3b-1a557ca0f9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:57.226465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668385b-bc9c-4be8-8d3b-1a557ca0f9cf None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:57.227252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668385b-bc9c-4be8-8d3b-1a557ca0f9cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:57.227562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668385b-bc9c-4be8-8d3b-1a557ca0f9cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:57.231122 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668385b-bc9c-4be8-8d3b-1a557ca0f9cf None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:57.242922 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 447/907] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:57:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:57.257077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668385b-bc9c-4be8-8d3b-1a557ca0f9cf None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:57.319146 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6375b9-706d-4106-9928-9e0f5d904e6f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:57.352771 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a93fe0-7592-42a9-b4f9-eb99a63584a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:57.353873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a93fe0-7592-42a9-b4f9-eb99a63584a8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:57.354155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a93fe0-7592-42a9-b4f9-eb99a63584a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:57.354432 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a93fe0-7592-42a9-b4f9-eb99a63584a8 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:57.355134 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a93fe0-7592-42a9-b4f9-eb99a63584a8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:57.355439 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a93fe0-7592-42a9-b4f9-eb99a63584a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:57.356850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a93fe0-7592-42a9-b4f9-eb99a63584a8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:57.361870 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 461/908] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 16:57:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:57.370469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a93fe0-7592-42a9-b4f9-eb99a63584a8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:57.388341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668385b-bc9c-4be8-8d3b-1a557ca0f9cf None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:57.428959 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7df76a-83e9-4c37-be5e-b2f2c84d96fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:57.430078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7df76a-83e9-4c37-be5e-b2f2c84d96fe None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:57.430449 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7df76a-83e9-4c37-be5e-b2f2c84d96fe None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:57.430794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7df76a-83e9-4c37-be5e-b2f2c84d96fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:57.432012 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7df76a-83e9-4c37-be5e-b2f2c84d96fe None admin] RBAC: Adding query filter params (role.id=a21fc21c2d6c4f2d9ac51e7ae4e71e6a, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=c0b16bc0880a4e12879ebb512ebb848b) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:57.432394 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7df76a-83e9-4c37-be5e-b2f2c84d96fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:57.434370 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7df76a-83e9-4c37-be5e-b2f2c84d96fe None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:57.443642 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 448/909] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:57:57 2022] GET /identity/v3/role_assignments?user.id=c0b16bc0880a4e12879ebb512ebb848b&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=a21fc21c2d6c4f2d9ac51e7ae4e71e6a => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:57:57.497244 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a93fe0-7592-42a9-b4f9-eb99a63584a8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:57.536852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c82613-ae9f-44ba-93e4-53aa00eea4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:57.537787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c82613-ae9f-44ba-93e4-53aa00eea4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:57.538219 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c82613-ae9f-44ba-93e4-53aa00eea4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:57.538640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c82613-ae9f-44ba-93e4-53aa00eea4f0 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:57.539501 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c82613-ae9f-44ba-93e4-53aa00eea4f0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:57.540006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c82613-ae9f-44ba-93e4-53aa00eea4f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:57.542273 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c82613-ae9f-44ba-93e4-53aa00eea4f0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:57.548575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 462/910] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 16:57:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:57.556821 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7df76a-83e9-4c37-be5e-b2f2c84d96fe None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:57.666996 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7df76a-83e9-4c37-be5e-b2f2c84d96fe None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:57.699877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d126df-0488-4dfc-872a-f03ba2ad8bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:57.700531 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d126df-0488-4dfc-872a-f03ba2ad8bed None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:57.700808 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d126df-0488-4dfc-872a-f03ba2ad8bed None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:57.701077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d126df-0488-4dfc-872a-f03ba2ad8bed None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:57.701852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d126df-0488-4dfc-872a-f03ba2ad8bed None admin] RBAC: Adding query filter params (interface=public, service_id=6cd60ab697a94380a988ace6c7018618, region_id=RegionOne) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:57.702156 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d126df-0488-4dfc-872a-f03ba2ad8bed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:57.703513 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d126df-0488-4dfc-872a-f03ba2ad8bed None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:57.708852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 449/911] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 16:57:57 2022] GET /identity/v3/endpoints?service_id=6cd60ab697a94380a988ace6c7018618&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:57.715378 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c82613-ae9f-44ba-93e4-53aa00eea4f0 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:57.814023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c82613-ae9f-44ba-93e4-53aa00eea4f0 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:57.851335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2e92d-3021-40de-a2e5-80174a47fde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:57.852388 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2e92d-3021-40de-a2e5-80174a47fde9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:57.852893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2e92d-3021-40de-a2e5-80174a47fde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:57.853396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2e92d-3021-40de-a2e5-80174a47fde9 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:57.854272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2e92d-3021-40de-a2e5-80174a47fde9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:57.855951 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2e92d-3021-40de-a2e5-80174a47fde9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:57.862674 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 463/912] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 16:57:57 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:57:58.304931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c4de5-c7a2-4bf4-957d-b89c29570dfb None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:58.305467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c4de5-c7a2-4bf4-957d-b89c29570dfb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:58.305467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c4de5-c7a2-4bf4-957d-b89c29570dfb None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:58.307232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 450/913] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:58.312422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000994a-9ef4-43a6-9ffe-6a1dbbe85f35 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:58.313111 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000994a-9ef4-43a6-9ffe-6a1dbbe85f35 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:58.313269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000994a-9ef4-43a6-9ffe-6a1dbbe85f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:58.330307 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4000994a-9ef4-43a6-9ffe-6a1dbbe85f35 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:58.331497 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4000994a-9ef4-43a6-9ffe-6a1dbbe85f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:58.399712 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 464/914] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:57:58.422840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c4de5-c7a2-4bf4-957d-b89c29570dfb None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:58.524848 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c4de5-c7a2-4bf4-957d-b89c29570dfb None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:58.559273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6cdb8-39df-411e-9683-43279aee02df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:58.560127 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6cdb8-39df-411e-9683-43279aee02df None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:58.560405 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6cdb8-39df-411e-9683-43279aee02df None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:58.560679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6cdb8-39df-411e-9683-43279aee02df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:58.561331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6cdb8-39df-411e-9683-43279aee02df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:58.562945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6cdb8-39df-411e-9683-43279aee02df None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5bb6cdb8-39df-411e-9683-43279aee02df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:58.575734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:58.578006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:58.580061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:58.580061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:57:58.580061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:58.580061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:58.580061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:58.580061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:58.580061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:58.580061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:58.580061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:58.580061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:58.580061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:57:58.580061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:58.580061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 16:57:58.580061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:57:58.580061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 451/915] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 16:57:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:58.588242 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000994a-9ef4-43a6-9ffe-6a1dbbe85f35 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:58.684259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000994a-9ef4-43a6-9ffe-6a1dbbe85f35 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:58.719235 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d651984-41ca-43ef-b57b-0f011a8f627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:58.719936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d651984-41ca-43ef-b57b-0f011a8f627e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:58.720220 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d651984-41ca-43ef-b57b-0f011a8f627e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:58.720494 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d651984-41ca-43ef-b57b-0f011a8f627e None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:58.721201 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d651984-41ca-43ef-b57b-0f011a8f627e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:58.721507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d651984-41ca-43ef-b57b-0f011a8f627e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:58.722875 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d651984-41ca-43ef-b57b-0f011a8f627e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:58.728275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 465/916] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 16:57:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:58.733876 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6cdb8-39df-411e-9683-43279aee02df None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:58.836151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6cdb8-39df-411e-9683-43279aee02df None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:58.870466 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dae66-e763-48f9-a4b5-5cac0ace3005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:58.871142 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dae66-e763-48f9-a4b5-5cac0ace3005 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:58.871420 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dae66-e763-48f9-a4b5-5cac0ace3005 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:58.871723 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dae66-e763-48f9-a4b5-5cac0ace3005 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:58.872425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dae66-e763-48f9-a4b5-5cac0ace3005 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:58.872729 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dae66-e763-48f9-a4b5-5cac0ace3005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:58.874086 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dae66-e763-48f9-a4b5-5cac0ace3005 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:58.879416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 452/917] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 16:57:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:58.885637 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d651984-41ca-43ef-b57b-0f011a8f627e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:58.984876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d651984-41ca-43ef-b57b-0f011a8f627e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:59.021086 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1e3f7-286b-4b44-821a-b1dfb5af3a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:59.021797 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1e3f7-286b-4b44-821a-b1dfb5af3a21 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:59.022081 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1e3f7-286b-4b44-821a-b1dfb5af3a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:59.022353 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1e3f7-286b-4b44-821a-b1dfb5af3a21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:59.023142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1e3f7-286b-4b44-821a-b1dfb5af3a21 None admin] RBAC: Adding query filter params (interface=public, service_id=212df5165eb94154a008ba7e739bb711, region_id=RegionOne) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:59.023450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1e3f7-286b-4b44-821a-b1dfb5af3a21 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:59.024897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1e3f7-286b-4b44-821a-b1dfb5af3a21 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:59.030889 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 466/918] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 16:57:58 2022] GET /identity/v3/endpoints?service_id=212df5165eb94154a008ba7e739bb711&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:59.036718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dae66-e763-48f9-a4b5-5cac0ace3005 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:59.145261 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dae66-e763-48f9-a4b5-5cac0ace3005 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:59.184827 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764f624-01c0-448e-ab29-9daba223b9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:59.185522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764f624-01c0-448e-ab29-9daba223b9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:59.185798 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764f624-01c0-448e-ab29-9daba223b9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:59.186073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764f624-01c0-448e-ab29-9daba223b9e6 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:59.186774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764f624-01c0-448e-ab29-9daba223b9e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:59.188476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764f624-01c0-448e-ab29-9daba223b9e6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:59.195668 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 453/919] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 16:57:59 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:57:59.388951 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f85e54-c807-4707-888a-cd50307bcca7 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:59.389479 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f85e54-c807-4707-888a-cd50307bcca7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:59.389479 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f85e54-c807-4707-888a-cd50307bcca7 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:59.390843 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 467/920] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:57:59.396190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f19f7-8032-4607-9042-0fa6a3a6fead None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:59.397016 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f19f7-8032-4607-9042-0fa6a3a6fead None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:59.397492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f19f7-8032-4607-9042-0fa6a3a6fead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:59.416496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-798f19f7-8032-4607-9042-0fa6a3a6fead None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:59.417976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-798f19f7-8032-4607-9042-0fa6a3a6fead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:59.485085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 454/921] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:59.508537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f85e54-c807-4707-888a-cd50307bcca7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:59.618485 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f85e54-c807-4707-888a-cd50307bcca7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:59.653658 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57117d7f-ba32-400b-a721-67872f6454d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:59.654426 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57117d7f-ba32-400b-a721-67872f6454d4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:59.654706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57117d7f-ba32-400b-a721-67872f6454d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:59.654976 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57117d7f-ba32-400b-a721-67872f6454d4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:59.655642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57117d7f-ba32-400b-a721-67872f6454d4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:59.657071 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57117d7f-ba32-400b-a721-67872f6454d4 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-57117d7f-ba32-400b-a721-67872f6454d4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:57:59.669118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:57:59.670123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:57:59.670949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:57:59.670949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:57:59.670949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:57:59.670949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:57:59.670949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:57:59.670949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:57:59.670949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:57:59.670949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:57:59.670949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:57:59.670949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:57:59.670949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:57:59.670949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:57:59.670949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 16:57:59.670949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:57:59.670949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 468/922] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:57:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:57:59.678246 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f19f7-8032-4607-9042-0fa6a3a6fead None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:59.764967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bcaca-10d7-4454-ada8-b5c1b3589d10 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:59.765247 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bcaca-10d7-4454-ada8-b5c1b3589d10 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:59.765735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bcaca-10d7-4454-ada8-b5c1b3589d10 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:59.767333 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 469/923] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:57:59.772786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc18b40-70d6-48b9-921f-fa6921ee6433 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:59.773317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc18b40-70d6-48b9-921f-fa6921ee6433 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:59.773793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc18b40-70d6-48b9-921f-fa6921ee6433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:59.780925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f19f7-8032-4607-9042-0fa6a3a6fead None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:57:59.791865 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-acc18b40-70d6-48b9-921f-fa6921ee6433 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:57:59.793332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-acc18b40-70d6-48b9-921f-fa6921ee6433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:57:59.823141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d93fb8-32bb-4360-a139-45dfda0d1f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:57:59.823842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d93fb8-32bb-4360-a139-45dfda0d1f8b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:57:59.824124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d93fb8-32bb-4360-a139-45dfda0d1f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:57:59.824399 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d93fb8-32bb-4360-a139-45dfda0d1f8b None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:57:59.825322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d93fb8-32bb-4360-a139-45dfda0d1f8b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:57:59.825661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d93fb8-32bb-4360-a139-45dfda0d1f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:57:59.827650 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d93fb8-32bb-4360-a139-45dfda0d1f8b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:57:59.833554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 455/924] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:57:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:57:59.839534 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d93fb8-32bb-4360-a139-45dfda0d1f8b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:59.873502 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 470/925] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:57:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:57:59.896212 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc18b40-70d6-48b9-921f-fa6921ee6433 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:57:59.961288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d93fb8-32bb-4360-a139-45dfda0d1f8b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:00.005775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed103c17-22ee-4957-99ea-2d995676766e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:00.007115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed103c17-22ee-4957-99ea-2d995676766e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:00.007802 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed103c17-22ee-4957-99ea-2d995676766e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:00.008290 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed103c17-22ee-4957-99ea-2d995676766e None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:00.010389 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed103c17-22ee-4957-99ea-2d995676766e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:00.011115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed103c17-22ee-4957-99ea-2d995676766e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:00.013579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed103c17-22ee-4957-99ea-2d995676766e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:00.015537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc18b40-70d6-48b9-921f-fa6921ee6433 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:00.026709 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 456/926] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 16:57:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:00.028022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed103c17-22ee-4957-99ea-2d995676766e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:00.058187 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbdc14-ea9b-4111-aed8-0ae68b94654c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:00.059548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbdc14-ea9b-4111-aed8-0ae68b94654c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:00.060249 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbdc14-ea9b-4111-aed8-0ae68b94654c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:00.060630 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbdc14-ea9b-4111-aed8-0ae68b94654c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:00.074796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbdc14-ea9b-4111-aed8-0ae68b94654c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d7cbdc14-ea9b-4111-aed8-0ae68b94654c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:58:00.085821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:00.087003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:00.089537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:00.089537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:00.089537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:00.089537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:00.089537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:58:00.089537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:58:00.089537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:58:00.089537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:58:00.089537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:58:00.089537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:58:00.089537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 16:58:00.089537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:00.089537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 471/927] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 17 16:57:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:00.095010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbdc14-ea9b-4111-aed8-0ae68b94654c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:00.155174 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed103c17-22ee-4957-99ea-2d995676766e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:00.189175 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239494ea-b6eb-41de-a133-801b1c71d88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:00.189837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239494ea-b6eb-41de-a133-801b1c71d88f None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:00.190113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239494ea-b6eb-41de-a133-801b1c71d88f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:00.190380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239494ea-b6eb-41de-a133-801b1c71d88f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:00.191116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239494ea-b6eb-41de-a133-801b1c71d88f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:00.192527 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239494ea-b6eb-41de-a133-801b1c71d88f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:00.202676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbdc14-ea9b-4111-aed8-0ae68b94654c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:00.211593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 457/928] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 16:58:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:58:00.213439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e953b-a7b8-4808-bbc4-d13cad1b410b None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:00.213720 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e953b-a7b8-4808-bbc4-d13cad1b410b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:00.213991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e953b-a7b8-4808-bbc4-d13cad1b410b None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:00.215381 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 458/929] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:00.220883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fb38e-a260-4f53-87e0-713c9a0d36b4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:00.221167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fb38e-a260-4f53-87e0-713c9a0d36b4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:00.221440 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fb38e-a260-4f53-87e0-713c9a0d36b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:00.242311 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-754fb38e-a260-4f53-87e0-713c9a0d36b4 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:00.245055 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-754fb38e-a260-4f53-87e0-713c9a0d36b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:00.258298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a612e3-e1e7-47f0-aa63-f95015cad846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:00.258981 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a612e3-e1e7-47f0-aa63-f95015cad846 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:00.259876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a612e3-e1e7-47f0-aa63-f95015cad846 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:00.260146 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a612e3-e1e7-47f0-aa63-f95015cad846 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:00.261452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a612e3-e1e7-47f0-aa63-f95015cad846 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:00.261762 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a612e3-e1e7-47f0-aa63-f95015cad846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:00.263482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a612e3-e1e7-47f0-aa63-f95015cad846 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:00.275674 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 472/930] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 17 16:58:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:00.281096 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a612e3-e1e7-47f0-aa63-f95015cad846 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:00.344971 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 459/931] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:58:00.369163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fb38e-a260-4f53-87e0-713c9a0d36b4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:00.406931 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a612e3-e1e7-47f0-aa63-f95015cad846 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:00.442040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6ccb7-a9a6-4b59-aab8-6b1bcc196c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:00.443138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6ccb7-a9a6-4b59-aab8-6b1bcc196c09 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:00.443634 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6ccb7-a9a6-4b59-aab8-6b1bcc196c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:00.443923 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6ccb7-a9a6-4b59-aab8-6b1bcc196c09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:00.457561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6ccb7-a9a6-4b59-aab8-6b1bcc196c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:00.459001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6ccb7-a9a6-4b59-aab8-6b1bcc196c09 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:00.476880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-16a6ccb7-a9a6-4b59-aab8-6b1bcc196c09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:00.476880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:00.476880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:00.476880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:00.476880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:00.476880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:00.476880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:00.476880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:00.476880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:00.476880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:00.476880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:00.476880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:00.476880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:58:00.476880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:58:00.476880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:00.477787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:00.478898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:58:00.478898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:58:00.478898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:00.478898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:00.478898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 473/932] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:00.484696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6ccb7-a9a6-4b59-aab8-6b1bcc196c09 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:00.487967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fb38e-a260-4f53-87e0-713c9a0d36b4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:00.524684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54890690-b490-4f58-82fe-9a61b4c1a25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:00.525896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54890690-b490-4f58-82fe-9a61b4c1a25b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:00.526453 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54890690-b490-4f58-82fe-9a61b4c1a25b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:00.526937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54890690-b490-4f58-82fe-9a61b4c1a25b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:00.527853 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54890690-b490-4f58-82fe-9a61b4c1a25b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:00.529418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54890690-b490-4f58-82fe-9a61b4c1a25b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-54890690-b490-4f58-82fe-9a61b4c1a25b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:00.542014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:00.543010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:00.544325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:00.544325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:00.544325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:00.544325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:00.544325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:00.544325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:00.544325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:00.544325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:00.544325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:00.544325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:00.544325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:00.544325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:58:00.544325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:00.544325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 16:58:00.544325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:00.547007 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 460/933] 10.222.0.48 () {56 vars in 1132 bytes} [Tue May 17 16:58:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:00.553017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54890690-b490-4f58-82fe-9a61b4c1a25b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:00.612770 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6ccb7-a9a6-4b59-aab8-6b1bcc196c09 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:00.648143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd43c86-0cb2-4c8b-944f-f37233efe3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:00.649150 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd43c86-0cb2-4c8b-944f-f37233efe3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:00.649654 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd43c86-0cb2-4c8b-944f-f37233efe3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:00.650780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd43c86-0cb2-4c8b-944f-f37233efe3b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:00.651773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd43c86-0cb2-4c8b-944f-f37233efe3b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:00.652293 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd43c86-0cb2-4c8b-944f-f37233efe3b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:00.653843 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd43c86-0cb2-4c8b-944f-f37233efe3b1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:00.666459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 474/934] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:00.666739 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54890690-b490-4f58-82fe-9a61b4c1a25b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:00.674041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd43c86-0cb2-4c8b-944f-f37233efe3b1 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:00.707874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616ea3a-fffd-4e8f-a081-adf7b5310c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:00.708925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616ea3a-fffd-4e8f-a081-adf7b5310c8f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:00.709548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616ea3a-fffd-4e8f-a081-adf7b5310c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:00.710318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616ea3a-fffd-4e8f-a081-adf7b5310c8f None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:00.711477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616ea3a-fffd-4e8f-a081-adf7b5310c8f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:00.711994 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616ea3a-fffd-4e8f-a081-adf7b5310c8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:00.715620 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616ea3a-fffd-4e8f-a081-adf7b5310c8f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:00.723031 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 461/935] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 16:58:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:00.735697 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616ea3a-fffd-4e8f-a081-adf7b5310c8f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:00.788839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd43c86-0cb2-4c8b-944f-f37233efe3b1 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:00.823671 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216857b-ff75-4b76-8f2d-1e801bcc10be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:00.824662 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216857b-ff75-4b76-8f2d-1e801bcc10be None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:00.825055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216857b-ff75-4b76-8f2d-1e801bcc10be None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:00.825429 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216857b-ff75-4b76-8f2d-1e801bcc10be None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:00.833280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216857b-ff75-4b76-8f2d-1e801bcc10be None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:00.834906 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216857b-ff75-4b76-8f2d-1e801bcc10be None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:00.840602 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616ea3a-fffd-4e8f-a081-adf7b5310c8f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-9216857b-ff75-4b76-8f2d-1e801bcc10be None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:58:00.850605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:00.851588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:00.852837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:00.852837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:00.852837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:58:00.852837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:58:00.852837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:58:00.852837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:58:00.852837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:58:00.852837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:58:00.852837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 16:58:00.852837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:00.858131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 475/936] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 16:58:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:00.859132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216857b-ff75-4b76-8f2d-1e801bcc10be None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:00.883794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccbff3-d853-4b08-9b80-53fbf5d4cba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:00.885401 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccbff3-d853-4b08-9b80-53fbf5d4cba2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:00.885892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccbff3-d853-4b08-9b80-53fbf5d4cba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:00.886633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccbff3-d853-4b08-9b80-53fbf5d4cba2 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:00.887803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccbff3-d853-4b08-9b80-53fbf5d4cba2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:00.888402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccbff3-d853-4b08-9b80-53fbf5d4cba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:00.890552 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccbff3-d853-4b08-9b80-53fbf5d4cba2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:00.896961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 462/937] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 16:58:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:00.905347 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccbff3-d853-4b08-9b80-53fbf5d4cba2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:00.971268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216857b-ff75-4b76-8f2d-1e801bcc10be None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:01.013953 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce477ef0-6645-4093-a69a-3c534d356483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:01.015041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce477ef0-6645-4093-a69a-3c534d356483 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:01.015892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce477ef0-6645-4093-a69a-3c534d356483 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:01.016582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce477ef0-6645-4093-a69a-3c534d356483 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:01.017720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce477ef0-6645-4093-a69a-3c534d356483 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:01.018502 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce477ef0-6645-4093-a69a-3c534d356483 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:01.020665 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce477ef0-6645-4093-a69a-3c534d356483 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:01.025010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccbff3-d853-4b08-9b80-53fbf5d4cba2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:01.042067 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 476/938] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 17 16:58:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:01.048028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce477ef0-6645-4093-a69a-3c534d356483 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:01.071110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d1627-19ed-4de6-9261-1947b1cb540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:01.072235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d1627-19ed-4de6-9261-1947b1cb540c None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:01.072512 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d1627-19ed-4de6-9261-1947b1cb540c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:01.072785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d1627-19ed-4de6-9261-1947b1cb540c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:01.073520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d1627-19ed-4de6-9261-1947b1cb540c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:01.074898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d1627-19ed-4de6-9261-1947b1cb540c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:01.107867 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 463/939] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 16:58:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:58:01.168135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce477ef0-6645-4093-a69a-3c534d356483 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:01.211460 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ea7a2-a4fe-4747-89ff-ccc40130822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:01.212346 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ea7a2-a4fe-4747-89ff-ccc40130822e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:01.212621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ea7a2-a4fe-4747-89ff-ccc40130822e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:01.212897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ea7a2-a4fe-4747-89ff-ccc40130822e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:01.223951 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ea7a2-a4fe-4747-89ff-ccc40130822e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:01.225417 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ea7a2-a4fe-4747-89ff-ccc40130822e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:01.246288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-032ea7a2-a4fe-4747-89ff-ccc40130822e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:01.246288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:01.246288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:01.246288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:01.246288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:01.246288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:01.246288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:01.246288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:01.246288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:01.246288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:01.246288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:01.246288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:01.246288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:58:01.246288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:58:01.246288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:01.247248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:01.248284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:58:01.248284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:58:01.248284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:01.248284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:01.248284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 477/940] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:01.254931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d1627-19ed-4de6-9261-1947b1cb540c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:01.366001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d1627-19ed-4de6-9261-1947b1cb540c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:01.401554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9538fee-1d92-4fb7-8b2a-4ad9efb2a2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:01.402380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9538fee-1d92-4fb7-8b2a-4ad9efb2a2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:01.402665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9538fee-1d92-4fb7-8b2a-4ad9efb2a2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:01.402941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9538fee-1d92-4fb7-8b2a-4ad9efb2a2a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:01.403722 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9538fee-1d92-4fb7-8b2a-4ad9efb2a2a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:01.404035 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9538fee-1d92-4fb7-8b2a-4ad9efb2a2a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:01.405488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9538fee-1d92-4fb7-8b2a-4ad9efb2a2a8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:01.419775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 464/941] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:01.425983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ea7a2-a4fe-4747-89ff-ccc40130822e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:01.529891 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ea7a2-a4fe-4747-89ff-ccc40130822e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:01.563839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c1b24-2f5c-4801-8a2d-05d58d26550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:01.564637 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c1b24-2f5c-4801-8a2d-05d58d26550e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:01.564916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c1b24-2f5c-4801-8a2d-05d58d26550e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:01.565185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c1b24-2f5c-4801-8a2d-05d58d26550e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:01.572728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c1b24-2f5c-4801-8a2d-05d58d26550e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:01.574175 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c1b24-2f5c-4801-8a2d-05d58d26550e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:01.588868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-5a6c1b24-2f5c-4801-8a2d-05d58d26550e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:58:01.588868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:01.588868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:01.588868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:01.588868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:01.588868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:01.588868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:01.588868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:01.588868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:01.588868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:01.588868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:01.588868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:01.588868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:58:01.588868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:58:01.588868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:01.589823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:01.590730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:58:01.590730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:58:01.590730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:58:01.590730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:58:01.590730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:58:01.590730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:58:01.590730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:58:01.590730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:01.590730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 478/942] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:58:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:01.598133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd842dc-e471-4967-b067-6342777f1510 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:01.598746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c1b24-2f5c-4801-8a2d-05d58d26550e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:01.598908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd842dc-e471-4967-b067-6342777f1510 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:01.598908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd842dc-e471-4967-b067-6342777f1510 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:01.601505 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 465/943] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:01.605447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf8a4f-015a-48f4-8451-f26dd9f54769 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:01.605742 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf8a4f-015a-48f4-8451-f26dd9f54769 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:01.605976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf8a4f-015a-48f4-8451-f26dd9f54769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:01.622440 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-75cf8a4f-015a-48f4-8451-f26dd9f54769 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:01.623529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-75cf8a4f-015a-48f4-8451-f26dd9f54769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:01.695925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 466/944] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:58:01.716002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf8a4f-015a-48f4-8451-f26dd9f54769 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:01.722027 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c1b24-2f5c-4801-8a2d-05d58d26550e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:01.766421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e02d4-4e2c-404b-89f8-3b5cb9d08ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:01.768078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e02d4-4e2c-404b-89f8-3b5cb9d08ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:01.768570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e02d4-4e2c-404b-89f8-3b5cb9d08ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:01.769198 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e02d4-4e2c-404b-89f8-3b5cb9d08ba1 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:01.770478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e02d4-4e2c-404b-89f8-3b5cb9d08ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:01.771014 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e02d4-4e2c-404b-89f8-3b5cb9d08ba1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:01.773084 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e02d4-4e2c-404b-89f8-3b5cb9d08ba1 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:01.795592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 479/945] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:58:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:01.796810 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e02d4-4e2c-404b-89f8-3b5cb9d08ba1 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:01.819875 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf8a4f-015a-48f4-8451-f26dd9f54769 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:01.854444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041437-99f7-42fe-b562-14f39baa4d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:01.855288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041437-99f7-42fe-b562-14f39baa4d65 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:01.855586 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041437-99f7-42fe-b562-14f39baa4d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:01.855835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041437-99f7-42fe-b562-14f39baa4d65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:01.856485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7041437-99f7-42fe-b562-14f39baa4d65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:01.857910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7041437-99f7-42fe-b562-14f39baa4d65 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c7041437-99f7-42fe-b562-14f39baa4d65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:01.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:01.876605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:01.877433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:01.877433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:01.877433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:01.877433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:01.877433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:01.877433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:01.877433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:01.877433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:01.877433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:01.877433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:01.877433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:58:01.877433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:01.877433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 16:58:01.877433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:01.880584 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 467/946] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 16:58:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:01.887405 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041437-99f7-42fe-b562-14f39baa4d65 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:01.922616 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e02d4-4e2c-404b-89f8-3b5cb9d08ba1 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:01.968310 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4081840-077d-427f-b452-26aae3ce9f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:01.969210 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4081840-077d-427f-b452-26aae3ce9f72 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:01.969489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4081840-077d-427f-b452-26aae3ce9f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:01.969763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4081840-077d-427f-b452-26aae3ce9f72 None admin] PATH_INFO: `/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/c0b16bc0880a4e12879ebb512ebb848b/roles/a21fc21c2d6c4f2d9ac51e7ae4e71e6a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:01.973028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4081840-077d-427f-b452-26aae3ce9f72 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2b356e72cf84d099f2ce8678103ecef, user_id=c0b16bc0880a4e12879ebb512ebb848b, role_id=a21fc21c2d6c4f2d9ac51e7ae4e71e6a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:01.974470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4081840-077d-427f-b452-26aae3ce9f72 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:01.991700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 480/947] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:58:01 2022] PUT /identity/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/c0b16bc0880a4e12879ebb512ebb848b/roles/a21fc21c2d6c4f2d9ac51e7ae4e71e6a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:58:02.012187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041437-99f7-42fe-b562-14f39baa4d65 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:02.052020 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081f2ec-c637-43dc-8040-265af88c92c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:02.053149 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081f2ec-c637-43dc-8040-265af88c92c6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:02.053712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081f2ec-c637-43dc-8040-265af88c92c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:02.054225 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081f2ec-c637-43dc-8040-265af88c92c6 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:02.055142 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081f2ec-c637-43dc-8040-265af88c92c6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:02.055667 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081f2ec-c637-43dc-8040-265af88c92c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:02.057556 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081f2ec-c637-43dc-8040-265af88c92c6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:02.064232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 468/948] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 16:58:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:02.070588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4081840-077d-427f-b452-26aae3ce9f72 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:02.179810 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4081840-077d-427f-b452-26aae3ce9f72 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:02.218920 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b27dd-48ef-4b46-b334-0a7eed908ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:02.219624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b27dd-48ef-4b46-b334-0a7eed908ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:02.219906 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b27dd-48ef-4b46-b334-0a7eed908ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:02.220185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b27dd-48ef-4b46-b334-0a7eed908ef8 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:02.220899 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b27dd-48ef-4b46-b334-0a7eed908ef8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:02.221205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b27dd-48ef-4b46-b334-0a7eed908ef8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:02.222570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b27dd-48ef-4b46-b334-0a7eed908ef8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:02.227788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 481/949] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 16:58:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:02.233619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081f2ec-c637-43dc-8040-265af88c92c6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:02.343226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081f2ec-c637-43dc-8040-265af88c92c6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:02.379680 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e7069-5c3f-4875-ba4b-fe03ff03b6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:02.380647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e7069-5c3f-4875-ba4b-fe03ff03b6e0 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:02.381103 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e7069-5c3f-4875-ba4b-fe03ff03b6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:02.381515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e7069-5c3f-4875-ba4b-fe03ff03b6e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:02.382417 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e7069-5c3f-4875-ba4b-fe03ff03b6e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:02.383947 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e7069-5c3f-4875-ba4b-fe03ff03b6e0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:02.404628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 469/950] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 16:58:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:58:02.603533 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f4905-91a2-40b1-b925-0f2228a4753d None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:02.604171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f4905-91a2-40b1-b925-0f2228a4753d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:02.604171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f4905-91a2-40b1-b925-0f2228a4753d None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:02.605963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 482/951] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:02.611389 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b108567-06ea-4466-ba40-b33a64a86fb2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:02.611898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b108567-06ea-4466-ba40-b33a64a86fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:02.612277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b108567-06ea-4466-ba40-b33a64a86fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:02.632236 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0b108567-06ea-4466-ba40-b33a64a86fb2 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:02.633406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0b108567-06ea-4466-ba40-b33a64a86fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:02.711711 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 470/952] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:02.730910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f4905-91a2-40b1-b925-0f2228a4753d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:02.835182 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f4905-91a2-40b1-b925-0f2228a4753d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:02.870597 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ac08d-2605-4a10-b2e7-2c0ffdc5b82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:02.871177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac08d-2605-4a10-b2e7-2c0ffdc5b82f None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:02.871456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac08d-2605-4a10-b2e7-2c0ffdc5b82f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:02.871761 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac08d-2605-4a10-b2e7-2c0ffdc5b82f None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:02.872465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ac08d-2605-4a10-b2e7-2c0ffdc5b82f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:02.873880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ac08d-2605-4a10-b2e7-2c0ffdc5b82f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:02.875240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: WARNING keystone.server.flask.common [None req-cf2ac08d-2605-4a10-b2e7-2c0ffdc5b82f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 17 16:58:02.897454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.sql.core [None req-cf2ac08d-2605-4a10-b2e7-2c0ffdc5b82f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 16:58:02.897454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 17 16:58:02.897454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [parameters: {'id': '35d30783815c453e8218e53f0988da3f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 17 16:58:02.897454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80070) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 16:58:02.914301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-cf2ac08d-2605-4a10-b2e7-2c0ffdc5b82f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 35d30783815c453e8218e53f0988da3f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 35d30783815c453e8218e53f0988da3f. May 17 16:58:02.914301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:02.914301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 16:58:02.914301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 16:58:02.914301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 16:58:02.914301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 16:58:02.914301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 16:58:02.914301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application result = self._query(query) May 17 16:58:02.914301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 16:58:02.914301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application conn.query(q) May 17 16:58:02.914301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 16:58:02.914301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 16:58:02.914301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application result.read() May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 17 16:58:02.915185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return project_ref.to_dict() May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application next(self.gen) May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application yield resource May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application next(self.gen) May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self.session.rollback() May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self.force_reraise() May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise self.value May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application session.commit() May 17 16:58:02.916269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._prepare_impl() May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self.session.flush() May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._flush(objects) May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application compat.raise_( May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application flush_context.execute() May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 16:58:02.917152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rec.execute(self) May 17 16:58:02.918079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 16:58:02.918079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 16:58:02.918079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 16:58:02.918079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 16:58:02.918079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 17 16:58:02.918079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application c = connection._execute_20( May 17 16:58:02.918079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 16:58:02.918079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 16:58:02.918079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 16:58:02.918079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 16:58:02.918079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 16:58:02.918079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 16:58:02.918079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 16:58:02.918079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 16:58:02.918079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application result = self._query(query) May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application conn.query(q) May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application result.read() May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 16:58:02.918866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 16:58:02.919739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 16:58:02.919739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 16:58:02.919739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 16:58:02.919739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 16:58:02.919739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 16:58:02.919739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 16:58:02.919739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 16:58:02.919739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 17 16:58:02.919739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [parameters: {'id': '35d30783815c453e8218e53f0988da3f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 17 16:58:02.919739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 16:58:02.919739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:02.919739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:58:02.919739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:02.919739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:02.919739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:02.920527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:02.921458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:02.921458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 17 16:58:02.921458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 17 16:58:02.921458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:02.921458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:02.921458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 17 16:58:02.921458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.Conflict( May 17 16:58:02.921458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 35d30783815c453e8218e53f0988da3f. May 17 16:58:02.921458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:02.923797 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 483/953] 10.222.0.48 () {60 vars in 1140 bytes} [Tue May 17 16:58:02 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:02.930776 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b108567-06ea-4466-ba40-b33a64a86fb2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:03.033702 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b108567-06ea-4466-ba40-b33a64a86fb2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:03.068569 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3a252-1c9c-4dee-9fe0-f87ee5722a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:03.069373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3a252-1c9c-4dee-9fe0-f87ee5722a4f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:03.069655 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3a252-1c9c-4dee-9fe0-f87ee5722a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:03.069931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3a252-1c9c-4dee-9fe0-f87ee5722a4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:03.076676 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3a252-1c9c-4dee-9fe0-f87ee5722a4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:03.078123 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3a252-1c9c-4dee-9fe0-f87ee5722a4f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:03.091829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-31e3a252-1c9c-4dee-9fe0-f87ee5722a4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:58:03.091829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:03.091829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:03.091829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:03.091829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:03.091829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:03.091829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:03.091829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:03.091829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:03.091829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:03.091829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:03.091829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:03.091829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:58:03.091829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:58:03.091829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:03.093837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:03.096383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:58:03.096383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:58:03.096383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:58:03.096383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:58:03.096383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:58:03.096383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:58:03.096383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:58:03.096383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:03.096383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 471/954] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:03.099764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ac08d-2605-4a10-b2e7-2c0ffdc5b82f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:03.203814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ac08d-2605-4a10-b2e7-2c0ffdc5b82f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:03.237912 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62282e-9511-46e5-a3b7-f6b45a689007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:03.238869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62282e-9511-46e5-a3b7-f6b45a689007 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:03.239330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62282e-9511-46e5-a3b7-f6b45a689007 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:03.239808 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62282e-9511-46e5-a3b7-f6b45a689007 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:03.240819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62282e-9511-46e5-a3b7-f6b45a689007 None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:03.241300 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62282e-9511-46e5-a3b7-f6b45a689007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:03.243348 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62282e-9511-46e5-a3b7-f6b45a689007 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:03.267046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 484/955] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 16:58:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:03.515290 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95de93b-9004-4962-92f0-fd585eed266d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:03.515483 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95de93b-9004-4962-92f0-fd585eed266d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:03.515850 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95de93b-9004-4962-92f0-fd585eed266d None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:03.517432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 472/956] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:03.523024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1e92-7855-40d9-9a4e-687e983bcbed None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:03.523553 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1e92-7855-40d9-9a4e-687e983bcbed None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:03.524115 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1e92-7855-40d9-9a4e-687e983bcbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:03.541496 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2a1d1e92-7855-40d9-9a4e-687e983bcbed None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:03.543274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2a1d1e92-7855-40d9-9a4e-687e983bcbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:03.615722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 485/957] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:58:03.635069 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95de93b-9004-4962-92f0-fd585eed266d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:03.744709 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95de93b-9004-4962-92f0-fd585eed266d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:03.779390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba4f80-8857-4c4c-b362-c9e97134694d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:03.780194 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba4f80-8857-4c4c-b362-c9e97134694d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:03.780479 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba4f80-8857-4c4c-b362-c9e97134694d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:03.780805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba4f80-8857-4c4c-b362-c9e97134694d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:03.781457 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba4f80-8857-4c4c-b362-c9e97134694d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:03.782828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba4f80-8857-4c4c-b362-c9e97134694d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-96ba4f80-8857-4c4c-b362-c9e97134694d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:03.795515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:03.796540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:03.797791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:03.797791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:03.797791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:03.797791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:03.797791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:03.797791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:03.797791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:03.797791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:03.797791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:03.797791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:03.797791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:58:03.797791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:03.797791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 16:58:03.797791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:03.797791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 473/958] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:58:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:03.804880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d1e92-7855-40d9-9a4e-687e983bcbed None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:03.904635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d1e92-7855-40d9-9a4e-687e983bcbed None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:03.939130 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab8239-d891-4221-8e60-5f90dd9d99d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:03.940177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab8239-d891-4221-8e60-5f90dd9d99d4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:03.940682 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab8239-d891-4221-8e60-5f90dd9d99d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:03.941156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab8239-d891-4221-8e60-5f90dd9d99d4 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:03.942074 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab8239-d891-4221-8e60-5f90dd9d99d4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:03.942575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab8239-d891-4221-8e60-5f90dd9d99d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:03.944150 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab8239-d891-4221-8e60-5f90dd9d99d4 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:03.954743 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 486/959] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 16:58:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:03.956341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba4f80-8857-4c4c-b362-c9e97134694d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:04.059221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba4f80-8857-4c4c-b362-c9e97134694d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:04.099625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f89d4-28e9-495f-b80a-9059421c5c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:04.099625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f89d4-28e9-495f-b80a-9059421c5c30 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:04.099625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f89d4-28e9-495f-b80a-9059421c5c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:04.099625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f89d4-28e9-495f-b80a-9059421c5c30 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:04.100034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f89d4-28e9-495f-b80a-9059421c5c30 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:04.100034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f89d4-28e9-495f-b80a-9059421c5c30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:04.100034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f89d4-28e9-495f-b80a-9059421c5c30 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:04.102218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 474/960] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 16:58:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:04.407791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe41c1-582f-4ac8-aa9c-669a18ee1826 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:04.408145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe41c1-582f-4ac8-aa9c-669a18ee1826 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:04.408324 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe41c1-582f-4ac8-aa9c-669a18ee1826 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:04.409969 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 487/961] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:04.415157 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b39262-97d4-47d3-9cd9-f43210eb182d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:04.416181 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b39262-97d4-47d3-9cd9-f43210eb182d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:04.416686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b39262-97d4-47d3-9cd9-f43210eb182d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:04.433609 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f3b39262-97d4-47d3-9cd9-f43210eb182d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:04.434786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f3b39262-97d4-47d3-9cd9-f43210eb182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:04.507840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 475/962] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:04.531263 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe41c1-582f-4ac8-aa9c-669a18ee1826 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:04.639717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe41c1-582f-4ac8-aa9c-669a18ee1826 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:04.673694 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca622985-f20e-4fe9-8c1f-fe87b89f0d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:04.674435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca622985-f20e-4fe9-8c1f-fe87b89f0d03 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:04.674718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca622985-f20e-4fe9-8c1f-fe87b89f0d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:04.675056 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca622985-f20e-4fe9-8c1f-fe87b89f0d03 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:04.685358 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca622985-f20e-4fe9-8c1f-fe87b89f0d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-ca622985-f20e-4fe9-8c1f-fe87b89f0d03 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:58:04.694132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:04.695080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:04.695966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:04.695966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:04.695966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:04.695966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:04.695966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:58:04.695966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:58:04.695966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:58:04.695966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:58:04.695966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:58:04.695966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:58:04.695966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 16:58:04.695966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:04.695966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 488/963] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 17 16:58:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:04.702127 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b39262-97d4-47d3-9cd9-f43210eb182d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:04.767521 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10ad54-22fe-48df-ade9-e19dc3e3a158 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:04.767867 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10ad54-22fe-48df-ade9-e19dc3e3a158 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:04.768109 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10ad54-22fe-48df-ade9-e19dc3e3a158 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:04.769735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 489/964] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:04.775396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf48ae6-e0b8-49a4-bece-051590d898c5 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:04.775738 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf48ae6-e0b8-49a4-bece-051590d898c5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:04.776025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf48ae6-e0b8-49a4-bece-051590d898c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:04.795669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-bbf48ae6-e0b8-49a4-bece-051590d898c5 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:04.796958 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-bbf48ae6-e0b8-49a4-bece-051590d898c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:04.806257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b39262-97d4-47d3-9cd9-f43210eb182d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:04.842603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4843b-73e3-485a-88b5-fffb21953b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:04.843322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4843b-73e3-485a-88b5-fffb21953b56 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:04.843624 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4843b-73e3-485a-88b5-fffb21953b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:04.843984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4843b-73e3-485a-88b5-fffb21953b56 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:04.844724 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4843b-73e3-485a-88b5-fffb21953b56 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:04.845028 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4843b-73e3-485a-88b5-fffb21953b56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:04.846391 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4843b-73e3-485a-88b5-fffb21953b56 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:04.855968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 476/965] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 17 16:58:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:04.861395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4843b-73e3-485a-88b5-fffb21953b56 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:04.873909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 490/966] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:58:04.897598 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf48ae6-e0b8-49a4-bece-051590d898c5 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:04.976608 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4843b-73e3-485a-88b5-fffb21953b56 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:05.009917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf48ae6-e0b8-49a4-bece-051590d898c5 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:05.011625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c490da-286b-4ec5-b565-ec5f11335283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:05.012517 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c490da-286b-4ec5-b565-ec5f11335283 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:05.012865 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c490da-286b-4ec5-b565-ec5f11335283 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:05.013205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c490da-286b-4ec5-b565-ec5f11335283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:05.025044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c490da-286b-4ec5-b565-ec5f11335283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:05.026581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c490da-286b-4ec5-b565-ec5f11335283 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:05.044102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-78c490da-286b-4ec5-b565-ec5f11335283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:05.044102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:05.044102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:05.044102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:05.044102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:05.044102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:05.044102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:05.044102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:05.044102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:05.044102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:05.044102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:05.044102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:05.044102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:58:05.044102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:58:05.044102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:05.045071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:05.045965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:58:05.045965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:58:05.045965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:05.045965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:05.045965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 477/967] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:05.051207 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c490da-286b-4ec5-b565-ec5f11335283 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:05.052264 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf7c5b-5991-4ec3-b526-e3869ce72df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:05.053077 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf7c5b-5991-4ec3-b526-e3869ce72df8 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:05.053362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf7c5b-5991-4ec3-b526-e3869ce72df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:05.053634 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf7c5b-5991-4ec3-b526-e3869ce72df8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:05.054465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf7c5b-5991-4ec3-b526-e3869ce72df8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:05.057265 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf7c5b-5991-4ec3-b526-e3869ce72df8 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-b5cf7c5b-5991-4ec3-b526-e3869ce72df8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:05.072989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:05.074361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:05.076125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:05.076125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:05.076125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:05.076125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:05.076125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:05.076125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:05.076125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:05.076125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:05.076125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:05.076125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:05.076125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:58:05.076125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:05.076125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 16:58:05.076125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:05.083623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 491/968] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 16:58:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:05.083623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf7c5b-5991-4ec3-b526-e3869ce72df8 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:05.158017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c490da-286b-4ec5-b565-ec5f11335283 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:05.191452 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da240580-5e1e-4256-897a-91c0a12804b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:05.192323 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da240580-5e1e-4256-897a-91c0a12804b8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:05.192665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da240580-5e1e-4256-897a-91c0a12804b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:05.193007 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da240580-5e1e-4256-897a-91c0a12804b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:05.193793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da240580-5e1e-4256-897a-91c0a12804b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:05.194160 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da240580-5e1e-4256-897a-91c0a12804b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:05.195584 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da240580-5e1e-4256-897a-91c0a12804b8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:05.207812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 478/969] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:05.215793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da240580-5e1e-4256-897a-91c0a12804b8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:05.218331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf7c5b-5991-4ec3-b526-e3869ce72df8 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:05.260175 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc4bad-ab79-4b97-beac-d7b5e5df5e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:05.260939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc4bad-ab79-4b97-beac-d7b5e5df5e16 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:05.261316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc4bad-ab79-4b97-beac-d7b5e5df5e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:05.261690 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc4bad-ab79-4b97-beac-d7b5e5df5e16 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:05.262509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc4bad-ab79-4b97-beac-d7b5e5df5e16 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:05.262913 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc4bad-ab79-4b97-beac-d7b5e5df5e16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:05.264417 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc4bad-ab79-4b97-beac-d7b5e5df5e16 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:05.269583 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 492/970] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 16:58:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:05.275568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc4bad-ab79-4b97-beac-d7b5e5df5e16 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:05.330513 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da240580-5e1e-4256-897a-91c0a12804b8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:05.367878 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05145fdc-e817-49e2-88e9-c0aae510f371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:05.368722 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05145fdc-e817-49e2-88e9-c0aae510f371 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:05.369003 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05145fdc-e817-49e2-88e9-c0aae510f371 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:05.369266 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05145fdc-e817-49e2-88e9-c0aae510f371 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:05.376828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05145fdc-e817-49e2-88e9-c0aae510f371 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:05.378279 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05145fdc-e817-49e2-88e9-c0aae510f371 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:05.394503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc4bad-ab79-4b97-beac-d7b5e5df5e16 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-05145fdc-e817-49e2-88e9-c0aae510f371 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:58:05.398554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:05.399490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:05.401024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:05.401024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:05.401024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:58:05.401024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:58:05.401024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:58:05.401024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:58:05.401024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:58:05.401024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:58:05.401024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 16:58:05.401024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:05.402025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 479/971] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 16:58:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:05.408093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05145fdc-e817-49e2-88e9-c0aae510f371 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:05.434736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b04d90-cc1b-492c-beb2-c28b2c163586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:05.435400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b04d90-cc1b-492c-beb2-c28b2c163586 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:05.435707 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b04d90-cc1b-492c-beb2-c28b2c163586 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:05.435983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b04d90-cc1b-492c-beb2-c28b2c163586 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:05.436732 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b04d90-cc1b-492c-beb2-c28b2c163586 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:05.437068 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b04d90-cc1b-492c-beb2-c28b2c163586 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:05.438680 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b04d90-cc1b-492c-beb2-c28b2c163586 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:05.449790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 493/972] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 16:58:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:05.450749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b04d90-cc1b-492c-beb2-c28b2c163586 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:05.514166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05145fdc-e817-49e2-88e9-c0aae510f371 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:05.548608 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b04d90-cc1b-492c-beb2-c28b2c163586 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:05.548930 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e5201-cd92-4d22-b6ff-a80858466490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:05.549431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e5201-cd92-4d22-b6ff-a80858466490 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:05.549708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e5201-cd92-4d22-b6ff-a80858466490 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:05.550032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e5201-cd92-4d22-b6ff-a80858466490 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:05.550882 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e5201-cd92-4d22-b6ff-a80858466490 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:05.551186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e5201-cd92-4d22-b6ff-a80858466490 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:05.552704 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e5201-cd92-4d22-b6ff-a80858466490 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:05.575219 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 480/973] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 17 16:58:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:05.580730 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e5201-cd92-4d22-b6ff-a80858466490 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:05.594553 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6483cd-174d-48e8-b6e8-08903243bf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:05.595218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6483cd-174d-48e8-b6e8-08903243bf43 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:05.595497 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6483cd-174d-48e8-b6e8-08903243bf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:05.595809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6483cd-174d-48e8-b6e8-08903243bf43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:05.596993 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6483cd-174d-48e8-b6e8-08903243bf43 None admin] RBAC: Adding query filter params (interface=admin, service_id=212df5165eb94154a008ba7e739bb711, region_id=RegionOne) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:05.597305 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6483cd-174d-48e8-b6e8-08903243bf43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:05.598996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6483cd-174d-48e8-b6e8-08903243bf43 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:05.609988 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 494/974] 10.222.0.48 () {56 vars in 1249 bytes} [Tue May 17 16:58:05 2022] GET /identity/v3/endpoints?service_id=212df5165eb94154a008ba7e739bb711&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:05.611043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6483cd-174d-48e8-b6e8-08903243bf43 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:05.688788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e5201-cd92-4d22-b6ff-a80858466490 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:05.723784 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b1c24-a769-4bfe-8943-40325e524906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:05.725109 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b1c24-a769-4bfe-8943-40325e524906 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:05.725534 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b1c24-a769-4bfe-8943-40325e524906 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:05.725977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b1c24-a769-4bfe-8943-40325e524906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:05.744952 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6483cd-174d-48e8-b6e8-08903243bf43 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:05.780038 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459c651-49d0-4409-80dd-ee7ff0123686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:05.780707 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459c651-49d0-4409-80dd-ee7ff0123686 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:05.780988 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459c651-49d0-4409-80dd-ee7ff0123686 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:05.781257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459c651-49d0-4409-80dd-ee7ff0123686 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:05.781924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459c651-49d0-4409-80dd-ee7ff0123686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:05.783270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459c651-49d0-4409-80dd-ee7ff0123686 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:05.791778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 495/975] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 16:58:05 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:58:05.791778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab6ce9-894f-464b-b8af-6dc5273a98e1 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:05.791778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab6ce9-894f-464b-b8af-6dc5273a98e1 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:05.791778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab6ce9-894f-464b-b8af-6dc5273a98e1 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:05.793370 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 496/976] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:05.796147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b1c24-a769-4bfe-8943-40325e524906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:05.797893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b1c24-a769-4bfe-8943-40325e524906 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:05.805259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400e3c1-7c33-4dba-879b-0a04f4ebaa57 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:05.807639 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400e3c1-7c33-4dba-879b-0a04f4ebaa57 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:05.807639 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400e3c1-7c33-4dba-879b-0a04f4ebaa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:05.824846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5400e3c1-7c33-4dba-879b-0a04f4ebaa57 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:05.826041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5400e3c1-7c33-4dba-879b-0a04f4ebaa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:05.915580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 497/977] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:05.924530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 481/978] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:58:05 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 16:58:05.932789 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400e3c1-7c33-4dba-879b-0a04f4ebaa57 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:05.940675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b1c24-a769-4bfe-8943-40325e524906 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:06.049910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400e3c1-7c33-4dba-879b-0a04f4ebaa57 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:06.060537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b1c24-a769-4bfe-8943-40325e524906 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:06.096907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e4970-3373-4049-bfdf-e070bc18179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:06.098147 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e4970-3373-4049-bfdf-e070bc18179e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:06.098561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e4970-3373-4049-bfdf-e070bc18179e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:06.098995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e4970-3373-4049-bfdf-e070bc18179e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:06.101602 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a393098-f39f-4b6c-b304-b294e8e19404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:06.103285 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a393098-f39f-4b6c-b304-b294e8e19404 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:06.103888 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a393098-f39f-4b6c-b304-b294e8e19404 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:06.104312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a393098-f39f-4b6c-b304-b294e8e19404 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:06.105183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a393098-f39f-4b6c-b304-b294e8e19404 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:06.107263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a393098-f39f-4b6c-b304-b294e8e19404 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:06.109341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: WARNING keystone.server.flask.common [None req-8a393098-f39f-4b6c-b304-b294e8e19404 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 17 16:58:06.110369 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e4970-3373-4049-bfdf-e070bc18179e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:06.112056 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e4970-3373-4049-bfdf-e070bc18179e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:06.124116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.sql.core [None req-8a393098-f39f-4b6c-b304-b294e8e19404 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 16:58:06.124116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 17 16:58:06.124116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [parameters: {'user_id': 'ef3c22832e2347808db304e81759481e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 17 16:58:06.124116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80069) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 16:58:06.132014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8a393098-f39f-4b6c-b304-b294e8e19404 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 17 16:58:06.132014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:06.132014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 16:58:06.132014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 16:58:06.132014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 16:58:06.132014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 16:58:06.132014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 16:58:06.132014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result = self._query(query) May 17 16:58:06.132014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 16:58:06.132014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application conn.query(q) May 17 16:58:06.132014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 16:58:06.132014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 16:58:06.132014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 16:58:06.132014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result.read() May 17 16:58:06.132014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 16:58:06.133001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application next(self.gen) May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application yield resource May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application next(self.gen) May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.session.rollback() May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.force_reraise() May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise self.value May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application session.commit() May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 16:58:06.134485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._prepare_impl() May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.session.flush() May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._flush(objects) May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application compat.raise_( May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application flush_context.execute() May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rec.execute(self) May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 16:58:06.135367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result = connection._execute_20( May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 16:58:06.136358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result = self._query(query) May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application conn.query(q) May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result.read() May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 16:58:06.137498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 16:58:06.138588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 16:58:06.138588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 16:58:06.138588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 16:58:06.138588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 16:58:06.138588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 16:58:06.138588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 17 16:58:06.138588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ef3c22832e2347808db304e81759481e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 17 16:58:06.138588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 16:58:06.138588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:06.138588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:58:06.138588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:06.138588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:06.138588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:06.138588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:06.138588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 17 16:58:06.139411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 17 16:58:06.140439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 17 16:58:06.140439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 17 16:58:06.140439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 16:58:06.140439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 16:58:06.140439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 17 16:58:06.140439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:06.140839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-5e4e4970-3373-4049-bfdf-e070bc18179e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:06.140839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:06.140839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:06.140839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:06.140839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:06.140839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:06.140839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:06.140839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:06.140839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:06.140839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:06.140839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:06.140839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:06.140839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:58:06.140839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:58:06.140839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:06.143982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:06.146113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:58:06.146113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:58:06.146113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:06.146113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:06.146113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 498/979] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:06.146113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e4970-3373-4049-bfdf-e070bc18179e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:06.148094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 482/980] 10.222.0.48 () {60 vars in 1131 bytes} [Tue May 17 16:58:05 2022] POST /identity/v3/users => generated 160 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:06.150350 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a393098-f39f-4b6c-b304-b294e8e19404 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:06.273530 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e4970-3373-4049-bfdf-e070bc18179e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:06.274249 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a393098-f39f-4b6c-b304-b294e8e19404 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:06.310429 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d552a-9af3-4be1-83a8-87a6e0548c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:06.311702 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d552a-9af3-4be1-83a8-87a6e0548c60 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:06.312206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d552a-9af3-4be1-83a8-87a6e0548c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:06.312994 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d552a-9af3-4be1-83a8-87a6e0548c60 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:06.316873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1a3b2-daab-4186-9ff2-1f25c900071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:06.317543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a3b2-daab-4186-9ff2-1f25c900071e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:06.317822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a3b2-daab-4186-9ff2-1f25c900071e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:06.318097 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a3b2-daab-4186-9ff2-1f25c900071e None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:06.318812 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1a3b2-daab-4186-9ff2-1f25c900071e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:06.319115 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1a3b2-daab-4186-9ff2-1f25c900071e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:06.320510 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1a3b2-daab-4186-9ff2-1f25c900071e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:06.323121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d552a-9af3-4be1-83a8-87a6e0548c60 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:06.324990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d552a-9af3-4be1-83a8-87a6e0548c60 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:06.339338 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 499/981] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:06.340286 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1a3b2-daab-4186-9ff2-1f25c900071e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-945d552a-9af3-4be1-83a8-87a6e0548c60 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:58:06.341561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:06.342481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:06.343431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:06.343431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:06.343431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:58:06.343431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:58:06.343431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:58:06.343431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:58:06.343431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:58:06.343431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:58:06.343431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 16:58:06.343431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:06.345799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 483/982] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:58:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:06.351739 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d552a-9af3-4be1-83a8-87a6e0548c60 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:06.454415 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1a3b2-daab-4186-9ff2-1f25c900071e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:06.456791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d552a-9af3-4be1-83a8-87a6e0548c60 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:06.486831 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b5c2e-7ec7-45a8-bdfb-a70c9f926413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:06.487687 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5c2e-7ec7-45a8-bdfb-a70c9f926413 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:06.487973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5c2e-7ec7-45a8-bdfb-a70c9f926413 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:06.488246 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5c2e-7ec7-45a8-bdfb-a70c9f926413 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:06.494306 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8576e-84ad-4ce6-a99e-1340a856b3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:06.494976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8576e-84ad-4ce6-a99e-1340a856b3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:06.495254 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8576e-84ad-4ce6-a99e-1340a856b3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:06.495421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b5c2e-7ec7-45a8-bdfb-a70c9f926413 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:06.495533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8576e-84ad-4ce6-a99e-1340a856b3d1 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:06.496343 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8576e-84ad-4ce6-a99e-1340a856b3d1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:06.496644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8576e-84ad-4ce6-a99e-1340a856b3d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:06.496876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b5c2e-7ec7-45a8-bdfb-a70c9f926413 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:06.498050 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8576e-84ad-4ce6-a99e-1340a856b3d1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:06.510909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-744b5c2e-7ec7-45a8-bdfb-a70c9f926413 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:58:06.510909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:06.510909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:06.510909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:06.510909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:06.510909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:06.510909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:06.510909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:06.510909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:06.510909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:06.510909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:06.510909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:06.510909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:58:06.510909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:58:06.510909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:06.511830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:06.517799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:58:06.517799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:58:06.517799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:58:06.517799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:58:06.517799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:58:06.517799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:58:06.517799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:58:06.517799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:06.517799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 500/983] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:58:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:06.517799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86498782-b7ba-4416-bfb5-240f8c6368ef None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:06.517799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86498782-b7ba-4416-bfb5-240f8c6368ef None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:06.518533 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86498782-b7ba-4416-bfb5-240f8c6368ef None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:06.518533 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 501/984] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:06.520204 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86498782-b7ba-4416-bfb5-240f8c6368ef None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:06.543503 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 484/985] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 16:58:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:06.544882 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adf063-aa10-4992-af8e-f3360532c1c3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:06.545170 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adf063-aa10-4992-af8e-f3360532c1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:06.545439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adf063-aa10-4992-af8e-f3360532c1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:06.574035 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f0adf063-aa10-4992-af8e-f3360532c1c3 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:06.576021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f0adf063-aa10-4992-af8e-f3360532c1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:06.644464 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86498782-b7ba-4416-bfb5-240f8c6368ef None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:06.665564 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 485/986] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:06.684235 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a9419-af8b-421c-a623-63a430eef278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:06.685364 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a9419-af8b-421c-a623-63a430eef278 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:06.685854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a9419-af8b-421c-a623-63a430eef278 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:06.686322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a9419-af8b-421c-a623-63a430eef278 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:06.688546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adf063-aa10-4992-af8e-f3360532c1c3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:06.690689 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a9419-af8b-421c-a623-63a430eef278 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:06.692348 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a9419-af8b-421c-a623-63a430eef278 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:06.696368 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a9419-af8b-421c-a623-63a430eef278 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:06.714433 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 502/987] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:58:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:06.721092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a9419-af8b-421c-a623-63a430eef278 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:06.803421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adf063-aa10-4992-af8e-f3360532c1c3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:06.833422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a9419-af8b-421c-a623-63a430eef278 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:06.843487 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05713da1-1cc2-4e77-a19d-7010a2ce32a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:06.844182 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05713da1-1cc2-4e77-a19d-7010a2ce32a7 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:06.844462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05713da1-1cc2-4e77-a19d-7010a2ce32a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:06.844734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05713da1-1cc2-4e77-a19d-7010a2ce32a7 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:06.845455 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05713da1-1cc2-4e77-a19d-7010a2ce32a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:06.846829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05713da1-1cc2-4e77-a19d-7010a2ce32a7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:06.862444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 486/988] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 16:58:06 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:58:06.877502 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3cdf8-908a-4096-8797-489863ea3ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:06.878175 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3cdf8-908a-4096-8797-489863ea3ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:06.878452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3cdf8-908a-4096-8797-489863ea3ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:06.878723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3cdf8-908a-4096-8797-489863ea3ad2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:06.879564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3cdf8-908a-4096-8797-489863ea3ad2 None admin] RBAC: Adding query filter params (role.id=a21fc21c2d6c4f2d9ac51e7ae4e71e6a, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=c0b16bc0880a4e12879ebb512ebb848b) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:06.879926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3cdf8-908a-4096-8797-489863ea3ad2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:06.881434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3cdf8-908a-4096-8797-489863ea3ad2 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:06.888962 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 503/989] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:58:06 2022] GET /identity/v3/role_assignments?user.id=c0b16bc0880a4e12879ebb512ebb848b&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=a21fc21c2d6c4f2d9ac51e7ae4e71e6a => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:08.127873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d701f3-a05e-4740-91a1-4ec17d02b2e6 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:08.128384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d701f3-a05e-4740-91a1-4ec17d02b2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:08.128494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d701f3-a05e-4740-91a1-4ec17d02b2e6 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:08.131661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 487/990] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:08.137260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6642d-40a0-4eca-ae7f-461f5cfd7e74 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:08.137721 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6642d-40a0-4eca-ae7f-461f5cfd7e74 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:08.137987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6642d-40a0-4eca-ae7f-461f5cfd7e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:08.155954 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-40a6642d-40a0-4eca-ae7f-461f5cfd7e74 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:08.157166 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-40a6642d-40a0-4eca-ae7f-461f5cfd7e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:08.231640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 504/991] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:08.257885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d701f3-a05e-4740-91a1-4ec17d02b2e6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:08.370093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d701f3-a05e-4740-91a1-4ec17d02b2e6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:08.403624 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5bac-bafe-477b-b948-0ac413d011ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:08.404539 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5bac-bafe-477b-b948-0ac413d011ac None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:08.404812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5bac-bafe-477b-b948-0ac413d011ac None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:08.405078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5bac-bafe-477b-b948-0ac413d011ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:08.405745 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee5bac-bafe-477b-b948-0ac413d011ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:08.407075 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee5bac-bafe-477b-b948-0ac413d011ac None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5cee5bac-bafe-477b-b948-0ac413d011ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:08.420308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:08.421425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:08.422293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:08.422293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:08.422293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:08.422293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:08.422293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:08.422293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:08.422293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:08.422293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:08.422293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:08.422293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:08.422293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:58:08.422293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:08.422293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 16:58:08.422293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:08.423721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 488/992] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 16:58:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:08.428002 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6642d-40a0-4eca-ae7f-461f5cfd7e74 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:08.528289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6642d-40a0-4eca-ae7f-461f5cfd7e74 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:08.566056 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a776d-6b9a-4ba1-8230-cb7310098fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:08.566724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a776d-6b9a-4ba1-8230-cb7310098fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:08.567072 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a776d-6b9a-4ba1-8230-cb7310098fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:08.567346 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a776d-6b9a-4ba1-8230-cb7310098fd3 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:08.568078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a776d-6b9a-4ba1-8230-cb7310098fd3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:08.568379 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a776d-6b9a-4ba1-8230-cb7310098fd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:08.569726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a776d-6b9a-4ba1-8230-cb7310098fd3 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:08.579365 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 505/993] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 16:58:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:08.580741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5bac-bafe-477b-b948-0ac413d011ac None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:08.689108 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5bac-bafe-477b-b948-0ac413d011ac None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:08.723239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17c95b-5d1b-4324-9fcb-3d0d4a6b24e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:08.724017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17c95b-5d1b-4324-9fcb-3d0d4a6b24e1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:08.724303 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17c95b-5d1b-4324-9fcb-3d0d4a6b24e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:08.724576 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17c95b-5d1b-4324-9fcb-3d0d4a6b24e1 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:08.725289 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17c95b-5d1b-4324-9fcb-3d0d4a6b24e1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:08.725594 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17c95b-5d1b-4324-9fcb-3d0d4a6b24e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:08.726972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17c95b-5d1b-4324-9fcb-3d0d4a6b24e1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:08.739653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 489/994] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 16:58:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:08.739871 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a776d-6b9a-4ba1-8230-cb7310098fd3 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:08.841881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a776d-6b9a-4ba1-8230-cb7310098fd3 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:08.877327 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1ca82-f6de-44b5-bfa0-03473113e032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:08.878276 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1ca82-f6de-44b5-bfa0-03473113e032 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:08.878562 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1ca82-f6de-44b5-bfa0-03473113e032 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:08.878940 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1ca82-f6de-44b5-bfa0-03473113e032 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:08.879571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1ca82-f6de-44b5-bfa0-03473113e032 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:08.880963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1ca82-f6de-44b5-bfa0-03473113e032 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:08.898745 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 506/995] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 16:58:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:58:09.261555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d5088-ea7c-431b-92d6-6075165290d6 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:09.262074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d5088-ea7c-431b-92d6-6075165290d6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:09.262154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d5088-ea7c-431b-92d6-6075165290d6 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:09.263488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 490/996] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:09.269036 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd65c6-a4c9-4a01-88db-9025793bdfbd None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:09.269528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd65c6-a4c9-4a01-88db-9025793bdfbd None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:09.269609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd65c6-a4c9-4a01-88db-9025793bdfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:09.286478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2ccd65c6-a4c9-4a01-88db-9025793bdfbd None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:09.287773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2ccd65c6-a4c9-4a01-88db-9025793bdfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:09.313233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93164db5-3cc0-4e5e-bd03-881d0268d508 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:09.313561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93164db5-3cc0-4e5e-bd03-881d0268d508 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:09.313793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93164db5-3cc0-4e5e-bd03-881d0268d508 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:09.315293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 491/997] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:58:09.320474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c010a3-ebd3-478b-a12c-222deb1f3859 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:09.320989 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c010a3-ebd3-478b-a12c-222deb1f3859 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:09.322143 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c010a3-ebd3-478b-a12c-222deb1f3859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:09.341006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e9c010a3-ebd3-478b-a12c-222deb1f3859 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:09.342496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e9c010a3-ebd3-478b-a12c-222deb1f3859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:09.360883 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 507/998] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:09.382809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd65c6-a4c9-4a01-88db-9025793bdfbd None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:09.408807 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 492/999] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:58:09.430192 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c010a3-ebd3-478b-a12c-222deb1f3859 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:09.489767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd65c6-a4c9-4a01-88db-9025793bdfbd None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:09.529775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c010a3-ebd3-478b-a12c-222deb1f3859 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:09.532964 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10bb67-af9e-4e37-b8c4-bfb5a21ac6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:09.534038 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10bb67-af9e-4e37-b8c4-bfb5a21ac6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:09.534539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10bb67-af9e-4e37-b8c4-bfb5a21ac6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:09.535022 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10bb67-af9e-4e37-b8c4-bfb5a21ac6a7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:09.535952 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10bb67-af9e-4e37-b8c4-bfb5a21ac6a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:09.537952 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10bb67-af9e-4e37-b8c4-bfb5a21ac6a7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-2f10bb67-af9e-4e37-b8c4-bfb5a21ac6a7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:09.549986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:09.551006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:09.551974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:09.551974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:09.551974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:09.551974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:09.551974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:09.551974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:09.551974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:09.551974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:09.551974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:09.551974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:09.551974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:58:09.551974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:09.551974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 16:58:09.551974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:09.551974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 508/1000] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:58:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:09.557503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10bb67-af9e-4e37-b8c4-bfb5a21ac6a7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:09.566347 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aad7ae-235f-4712-8647-c96a2627f373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:09.567005 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aad7ae-235f-4712-8647-c96a2627f373 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:09.567334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aad7ae-235f-4712-8647-c96a2627f373 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:09.567620 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aad7ae-235f-4712-8647-c96a2627f373 None admin] PATH_INFO: `/v3/services/image` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:09.568315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aad7ae-235f-4712-8647-c96a2627f373 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:09.569669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aad7ae-235f-4712-8647-c96a2627f373 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-34aad7ae-235f-4712-8647-c96a2627f373 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:09.581634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:09.582629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:09.583460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:09.583460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:09.583460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:09.583460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:09.583460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:09.583460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:09.583460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:09.583460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:09.583460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:09.583460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:09.583460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:58:09.583460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:09.583460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 16:58:09.583460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:09.583460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 493/1001] 10.222.0.48 () {56 vars in 1105 bytes} [Tue May 17 16:58:09 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:09.588782 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aad7ae-235f-4712-8647-c96a2627f373 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:09.656681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10bb67-af9e-4e37-b8c4-bfb5a21ac6a7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:09.686600 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aad7ae-235f-4712-8647-c96a2627f373 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:09.689718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93fbcc-d168-484b-a272-5a03ad3fa3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:09.690383 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93fbcc-d168-484b-a272-5a03ad3fa3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:09.690664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93fbcc-d168-484b-a272-5a03ad3fa3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:09.690940 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93fbcc-d168-484b-a272-5a03ad3fa3e9 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:09.691671 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93fbcc-d168-484b-a272-5a03ad3fa3e9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:09.691980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93fbcc-d168-484b-a272-5a03ad3fa3e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:09.693342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93fbcc-d168-484b-a272-5a03ad3fa3e9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:09.703428 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 509/1002] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 16:58:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:09.704744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93fbcc-d168-484b-a272-5a03ad3fa3e9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:09.719557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d94774-2fe5-4b36-b28a-52bd9cdd934a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:09.720292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d94774-2fe5-4b36-b28a-52bd9cdd934a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:09.720575 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d94774-2fe5-4b36-b28a-52bd9cdd934a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:09.720849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d94774-2fe5-4b36-b28a-52bd9cdd934a None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:09.721543 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d94774-2fe5-4b36-b28a-52bd9cdd934a None admin] RBAC: Adding query filter params (name=image) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:09.721844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d94774-2fe5-4b36-b28a-52bd9cdd934a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:09.723200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d94774-2fe5-4b36-b28a-52bd9cdd934a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:09.732588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 494/1003] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:09.733883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d94774-2fe5-4b36-b28a-52bd9cdd934a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:09.810652 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93fbcc-d168-484b-a272-5a03ad3fa3e9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:09.835521 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d94774-2fe5-4b36-b28a-52bd9cdd934a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:09.842564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77b792-1020-4702-adb7-f59b543082ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:09.843219 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77b792-1020-4702-adb7-f59b543082ee None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:09.843497 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77b792-1020-4702-adb7-f59b543082ee None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:09.843795 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77b792-1020-4702-adb7-f59b543082ee None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:09.844487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77b792-1020-4702-adb7-f59b543082ee None admin] RBAC: Adding query filter params (type=compute) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:09.844784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77b792-1020-4702-adb7-f59b543082ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:09.846140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77b792-1020-4702-adb7-f59b543082ee None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:09.850737 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 510/1004] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 16:58:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:09.857049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77b792-1020-4702-adb7-f59b543082ee None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:09.871121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10730d3-bf60-420a-95c9-19f454b29c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:09.871810 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10730d3-bf60-420a-95c9-19f454b29c93 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:09.872090 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10730d3-bf60-420a-95c9-19f454b29c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:09.872362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10730d3-bf60-420a-95c9-19f454b29c93 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:09.873056 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10730d3-bf60-420a-95c9-19f454b29c93 None admin] RBAC: Adding query filter params (type=image) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:09.873353 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10730d3-bf60-420a-95c9-19f454b29c93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:09.874697 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10730d3-bf60-420a-95c9-19f454b29c93 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:09.879249 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 495/1005] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:09.972990 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77b792-1020-4702-adb7-f59b543082ee None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:10.007068 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4950d-7a4d-471d-baae-fa9f39f8da58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:10.007795 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4950d-7a4d-471d-baae-fa9f39f8da58 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:10.008082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4950d-7a4d-471d-baae-fa9f39f8da58 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:10.008360 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4950d-7a4d-471d-baae-fa9f39f8da58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:10.009778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4950d-7a4d-471d-baae-fa9f39f8da58 None admin] RBAC: Adding query filter params (interface=public, service_id=1e1d5a67111d4d21a2369c109689c516, region_id=RegionOne) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:10.010096 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4950d-7a4d-471d-baae-fa9f39f8da58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:10.011480 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4950d-7a4d-471d-baae-fa9f39f8da58 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:10.022098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 511/1006] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 16:58:09 2022] GET /identity/v3/endpoints?service_id=1e1d5a67111d4d21a2369c109689c516&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:10.022957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10730d3-bf60-420a-95c9-19f454b29c93 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:10.134359 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10730d3-bf60-420a-95c9-19f454b29c93 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:10.167386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda734f3-44e9-44ba-8581-4d5ec9c17fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:10.168084 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda734f3-44e9-44ba-8581-4d5ec9c17fbd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:10.168366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda734f3-44e9-44ba-8581-4d5ec9c17fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:10.168639 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda734f3-44e9-44ba-8581-4d5ec9c17fbd None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:10.169320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda734f3-44e9-44ba-8581-4d5ec9c17fbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:10.170682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda734f3-44e9-44ba-8581-4d5ec9c17fbd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:10.177133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 496/1007] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 16:58:10 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 16:58:11.152400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de051a-1412-4522-ae60-1c1b8937e4a6 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:11.152914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de051a-1412-4522-ae60-1c1b8937e4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:11.152991 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de051a-1412-4522-ae60-1c1b8937e4a6 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:11.154333 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 512/1008] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:11.159778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151fd24-6cfc-49ee-8898-1f3f938f5b65 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:11.160202 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151fd24-6cfc-49ee-8898-1f3f938f5b65 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:11.160430 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151fd24-6cfc-49ee-8898-1f3f938f5b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:11.177122 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6151fd24-6cfc-49ee-8898-1f3f938f5b65 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:11.178272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6151fd24-6cfc-49ee-8898-1f3f938f5b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:11.240813 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 497/1009] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:11.266159 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de051a-1412-4522-ae60-1c1b8937e4a6 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:11.364164 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de051a-1412-4522-ae60-1c1b8937e4a6 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:11.396423 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149ae6e-5ed0-43fa-9881-0cd2d0897cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:11.397545 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149ae6e-5ed0-43fa-9881-0cd2d0897cee None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:11.398065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149ae6e-5ed0-43fa-9881-0cd2d0897cee None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:11.398539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149ae6e-5ed0-43fa-9881-0cd2d0897cee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:11.400681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149ae6e-5ed0-43fa-9881-0cd2d0897cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:11.402303 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149ae6e-5ed0-43fa-9881-0cd2d0897cee None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:11.404474 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 513/1010] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:11.409872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151fd24-6cfc-49ee-8898-1f3f938f5b65 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:11.505005 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151fd24-6cfc-49ee-8898-1f3f938f5b65 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:11.538990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7441c4b-69f0-40ff-ac9c-3051d0e7e0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:11.539681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7441c4b-69f0-40ff-ac9c-3051d0e7e0f7 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:11.540015 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7441c4b-69f0-40ff-ac9c-3051d0e7e0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:11.540371 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7441c4b-69f0-40ff-ac9c-3051d0e7e0f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:11.541259 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7441c4b-69f0-40ff-ac9c-3051d0e7e0f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:11.542700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7441c4b-69f0-40ff-ac9c-3051d0e7e0f7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:11.575645 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 498/1011] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 16:58:11 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:58:12.132788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434f1e3-2d42-4527-820d-771e04748d77 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:12.133107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434f1e3-2d42-4527-820d-771e04748d77 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:12.133344 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434f1e3-2d42-4527-820d-771e04748d77 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:12.135531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 514/1012] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:12.140711 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5feddd-847c-4484-b616-08a95338ef99 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:12.141004 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5feddd-847c-4484-b616-08a95338ef99 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:12.141281 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5feddd-847c-4484-b616-08a95338ef99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:12.158969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bb5feddd-847c-4484-b616-08a95338ef99 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:12.160178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bb5feddd-847c-4484-b616-08a95338ef99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:12.223723 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 499/1013] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:58:12.246309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434f1e3-2d42-4527-820d-771e04748d77 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:12.346675 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434f1e3-2d42-4527-820d-771e04748d77 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:12.378902 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab87aa-3cc9-4b26-9acb-237d810b0d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:12.379564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab87aa-3cc9-4b26-9acb-237d810b0d25 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:12.379871 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab87aa-3cc9-4b26-9acb-237d810b0d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:12.380152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab87aa-3cc9-4b26-9acb-237d810b0d25 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:12.380877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab87aa-3cc9-4b26-9acb-237d810b0d25 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:12.382230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab87aa-3cc9-4b26-9acb-237d810b0d25 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:12.397929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 515/1014] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 16:58:12 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:58:12.434964 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce669a44-ed76-4822-b0bc-550d5a9ce814 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:12.435311 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce669a44-ed76-4822-b0bc-550d5a9ce814 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:12.435529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce669a44-ed76-4822-b0bc-550d5a9ce814 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:12.437128 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 500/1015] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:12.443538 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fe8eb-1767-49e2-8397-90398186740f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:12.443905 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fe8eb-1767-49e2-8397-90398186740f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:12.444249 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fe8eb-1767-49e2-8397-90398186740f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:12.462814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7e8fe8eb-1767-49e2-8397-90398186740f None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:12.464065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7e8fe8eb-1767-49e2-8397-90398186740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:12.539417 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 516/1016] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:12 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:12.563371 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce669a44-ed76-4822-b0bc-550d5a9ce814 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:12.666328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce669a44-ed76-4822-b0bc-550d5a9ce814 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:12.700412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08f749-ebdc-4379-920e-8486425de5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:12.701210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f749-ebdc-4379-920e-8486425de5ba None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:12.701486 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f749-ebdc-4379-920e-8486425de5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:12.701755 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f749-ebdc-4379-920e-8486425de5ba None admin] PATH_INFO: `/v3/services/compute` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:12.702400 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08f749-ebdc-4379-920e-8486425de5ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:12.703843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08f749-ebdc-4379-920e-8486425de5ba None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5f08f749-ebdc-4379-920e-8486425de5ba None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:12.716262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:12.717313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:12.718153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:12.718153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:12.718153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:12.718153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:12.718153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:12.718153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:12.718153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:12.718153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:12.718153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:12.718153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:12.718153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:58:12.718153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:12.718153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 16:58:12.718153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:12.719489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 501/1017] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:58:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:12.723881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fe8eb-1767-49e2-8397-90398186740f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:12.820553 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fe8eb-1767-49e2-8397-90398186740f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:12.854048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9edc6-1c69-4dbc-bae4-11da2023523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:12.854707 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9edc6-1c69-4dbc-bae4-11da2023523c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:12.854988 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9edc6-1c69-4dbc-bae4-11da2023523c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:12.855260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9edc6-1c69-4dbc-bae4-11da2023523c None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:12.855983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9edc6-1c69-4dbc-bae4-11da2023523c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:12.856287 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9edc6-1c69-4dbc-bae4-11da2023523c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:12.857652 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9edc6-1c69-4dbc-bae4-11da2023523c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:12.866863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 517/1018] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 16:58:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:12.868699 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08f749-ebdc-4379-920e-8486425de5ba None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:12.965209 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08f749-ebdc-4379-920e-8486425de5ba None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:12.998205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862034cd-9069-4cfb-89ec-b2c0d4e736d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:12.999012 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862034cd-9069-4cfb-89ec-b2c0d4e736d3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:12.999150 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862034cd-9069-4cfb-89ec-b2c0d4e736d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:12.999423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862034cd-9069-4cfb-89ec-b2c0d4e736d3 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:13.000162 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862034cd-9069-4cfb-89ec-b2c0d4e736d3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:13.000466 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862034cd-9069-4cfb-89ec-b2c0d4e736d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:13.001836 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862034cd-9069-4cfb-89ec-b2c0d4e736d3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:13.011705 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 502/1019] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 16:58:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:13.013229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9edc6-1c69-4dbc-bae4-11da2023523c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:13.107178 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9edc6-1c69-4dbc-bae4-11da2023523c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:13.140758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb3ee9-48a8-4c67-b5ab-3341c654dca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:13.141417 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb3ee9-48a8-4c67-b5ab-3341c654dca6 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:13.141696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb3ee9-48a8-4c67-b5ab-3341c654dca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:13.141967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb3ee9-48a8-4c67-b5ab-3341c654dca6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:13.142705 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb3ee9-48a8-4c67-b5ab-3341c654dca6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:13.144093 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb3ee9-48a8-4c67-b5ab-3341c654dca6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:13.168354 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 518/1020] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 16:58:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:58:13.854610 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957e869-128b-4ddd-8464-984a1217585d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:13.855155 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957e869-128b-4ddd-8464-984a1217585d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:13.855155 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957e869-128b-4ddd-8464-984a1217585d None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:13.856582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 503/1021] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:13.861685 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2940a-ad37-45d8-9b3d-65acb65fcca9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:13.862063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2940a-ad37-45d8-9b3d-65acb65fcca9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:13.862229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2940a-ad37-45d8-9b3d-65acb65fcca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:13.879198 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0da2940a-ad37-45d8-9b3d-65acb65fcca9 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:13.880404 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0da2940a-ad37-45d8-9b3d-65acb65fcca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:13.948897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 519/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:13.972913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957e869-128b-4ddd-8464-984a1217585d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:14.069451 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957e869-128b-4ddd-8464-984a1217585d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:14.104913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729a061-416e-4f7e-86aa-e07733979e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:14.105966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729a061-416e-4f7e-86aa-e07733979e12 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:14.106421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729a061-416e-4f7e-86aa-e07733979e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:14.106867 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729a061-416e-4f7e-86aa-e07733979e12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:14.108215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729a061-416e-4f7e-86aa-e07733979e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:14.109814 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729a061-416e-4f7e-86aa-e07733979e12 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:14.116084 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 504/1023] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:14.117509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2940a-ad37-45d8-9b3d-65acb65fcca9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:14.213133 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2940a-ad37-45d8-9b3d-65acb65fcca9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:14.246574 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb59f8-f625-439d-bcbf-bca9453d6574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:14.247246 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb59f8-f625-439d-bcbf-bca9453d6574 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:14.247528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb59f8-f625-439d-bcbf-bca9453d6574 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:14.247827 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb59f8-f625-439d-bcbf-bca9453d6574 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:14.248544 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb59f8-f625-439d-bcbf-bca9453d6574 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:14.249968 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb59f8-f625-439d-bcbf-bca9453d6574 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:14.275893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 520/1024] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:58:14 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:58:14.659125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813e02f-1e6e-4bfb-8281-3c8d1ab0012b None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:14.659511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813e02f-1e6e-4bfb-8281-3c8d1ab0012b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:14.659717 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813e02f-1e6e-4bfb-8281-3c8d1ab0012b None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:14.661238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 505/1025] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:14.666274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6e4dc-3e8f-4593-bbdb-7513aaf6c8c9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:14.666566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6e4dc-3e8f-4593-bbdb-7513aaf6c8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:14.666843 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6e4dc-3e8f-4593-bbdb-7513aaf6c8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:14.683536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7ed6e4dc-3e8f-4593-bbdb-7513aaf6c8c9 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:14.684730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7ed6e4dc-3e8f-4593-bbdb-7513aaf6c8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:14.747551 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 521/1026] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:14.769990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813e02f-1e6e-4bfb-8281-3c8d1ab0012b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:14.869725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813e02f-1e6e-4bfb-8281-3c8d1ab0012b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:14.902227 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07886f41-fbcf-4a81-9f54-14e8176096cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:14.903022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07886f41-fbcf-4a81-9f54-14e8176096cb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:14.903304 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07886f41-fbcf-4a81-9f54-14e8176096cb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:14.903577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07886f41-fbcf-4a81-9f54-14e8176096cb None admin] PATH_INFO: `/v3/services/image` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:14.904248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07886f41-fbcf-4a81-9f54-14e8176096cb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:14.905609 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07886f41-fbcf-4a81-9f54-14e8176096cb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-07886f41-fbcf-4a81-9f54-14e8176096cb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:14.916985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:14.917985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:14.918811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:14.918811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:14.918811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:14.918811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:14.918811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:14.918811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:14.918811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:14.918811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:14.918811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:14.918811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:14.918811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:58:14.918811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:14.918811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 16:58:14.918811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:14.923044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 506/1027] 10.222.0.48 () {56 vars in 1105 bytes} [Tue May 17 16:58:14 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:14.924053 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6e4dc-3e8f-4593-bbdb-7513aaf6c8c9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:15.018936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6e4dc-3e8f-4593-bbdb-7513aaf6c8c9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:15.052018 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2f70e-2855-47cf-ab19-8094566bdd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:15.052681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2f70e-2855-47cf-ab19-8094566bdd49 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:15.052959 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2f70e-2855-47cf-ab19-8094566bdd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:15.053230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2f70e-2855-47cf-ab19-8094566bdd49 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:15.053921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2f70e-2855-47cf-ab19-8094566bdd49 None admin] RBAC: Adding query filter params (name=image) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:15.054223 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2f70e-2855-47cf-ab19-8094566bdd49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:15.055593 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2f70e-2855-47cf-ab19-8094566bdd49 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:15.065581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 522/1028] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:15.066527 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07886f41-fbcf-4a81-9f54-14e8176096cb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:15.170394 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07886f41-fbcf-4a81-9f54-14e8176096cb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:15.202524 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab54c0d-f571-4495-ba81-ab2a4a65a50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:15.203187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab54c0d-f571-4495-ba81-ab2a4a65a50a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:15.203466 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab54c0d-f571-4495-ba81-ab2a4a65a50a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:15.203768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab54c0d-f571-4495-ba81-ab2a4a65a50a None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:15.204468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab54c0d-f571-4495-ba81-ab2a4a65a50a None admin] RBAC: Adding query filter params (type=image) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:15.204817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab54c0d-f571-4495-ba81-ab2a4a65a50a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:15.206177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab54c0d-f571-4495-ba81-ab2a4a65a50a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:15.211007 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 507/1029] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:15.216622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2f70e-2855-47cf-ab19-8094566bdd49 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:15.315761 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2f70e-2855-47cf-ab19-8094566bdd49 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:15.350827 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd92c0d-a530-4d62-8f74-df0dceab4267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:15.351485 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd92c0d-a530-4d62-8f74-df0dceab4267 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:15.351794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd92c0d-a530-4d62-8f74-df0dceab4267 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:15.352068 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd92c0d-a530-4d62-8f74-df0dceab4267 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:15.352966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd92c0d-a530-4d62-8f74-df0dceab4267 None admin] RBAC: Adding query filter params (interface=public, service_id=80aadacc8d784341bf2334cb2954cc31, region_id=RegionOne) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:15.353334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd92c0d-a530-4d62-8f74-df0dceab4267 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:15.354724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd92c0d-a530-4d62-8f74-df0dceab4267 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:15.359824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 523/1030] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 16:58:15 2022] GET /identity/v3/endpoints?service_id=80aadacc8d784341bf2334cb2954cc31&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:15.365105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab54c0d-f571-4495-ba81-ab2a4a65a50a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:15.461236 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab54c0d-f571-4495-ba81-ab2a4a65a50a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:15.488879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3e8d9-0c5c-46b8-943c-3df0f80be4bf None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:15.489162 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3e8d9-0c5c-46b8-943c-3df0f80be4bf None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:15.489434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3e8d9-0c5c-46b8-943c-3df0f80be4bf None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:15.490985 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 524/1031] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:15.494990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9f967-49c5-40ba-8615-e77132be0742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:15.495679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9f967-49c5-40ba-8615-e77132be0742 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:15.495962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9f967-49c5-40ba-8615-e77132be0742 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:15.496237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9f967-49c5-40ba-8615-e77132be0742 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:15.496343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe827d65-b7d1-4028-82ed-b03e2b31c23d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:15.496519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe827d65-b7d1-4028-82ed-b03e2b31c23d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:15.496794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe827d65-b7d1-4028-82ed-b03e2b31c23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:15.496950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9f967-49c5-40ba-8615-e77132be0742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:15.498267 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9f967-49c5-40ba-8615-e77132be0742 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:15.511955 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 508/1032] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 16:58:15 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 16:58:15.514935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-fe827d65-b7d1-4028-82ed-b03e2b31c23d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:15.516059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-fe827d65-b7d1-4028-82ed-b03e2b31c23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:15.590280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 525/1033] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:15.614180 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9f967-49c5-40ba-8615-e77132be0742 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:15.716410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9f967-49c5-40ba-8615-e77132be0742 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:15.748993 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cf847-a01f-4de0-b57d-1d860ea6e579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:15.749800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cf847-a01f-4de0-b57d-1d860ea6e579 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:15.750079 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cf847-a01f-4de0-b57d-1d860ea6e579 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:15.750351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cf847-a01f-4de0-b57d-1d860ea6e579 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:15.760757 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cf847-a01f-4de0-b57d-1d860ea6e579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-787cf847-a01f-4de0-b57d-1d860ea6e579 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:58:15.768714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:15.769632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:15.770470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:15.770470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:15.770470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:15.770470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:15.770470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:58:15.770470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:58:15.770470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:58:15.770470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:58:15.770470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:58:15.770470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:58:15.770470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 16:58:15.770470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:15.770470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 509/1034] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 17 16:58:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:15.776128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe827d65-b7d1-4028-82ed-b03e2b31c23d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:15.869691 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe827d65-b7d1-4028-82ed-b03e2b31c23d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:15.901159 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab76718-8d88-47b1-81ff-332a25f7d3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:15.901822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab76718-8d88-47b1-81ff-332a25f7d3da None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:15.902100 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab76718-8d88-47b1-81ff-332a25f7d3da None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:15.902368 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab76718-8d88-47b1-81ff-332a25f7d3da None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:15.903094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab76718-8d88-47b1-81ff-332a25f7d3da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:15.903391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab76718-8d88-47b1-81ff-332a25f7d3da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:15.904792 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab76718-8d88-47b1-81ff-332a25f7d3da None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:15.917770 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 526/1035] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 17 16:58:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:15.918989 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cf847-a01f-4de0-b57d-1d860ea6e579 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:16.014528 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cf847-a01f-4de0-b57d-1d860ea6e579 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:16.046897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc006a62-3d98-451e-9ad3-5fcfa42205e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:16.047713 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc006a62-3d98-451e-9ad3-5fcfa42205e4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:16.047994 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc006a62-3d98-451e-9ad3-5fcfa42205e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:16.048263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc006a62-3d98-451e-9ad3-5fcfa42205e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:16.059275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc006a62-3d98-451e-9ad3-5fcfa42205e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:16.060757 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc006a62-3d98-451e-9ad3-5fcfa42205e4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:16.077657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-bc006a62-3d98-451e-9ad3-5fcfa42205e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:16.077657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:16.077657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:16.077657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:16.077657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:16.077657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:16.077657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:16.077657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:16.077657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:16.077657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:16.077657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:16.077657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:16.077657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:58:16.077657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:58:16.077657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:16.078558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:16.086159 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:58:16.086159 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:58:16.086159 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:16.086159 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:16.086159 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 510/1036] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:16.086524 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab76718-8d88-47b1-81ff-332a25f7d3da None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:16.186391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab76718-8d88-47b1-81ff-332a25f7d3da None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:16.218782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c09062-07ec-4937-af86-797f86e39b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:16.219775 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c09062-07ec-4937-af86-797f86e39b79 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:16.220240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c09062-07ec-4937-af86-797f86e39b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:16.220724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c09062-07ec-4937-af86-797f86e39b79 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:16.221663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c09062-07ec-4937-af86-797f86e39b79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:16.222145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c09062-07ec-4937-af86-797f86e39b79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:16.223717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c09062-07ec-4937-af86-797f86e39b79 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:16.236143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 527/1037] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:16.241570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc006a62-3d98-451e-9ad3-5fcfa42205e4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:16.345214 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc006a62-3d98-451e-9ad3-5fcfa42205e4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:16.377951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc382a6d-f8ff-4898-941b-cc4b3898a235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:16.378889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc382a6d-f8ff-4898-941b-cc4b3898a235 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:16.378999 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc382a6d-f8ff-4898-941b-cc4b3898a235 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:16.379279 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc382a6d-f8ff-4898-941b-cc4b3898a235 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:16.387761 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc382a6d-f8ff-4898-941b-cc4b3898a235 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:16.389341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc382a6d-f8ff-4898-941b-cc4b3898a235 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-fc382a6d-f8ff-4898-941b-cc4b3898a235 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:58:16.404823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:16.405885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:16.406841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:16.406841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:16.406841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:58:16.406841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:58:16.406841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:58:16.406841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:58:16.406841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:58:16.406841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:58:16.406841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 16:58:16.406841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:16.406841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 511/1038] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 16:58:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:16.413880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c09062-07ec-4937-af86-797f86e39b79 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:16.519398 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c09062-07ec-4937-af86-797f86e39b79 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:16.552819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dffcd5-2f07-4fb1-aa15-c0dfd7908a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:16.553550 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dffcd5-2f07-4fb1-aa15-c0dfd7908a6a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:16.553834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dffcd5-2f07-4fb1-aa15-c0dfd7908a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:16.554167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dffcd5-2f07-4fb1-aa15-c0dfd7908a6a None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:16.555000 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dffcd5-2f07-4fb1-aa15-c0dfd7908a6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:16.556074 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dffcd5-2f07-4fb1-aa15-c0dfd7908a6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:16.558045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dffcd5-2f07-4fb1-aa15-c0dfd7908a6a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:16.580099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 528/1039] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 16:58:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:16.581591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc382a6d-f8ff-4898-941b-cc4b3898a235 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:16.583159 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eeb2f-3d3e-4974-a4d6-b360f579053f None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:16.583453 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eeb2f-3d3e-4974-a4d6-b360f579053f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:16.583767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eeb2f-3d3e-4974-a4d6-b360f579053f None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:16.585194 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 529/1040] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:58:16.590576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696ddff-6e5b-4a3d-ba7a-014d2bc2ae92 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:16.590862 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696ddff-6e5b-4a3d-ba7a-014d2bc2ae92 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:16.591140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696ddff-6e5b-4a3d-ba7a-014d2bc2ae92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:16.607473 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4696ddff-6e5b-4a3d-ba7a-014d2bc2ae92 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:16.608604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4696ddff-6e5b-4a3d-ba7a-014d2bc2ae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:16.679289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 530/1041] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:58:16.686416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc382a6d-f8ff-4898-941b-cc4b3898a235 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:16.703122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696ddff-6e5b-4a3d-ba7a-014d2bc2ae92 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:16.723554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdc3b1-d263-477c-ac0c-33e2d5a87252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:16.724244 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdc3b1-d263-477c-ac0c-33e2d5a87252 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:16.724529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdc3b1-d263-477c-ac0c-33e2d5a87252 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:16.724812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdc3b1-d263-477c-ac0c-33e2d5a87252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:16.800128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696ddff-6e5b-4a3d-ba7a-014d2bc2ae92 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:16.808187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcdc3b1-d263-477c-ac0c-33e2d5a87252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:16.809653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcdc3b1-d263-477c-ac0c-33e2d5a87252 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:16.836073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c3287-37fb-4c7e-a5ce-cb98bec916a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:16.838233 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c3287-37fb-4c7e-a5ce-cb98bec916a4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:16.838519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c3287-37fb-4c7e-a5ce-cb98bec916a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:16.838952 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c3287-37fb-4c7e-a5ce-cb98bec916a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:16.851857 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c3287-37fb-4c7e-a5ce-cb98bec916a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-783c3287-37fb-4c7e-a5ce-cb98bec916a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:58:16.859580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:16.860622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:16.861499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:16.861499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:16.861499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:16.861499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:16.861499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:58:16.861499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:58:16.861499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:58:16.861499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:58:16.861499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:58:16.861499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:58:16.861499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:58:16.861499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:16.861499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 531/1042] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:58:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:16.866725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c3287-37fb-4c7e-a5ce-cb98bec916a4 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:16.914797 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 512/1043] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:58:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 16:58:16.916150 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdc3b1-d263-477c-ac0c-33e2d5a87252 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:16.964608 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c3287-37fb-4c7e-a5ce-cb98bec916a4 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:16.996700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e41e2-8b49-4138-8221-6cf55dad0d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:16.997352 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e41e2-8b49-4138-8221-6cf55dad0d41 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:16.997634 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e41e2-8b49-4138-8221-6cf55dad0d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:16.997903 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e41e2-8b49-4138-8221-6cf55dad0d41 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:16.998630 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e41e2-8b49-4138-8221-6cf55dad0d41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:16.998927 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e41e2-8b49-4138-8221-6cf55dad0d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:17.000310 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e41e2-8b49-4138-8221-6cf55dad0d41 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:17.008139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 532/1044] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:58:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:17.013524 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e41e2-8b49-4138-8221-6cf55dad0d41 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:17.015450 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdc3b1-d263-477c-ac0c-33e2d5a87252 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:17.049491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4a639-0ac3-4e87-97f1-36b054b1e025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:17.050280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4a639-0ac3-4e87-97f1-36b054b1e025 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:17.050559 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4a639-0ac3-4e87-97f1-36b054b1e025 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:17.050828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4a639-0ac3-4e87-97f1-36b054b1e025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:17.061353 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4a639-0ac3-4e87-97f1-36b054b1e025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:17.063068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4a639-0ac3-4e87-97f1-36b054b1e025 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:17.081176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-92c4a639-0ac3-4e87-97f1-36b054b1e025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:17.081176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:17.081176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:17.081176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:17.081176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:17.081176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:17.081176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:17.081176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:17.081176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:17.081176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:17.081176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:17.081176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:17.081176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:58:17.081176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:58:17.081176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:17.082147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:17.083138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:58:17.083138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:58:17.083138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:17.083138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:17.083138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 513/1045] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:17.089074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4a639-0ac3-4e87-97f1-36b054b1e025 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:17.117243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e41e2-8b49-4138-8221-6cf55dad0d41 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:17.152173 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2149f-acb7-442d-bae5-7e7e5fd0a709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:17.153051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2149f-acb7-442d-bae5-7e7e5fd0a709 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:17.153332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2149f-acb7-442d-bae5-7e7e5fd0a709 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:17.153604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2149f-acb7-442d-bae5-7e7e5fd0a709 None admin] PATH_INFO: `/v3/users/b4fc8d74ab594d31aa6c138c5d828694` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:17.167714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2149f-acb7-442d-bae5-7e7e5fd0a709 None admin] RBAC: Authorizing `identity:get_user(user_id=b4fc8d74ab594d31aa6c138c5d828694)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:17.169188 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2149f-acb7-442d-bae5-7e7e5fd0a709 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:17.171034 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 533/1046] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:58:17 2022] GET /identity/v3/users/b4fc8d74ab594d31aa6c138c5d828694 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:17.176540 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2149f-acb7-442d-bae5-7e7e5fd0a709 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:17.186648 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4a639-0ac3-4e87-97f1-36b054b1e025 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:17.221265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9de9-7420-4b70-99ee-1519c5a2a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:17.221926 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9de9-7420-4b70-99ee-1519c5a2a4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:17.222201 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9de9-7420-4b70-99ee-1519c5a2a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:17.222469 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9de9-7420-4b70-99ee-1519c5a2a4b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:17.223299 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c9de9-7420-4b70-99ee-1519c5a2a4b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:17.223615 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c9de9-7420-4b70-99ee-1519c5a2a4b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:17.225048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c9de9-7420-4b70-99ee-1519c5a2a4b4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:17.236857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 514/1047] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:17.242867 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9de9-7420-4b70-99ee-1519c5a2a4b4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:17.273348 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2149f-acb7-442d-bae5-7e7e5fd0a709 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:17.308270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947279f0-2a89-4365-9a19-eb63b7d9c3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:17.308919 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947279f0-2a89-4365-9a19-eb63b7d9c3df None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:17.309197 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947279f0-2a89-4365-9a19-eb63b7d9c3df None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:17.309473 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947279f0-2a89-4365-9a19-eb63b7d9c3df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:17.338741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9de9-7420-4b70-99ee-1519c5a2a4b4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:17.372988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8aefbd-59e9-4d9f-a428-5967b47a4825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:17.373689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8aefbd-59e9-4d9f-a428-5967b47a4825 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:17.373973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8aefbd-59e9-4d9f-a428-5967b47a4825 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:17.374242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8aefbd-59e9-4d9f-a428-5967b47a4825 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:17.375398 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947279f0-2a89-4365-9a19-eb63b7d9c3df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:17.376987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947279f0-2a89-4365-9a19-eb63b7d9c3df None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:17.380872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8aefbd-59e9-4d9f-a428-5967b47a4825 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:17.382305 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8aefbd-59e9-4d9f-a428-5967b47a4825 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:17.397316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-2e8aefbd-59e9-4d9f-a428-5967b47a4825 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:58:17.397316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:17.397316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:17.397316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:17.397316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:17.397316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:17.397316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:17.397316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:17.397316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:17.397316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:17.397316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:17.397316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:17.397316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:58:17.397316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:58:17.397316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:17.398390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:17.404842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:58:17.404842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:58:17.404842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:58:17.404842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:58:17.404842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:58:17.404842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:58:17.404842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:58:17.404842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:17.404842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 515/1048] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:58:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:17.405348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8aefbd-59e9-4d9f-a428-5967b47a4825 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:17.477856 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 534/1049] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:58:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 16:58:17.483654 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947279f0-2a89-4365-9a19-eb63b7d9c3df None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:17.506386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8aefbd-59e9-4d9f-a428-5967b47a4825 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:17.546148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653370a-8e30-4153-af36-6e8ec0d42b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:17.546872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653370a-8e30-4153-af36-6e8ec0d42b27 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:17.547242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653370a-8e30-4153-af36-6e8ec0d42b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:17.547518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653370a-8e30-4153-af36-6e8ec0d42b27 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:17.548332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653370a-8e30-4153-af36-6e8ec0d42b27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:17.548639 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653370a-8e30-4153-af36-6e8ec0d42b27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:17.550077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653370a-8e30-4153-af36-6e8ec0d42b27 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:17.564571 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 516/1050] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:58:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:17.571097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653370a-8e30-4153-af36-6e8ec0d42b27 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:17.585641 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947279f0-2a89-4365-9a19-eb63b7d9c3df None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:17.620749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ce7ac-8d18-469f-9af8-53dfba488018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:17.621605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ce7ac-8d18-469f-9af8-53dfba488018 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:17.621888 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ce7ac-8d18-469f-9af8-53dfba488018 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:17.622161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ce7ac-8d18-469f-9af8-53dfba488018 None admin] PATH_INFO: `/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:17.623399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ce7ac-8d18-469f-9af8-53dfba488018 None admin] RBAC: Authorizing `identity:get_project(project_id=9c882a32c3c54dea8092c86b4bfd2f0d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:17.624798 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ce7ac-8d18-469f-9af8-53dfba488018 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:17.631288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 535/1051] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:58:17 2022] GET /identity/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:17.632286 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ce7ac-8d18-469f-9af8-53dfba488018 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:17.677473 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653370a-8e30-4153-af36-6e8ec0d42b27 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:17.710085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcc7e1-0d40-4d62-8fbe-95b8bb96d3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:17.710743 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcc7e1-0d40-4d62-8fbe-95b8bb96d3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:17.711021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcc7e1-0d40-4d62-8fbe-95b8bb96d3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:17.712494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcc7e1-0d40-4d62-8fbe-95b8bb96d3a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:17.713356 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcc7e1-0d40-4d62-8fbe-95b8bb96d3a6 None admin] RBAC: Adding query filter params (role.id=a21fc21c2d6c4f2d9ac51e7ae4e71e6a, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=5becb135afbd43e9bc0b1347ba04e2b5) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:17.713670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcc7e1-0d40-4d62-8fbe-95b8bb96d3a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:17.715106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcc7e1-0d40-4d62-8fbe-95b8bb96d3a6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:17.731884 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 517/1052] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:58:17 2022] GET /identity/v3/role_assignments?user.id=5becb135afbd43e9bc0b1347ba04e2b5&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=a21fc21c2d6c4f2d9ac51e7ae4e71e6a => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:17.742717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ce7ac-8d18-469f-9af8-53dfba488018 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:17.758482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9cd6b-c03d-4522-957a-3c9f28d1f175 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:17.758876 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9cd6b-c03d-4522-957a-3c9f28d1f175 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:17.759284 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9cd6b-c03d-4522-957a-3c9f28d1f175 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:17.760742 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 518/1053] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 16:58:17.766453 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538bb8a-b677-43be-8683-f2bfa151f734 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:17.766742 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538bb8a-b677-43be-8683-f2bfa151f734 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:17.767021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538bb8a-b677-43be-8683-f2bfa151f734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:17.782345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c55712-4ca4-4cfc-b1b2-b79395d00cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:17.783386 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c55712-4ca4-4cfc-b1b2-b79395d00cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:17.783875 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c55712-4ca4-4cfc-b1b2-b79395d00cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:17.784342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c55712-4ca4-4cfc-b1b2-b79395d00cd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:17.784750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0538bb8a-b677-43be-8683-f2bfa151f734 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:17.785570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c55712-4ca4-4cfc-b1b2-b79395d00cd2 None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=9c882a32c3c54dea8092c86b4bfd2f0d, user.id=b4fc8d74ab594d31aa6c138c5d828694) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:17.785970 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0538bb8a-b677-43be-8683-f2bfa151f734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:17.786294 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c55712-4ca4-4cfc-b1b2-b79395d00cd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:17.788220 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c55712-4ca4-4cfc-b1b2-b79395d00cd2 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:17.796532 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 536/1054] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:58:17 2022] GET /identity/v3/role_assignments?user.id=b4fc8d74ab594d31aa6c138c5d828694&scope.project.id=9c882a32c3c54dea8092c86b4bfd2f0d&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:17.868814 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 519/1055] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:58:17.889053 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c55712-4ca4-4cfc-b1b2-b79395d00cd2 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:17.994097 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c55712-4ca4-4cfc-b1b2-b79395d00cd2 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:18.028283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7ddcd-dce0-471d-8915-1ca195027fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:18.029087 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7ddcd-dce0-471d-8915-1ca195027fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:18.029370 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7ddcd-dce0-471d-8915-1ca195027fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:18.029645 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7ddcd-dce0-471d-8915-1ca195027fc5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:18.030293 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7ddcd-dce0-471d-8915-1ca195027fc5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:18.031710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7ddcd-dce0-471d-8915-1ca195027fc5 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-a3c7ddcd-dce0-471d-8915-1ca195027fc5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:18.047304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:18.048554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:18.049396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:18.049396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:18.049396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:18.049396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:18.049396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:18.049396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:18.049396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:18.049396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:18.049396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:18.049396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:18.049396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 16:58:18.049396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 16:58:18.049396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 16:58:18.049396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:18.049396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 537/1056] 10.222.0.48 () {56 vars in 1105 bytes} [Tue May 17 16:58:17 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:18.057206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538bb8a-b677-43be-8683-f2bfa151f734 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:18.158598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538bb8a-b677-43be-8683-f2bfa151f734 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:18.192363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ff152-0c5e-4ea7-b7bb-589f236a4393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:18.193263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ff152-0c5e-4ea7-b7bb-589f236a4393 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:18.193708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ff152-0c5e-4ea7-b7bb-589f236a4393 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:18.194132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ff152-0c5e-4ea7-b7bb-589f236a4393 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:18.194988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ff152-0c5e-4ea7-b7bb-589f236a4393 None admin] RBAC: Adding query filter params (name=image) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:18.195434 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ff152-0c5e-4ea7-b7bb-589f236a4393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:18.197041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ff152-0c5e-4ea7-b7bb-589f236a4393 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:18.202412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 520/1057] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:18.207878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7ddcd-dce0-471d-8915-1ca195027fc5 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:18.306651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7ddcd-dce0-471d-8915-1ca195027fc5 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:18.339674 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7166f4-1e4e-4363-adaf-d13c23179a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:18.340336 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7166f4-1e4e-4363-adaf-d13c23179a73 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:18.340614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7166f4-1e4e-4363-adaf-d13c23179a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:18.340882 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7166f4-1e4e-4363-adaf-d13c23179a73 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:18.341574 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7166f4-1e4e-4363-adaf-d13c23179a73 None admin] RBAC: Adding query filter params (type=image) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:18.341871 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7166f4-1e4e-4363-adaf-d13c23179a73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:18.343298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7166f4-1e4e-4363-adaf-d13c23179a73 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:18.351817 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 538/1058] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:18.354761 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ff152-0c5e-4ea7-b7bb-589f236a4393 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:18.451488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ff152-0c5e-4ea7-b7bb-589f236a4393 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:18.484412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061889f-d2ca-4bdd-8f4e-37e9dc365556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:18.485067 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061889f-d2ca-4bdd-8f4e-37e9dc365556 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:18.485345 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061889f-d2ca-4bdd-8f4e-37e9dc365556 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:18.485617 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061889f-d2ca-4bdd-8f4e-37e9dc365556 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:18.486351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061889f-d2ca-4bdd-8f4e-37e9dc365556 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:18.487734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061889f-d2ca-4bdd-8f4e-37e9dc365556 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:18.511643 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 521/1059] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 16:58:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 16:58:19.950341 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf17b2-f43a-4785-8b37-7f052148cfc4 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:19.950896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf17b2-f43a-4785-8b37-7f052148cfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:19.950896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf17b2-f43a-4785-8b37-7f052148cfc4 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:19.952305 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 539/1060] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:19.957302 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747e4e7-ff68-47dc-937f-f39966a7357d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:19.957696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747e4e7-ff68-47dc-937f-f39966a7357d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:19.957853 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747e4e7-ff68-47dc-937f-f39966a7357d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:19.973916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6747e4e7-ff68-47dc-937f-f39966a7357d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:19.975062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6747e4e7-ff68-47dc-937f-f39966a7357d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:20.020956 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99896a2b-a0da-4813-b422-f77d6e28b646 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:20.021291 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99896a2b-a0da-4813-b422-f77d6e28b646 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:20.021500 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99896a2b-a0da-4813-b422-f77d6e28b646 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:20.022858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 540/1061] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:20.027934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da41dc0-858c-49b8-906a-0c010bb68adb None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:20.028223 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da41dc0-858c-49b8-906a-0c010bb68adb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:20.028508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da41dc0-858c-49b8-906a-0c010bb68adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:20.044648 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 522/1062] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:20.045007 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1da41dc0-858c-49b8-906a-0c010bb68adb None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:20.046182 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1da41dc0-858c-49b8-906a-0c010bb68adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:20.066997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747e4e7-ff68-47dc-937f-f39966a7357d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:20.113031 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 541/1063] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:58:20.136677 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da41dc0-858c-49b8-906a-0c010bb68adb None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:20.169645 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747e4e7-ff68-47dc-937f-f39966a7357d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:20.204952 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcaeb7-2593-451f-b8b3-21aaf4a91e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:20.205687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcaeb7-2593-451f-b8b3-21aaf4a91e06 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:20.205968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcaeb7-2593-451f-b8b3-21aaf4a91e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:20.206243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcaeb7-2593-451f-b8b3-21aaf4a91e06 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:20.217692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcaeb7-2593-451f-b8b3-21aaf4a91e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-37dcaeb7-2593-451f-b8b3-21aaf4a91e06 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:58:20.225950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:20.226968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:20.228235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:20.228235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:20.228235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:20.228235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:20.228235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:58:20.228235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:58:20.228235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:58:20.228235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:58:20.228235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:58:20.228235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:58:20.228235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 16:58:20.228235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:20.228235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 523/1064] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 17 16:58:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:20.232867 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcaeb7-2593-451f-b8b3-21aaf4a91e06 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:20.237510 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da41dc0-858c-49b8-906a-0c010bb68adb None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:20.272106 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363fa2f-f680-4f5a-845e-2c3add1e76e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:20.272899 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363fa2f-f680-4f5a-845e-2c3add1e76e7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:20.273179 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363fa2f-f680-4f5a-845e-2c3add1e76e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:20.273454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363fa2f-f680-4f5a-845e-2c3add1e76e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:20.286924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363fa2f-f680-4f5a-845e-2c3add1e76e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-4363fa2f-f680-4f5a-845e-2c3add1e76e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:58:20.295064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:20.296063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:20.296908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:20.296908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:20.296908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:20.296908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:20.296908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:58:20.296908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:58:20.296908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:58:20.296908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:58:20.296908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:58:20.296908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:58:20.296908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:58:20.296908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:20.296908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 542/1065] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:58:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:20.302218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363fa2f-f680-4f5a-845e-2c3add1e76e7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:20.339404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcaeb7-2593-451f-b8b3-21aaf4a91e06 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:20.373505 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53b43a-604d-4998-ae6d-1655d8e4f3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:20.374177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b43a-604d-4998-ae6d-1655d8e4f3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:20.374459 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b43a-604d-4998-ae6d-1655d8e4f3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:20.374734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b43a-604d-4998-ae6d-1655d8e4f3d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:20.375481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53b43a-604d-4998-ae6d-1655d8e4f3d6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:20.375819 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53b43a-604d-4998-ae6d-1655d8e4f3d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:20.377193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53b43a-604d-4998-ae6d-1655d8e4f3d6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:20.385368 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 524/1066] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 17 16:58:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:20.390953 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53b43a-604d-4998-ae6d-1655d8e4f3d6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:20.406010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363fa2f-f680-4f5a-845e-2c3add1e76e7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:20.440120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c284a-cceb-4d09-ab15-e34e1e65a434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:20.440778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c284a-cceb-4d09-ab15-e34e1e65a434 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:20.441064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c284a-cceb-4d09-ab15-e34e1e65a434 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:20.441330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c284a-cceb-4d09-ab15-e34e1e65a434 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:20.442069 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c284a-cceb-4d09-ab15-e34e1e65a434 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:20.442356 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c284a-cceb-4d09-ab15-e34e1e65a434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:20.443725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c284a-cceb-4d09-ab15-e34e1e65a434 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:20.451853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 543/1067] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:58:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:20.457292 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c284a-cceb-4d09-ab15-e34e1e65a434 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:20.503510 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53b43a-604d-4998-ae6d-1655d8e4f3d6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:20.536643 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07301034-a6a6-4a9b-9f3b-6f60ec95fb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:20.537440 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07301034-a6a6-4a9b-9f3b-6f60ec95fb2d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:20.537739 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07301034-a6a6-4a9b-9f3b-6f60ec95fb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:20.537988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07301034-a6a6-4a9b-9f3b-6f60ec95fb2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:20.549681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07301034-a6a6-4a9b-9f3b-6f60ec95fb2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:20.551156 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07301034-a6a6-4a9b-9f3b-6f60ec95fb2d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:20.557039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c284a-cceb-4d09-ab15-e34e1e65a434 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:20.569799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-07301034-a6a6-4a9b-9f3b-6f60ec95fb2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:20.569799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:20.569799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:20.569799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:20.569799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:20.569799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:20.569799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:20.569799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:20.569799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:20.569799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:20.569799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:20.569799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:20.569799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:58:20.569799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:58:20.569799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:20.570772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:20.571832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:58:20.571832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:58:20.571832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:20.571832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:20.571832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 525/1068] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:20.576832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07301034-a6a6-4a9b-9f3b-6f60ec95fb2d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:20.592239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d649263-eda5-4171-8c70-80efcca854bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:20.593155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d649263-eda5-4171-8c70-80efcca854bc None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:20.593432 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d649263-eda5-4171-8c70-80efcca854bc None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:20.593704 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d649263-eda5-4171-8c70-80efcca854bc None admin] PATH_INFO: `/v3/users/b4fc8d74ab594d31aa6c138c5d828694` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:20.594987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d649263-eda5-4171-8c70-80efcca854bc None admin] RBAC: Authorizing `identity:get_user(user_id=b4fc8d74ab594d31aa6c138c5d828694)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:20.596514 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d649263-eda5-4171-8c70-80efcca854bc None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:20.598382 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 544/1069] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:58:20 2022] GET /identity/v3/users/b4fc8d74ab594d31aa6c138c5d828694 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:20.604783 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d649263-eda5-4171-8c70-80efcca854bc None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:20.679558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07301034-a6a6-4a9b-9f3b-6f60ec95fb2d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:20.707060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d649263-eda5-4171-8c70-80efcca854bc None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:20.712776 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657e3e7-b5a6-47a1-8a63-1998925c09cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:20.713375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657e3e7-b5a6-47a1-8a63-1998925c09cf None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:20.713654 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657e3e7-b5a6-47a1-8a63-1998925c09cf None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:20.713927 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657e3e7-b5a6-47a1-8a63-1998925c09cf None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:20.714636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657e3e7-b5a6-47a1-8a63-1998925c09cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:20.714936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657e3e7-b5a6-47a1-8a63-1998925c09cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:20.716339 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657e3e7-b5a6-47a1-8a63-1998925c09cf None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:20.728241 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 526/1070] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:20.733444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657e3e7-b5a6-47a1-8a63-1998925c09cf None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:20.739373 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d3f3f-c2ed-4b2a-b19a-0bdf211757d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:20.740266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d3f3f-c2ed-4b2a-b19a-0bdf211757d7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:20.740546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d3f3f-c2ed-4b2a-b19a-0bdf211757d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:20.740819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d3f3f-c2ed-4b2a-b19a-0bdf211757d7 None admin] PATH_INFO: `/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:20.741980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d3f3f-c2ed-4b2a-b19a-0bdf211757d7 None admin] RBAC: Authorizing `identity:get_project(project_id=9c882a32c3c54dea8092c86b4bfd2f0d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:20.743954 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d3f3f-c2ed-4b2a-b19a-0bdf211757d7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:20.745665 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 545/1071] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:58:20 2022] GET /identity/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:20.752459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d3f3f-c2ed-4b2a-b19a-0bdf211757d7 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:20.829066 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657e3e7-b5a6-47a1-8a63-1998925c09cf None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:20.850042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d3f3f-c2ed-4b2a-b19a-0bdf211757d7 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:20.861790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f175f-8b9f-48bb-9dc8-9e573d24c4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:20.862591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f175f-8b9f-48bb-9dc8-9e573d24c4ba None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:20.862965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f175f-8b9f-48bb-9dc8-9e573d24c4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:20.863240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f175f-8b9f-48bb-9dc8-9e573d24c4ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:20.870611 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f175f-8b9f-48bb-9dc8-9e573d24c4ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:20.872069 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f175f-8b9f-48bb-9dc8-9e573d24c4ba None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:20.882861 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e91403-627a-40b6-a9ac-285bd14b902d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:20.884613 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e91403-627a-40b6-a9ac-285bd14b902d None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:20.884896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e91403-627a-40b6-a9ac-285bd14b902d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:20.885170 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e91403-627a-40b6-a9ac-285bd14b902d None admin] PATH_INFO: `/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d/users/b4fc8d74ab594d31aa6c138c5d828694/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-537f175f-8b9f-48bb-9dc8-9e573d24c4ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:58:20.886332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:20.887442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:20.888646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:20.888646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:20.888646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:58:20.888646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:58:20.888646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:58:20.888646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:58:20.888646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:58:20.888646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:58:20.888646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 16:58:20.888646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:20.888646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 527/1072] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 16:58:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:20.889370 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150087b0-86e2-4ebe-a14f-9fcc69f591b7 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:20.889370 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150087b0-86e2-4ebe-a14f-9fcc69f591b7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:20.889370 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150087b0-86e2-4ebe-a14f-9fcc69f591b7 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:20.890656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 528/1073] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:20.890926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e91403-627a-40b6-a9ac-285bd14b902d None admin] RBAC: Authorizing `identity:create_grant(project_id=9c882a32c3c54dea8092c86b4bfd2f0d, user_id=b4fc8d74ab594d31aa6c138c5d828694, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:20.892480 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e91403-627a-40b6-a9ac-285bd14b902d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:20.894120 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150087b0-86e2-4ebe-a14f-9fcc69f591b7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:20.905774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 546/1074] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:58:20 2022] PUT /identity/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d/users/b4fc8d74ab594d31aa6c138c5d828694/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 16:58:20.907092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416774b7-86bd-4c43-a07c-7fa70845a0e7 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:20.907384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416774b7-86bd-4c43-a07c-7fa70845a0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:20.907698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416774b7-86bd-4c43-a07c-7fa70845a0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:20.936111 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-416774b7-86bd-4c43-a07c-7fa70845a0e7 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:20.937752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-416774b7-86bd-4c43-a07c-7fa70845a0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:21.002978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150087b0-86e2-4ebe-a14f-9fcc69f591b7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:21.014816 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 547/1075] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:21.037430 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416774b7-86bd-4c43-a07c-7fa70845a0e7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:21.039233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cdf98-0c34-48ec-9b13-398a5d821e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:21.040656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cdf98-0c34-48ec-9b13-398a5d821e95 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:21.041148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cdf98-0c34-48ec-9b13-398a5d821e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:21.041425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cdf98-0c34-48ec-9b13-398a5d821e95 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:21.042453 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cdf98-0c34-48ec-9b13-398a5d821e95 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:21.042772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cdf98-0c34-48ec-9b13-398a5d821e95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:21.044285 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cdf98-0c34-48ec-9b13-398a5d821e95 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:21.063748 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 529/1076] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 16:58:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:21.069329 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cdf98-0c34-48ec-9b13-398a5d821e95 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:21.150300 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416774b7-86bd-4c43-a07c-7fa70845a0e7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:21.175734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cdf98-0c34-48ec-9b13-398a5d821e95 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:21.184465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a08cc7-e6f2-42c5-bde1-d226cd92fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:21.185113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a08cc7-e6f2-42c5-bde1-d226cd92fbdd None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:21.185391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a08cc7-e6f2-42c5-bde1-d226cd92fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:21.185668 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a08cc7-e6f2-42c5-bde1-d226cd92fbdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:21.209965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186ed33-3e5c-42a3-9840-04db84b2eff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:21.211065 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186ed33-3e5c-42a3-9840-04db84b2eff1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:21.211627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186ed33-3e5c-42a3-9840-04db84b2eff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:21.212076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186ed33-3e5c-42a3-9840-04db84b2eff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:21.222313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186ed33-3e5c-42a3-9840-04db84b2eff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:21.224033 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186ed33-3e5c-42a3-9840-04db84b2eff1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:21.243470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-d186ed33-3e5c-42a3-9840-04db84b2eff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:21.243470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:21.243470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:21.243470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:21.243470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:21.243470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:21.243470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:21.243470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:21.243470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:21.243470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:21.243470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:21.243470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:21.243470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:58:21.243470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:58:21.243470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:21.244671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:21.245604 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:58:21.245604 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:58:21.245604 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:21.245604 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:21.247760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 530/1077] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:21.252407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a08cc7-e6f2-42c5-bde1-d226cd92fbdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:21.253275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186ed33-3e5c-42a3-9840-04db84b2eff1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:21.253885 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a08cc7-e6f2-42c5-bde1-d226cd92fbdd None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:21.349294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186ed33-3e5c-42a3-9840-04db84b2eff1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:21.360898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 548/1078] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:58:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 16:58:21.362157 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a08cc7-e6f2-42c5-bde1-d226cd92fbdd None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:21.384603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a8907-08c4-43e0-a04c-09db88282fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:21.385407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a8907-08c4-43e0-a04c-09db88282fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:21.385743 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a8907-08c4-43e0-a04c-09db88282fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:21.386082 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a8907-08c4-43e0-a04c-09db88282fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:21.386852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a8907-08c4-43e0-a04c-09db88282fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:21.387219 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a8907-08c4-43e0-a04c-09db88282fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:21.388690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a8907-08c4-43e0-a04c-09db88282fd5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:21.400784 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 531/1079] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:21.405994 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a8907-08c4-43e0-a04c-09db88282fd5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:21.462775 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a08cc7-e6f2-42c5-bde1-d226cd92fbdd None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:21.497445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b683-9456-44b1-ad3f-a8ed6e41d852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:21.498244 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b683-9456-44b1-ad3f-a8ed6e41d852 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:21.498525 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b683-9456-44b1-ad3f-a8ed6e41d852 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:21.498805 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b683-9456-44b1-ad3f-a8ed6e41d852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:21.503486 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a8907-08c4-43e0-a04c-09db88282fd5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:21.508743 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332b683-9456-44b1-ad3f-a8ed6e41d852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:21.510367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332b683-9456-44b1-ad3f-a8ed6e41d852 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:21.528698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-a332b683-9456-44b1-ad3f-a8ed6e41d852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:21.528698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:21.528698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:21.528698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:21.528698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:21.528698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:21.528698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:21.528698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:21.528698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:21.528698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:21.528698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:21.528698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:21.528698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:58:21.528698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:58:21.528698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:21.529793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:21.530898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:58:21.530898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:58:21.530898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:21.530898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:21.530898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 549/1080] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:21.535819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b683-9456-44b1-ad3f-a8ed6e41d852 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:21.539113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e96766-7553-4c95-9557-b55d69c177df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:21.540506 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e96766-7553-4c95-9557-b55d69c177df None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:21.540786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e96766-7553-4c95-9557-b55d69c177df None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:21.541111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e96766-7553-4c95-9557-b55d69c177df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:21.547968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e96766-7553-4c95-9557-b55d69c177df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:21.549405 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e96766-7553-4c95-9557-b55d69c177df None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:21.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-d8e96766-7553-4c95-9557-b55d69c177df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:58:21.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:21.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:21.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:21.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:21.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:21.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:21.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:21.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:21.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:21.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:21.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:21.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:58:21.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:58:21.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:21.564540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:21.565414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:58:21.565414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:58:21.565414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:58:21.565414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:58:21.565414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:58:21.565414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:58:21.565414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:58:21.565414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:21.569528 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 532/1081] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:58:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:21.570365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e96766-7553-4c95-9557-b55d69c177df None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:21.636113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b683-9456-44b1-ad3f-a8ed6e41d852 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:21.666948 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e96766-7553-4c95-9557-b55d69c177df None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:21.669377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e60e2c-55c6-446f-ae78-1c782c0b9bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:21.670035 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e60e2c-55c6-446f-ae78-1c782c0b9bba None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:21.670316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e60e2c-55c6-446f-ae78-1c782c0b9bba None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:21.670586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e60e2c-55c6-446f-ae78-1c782c0b9bba None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:21.671308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e60e2c-55c6-446f-ae78-1c782c0b9bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:21.671611 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e60e2c-55c6-446f-ae78-1c782c0b9bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:21.672979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e60e2c-55c6-446f-ae78-1c782c0b9bba None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:21.684330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 550/1082] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:21.701339 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa0341-5633-43cf-a099-f7b2907186e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:21.702033 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa0341-5633-43cf-a099-f7b2907186e1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:21.702319 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa0341-5633-43cf-a099-f7b2907186e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:21.702597 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa0341-5633-43cf-a099-f7b2907186e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:21.703410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa0341-5633-43cf-a099-f7b2907186e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:21.703762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa0341-5633-43cf-a099-f7b2907186e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:21.705265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa0341-5633-43cf-a099-f7b2907186e1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:21.719365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 533/1083] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:58:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:21.725218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e60e2c-55c6-446f-ae78-1c782c0b9bba None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:21.832569 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e60e2c-55c6-446f-ae78-1c782c0b9bba None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:21.868217 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba4fb8-0fea-4a3b-ab3c-c8772cfd4f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:21.869205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba4fb8-0fea-4a3b-ab3c-c8772cfd4f99 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:21.869489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba4fb8-0fea-4a3b-ab3c-c8772cfd4f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:21.869760 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba4fb8-0fea-4a3b-ab3c-c8772cfd4f99 None admin] PATH_INFO: `/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/5becb135afbd43e9bc0b1347ba04e2b5/roles/a21fc21c2d6c4f2d9ac51e7ae4e71e6a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:21.872079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba4fb8-0fea-4a3b-ab3c-c8772cfd4f99 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2b356e72cf84d099f2ce8678103ecef, user_id=5becb135afbd43e9bc0b1347ba04e2b5, role_id=a21fc21c2d6c4f2d9ac51e7ae4e71e6a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:21.873511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba4fb8-0fea-4a3b-ab3c-c8772cfd4f99 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:21.887624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 551/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:58:21 2022] PUT /identity/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/5becb135afbd43e9bc0b1347ba04e2b5/roles/a21fc21c2d6c4f2d9ac51e7ae4e71e6a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:58:23.128322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea676363-7ef7-4619-a80b-aeda90e6c13b None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:23.128898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea676363-7ef7-4619-a80b-aeda90e6c13b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:23.128898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea676363-7ef7-4619-a80b-aeda90e6c13b None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:23.130466 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 534/1085] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:23.136305 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e63fca-cd3a-4398-a1c5-8ad103b8be2b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:23.136775 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e63fca-cd3a-4398-a1c5-8ad103b8be2b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:23.136995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e63fca-cd3a-4398-a1c5-8ad103b8be2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:23.153591 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-55e63fca-cd3a-4398-a1c5-8ad103b8be2b None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:23.154757 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-55e63fca-cd3a-4398-a1c5-8ad103b8be2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:23.217503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 552/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:23.240680 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea676363-7ef7-4619-a80b-aeda90e6c13b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:23.337412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea676363-7ef7-4619-a80b-aeda90e6c13b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:23.369722 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809e329-40e1-43ef-b679-0ee26b31704c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:23.370436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809e329-40e1-43ef-b679-0ee26b31704c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:23.370711 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809e329-40e1-43ef-b679-0ee26b31704c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:23.370977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809e329-40e1-43ef-b679-0ee26b31704c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:23.380418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809e329-40e1-43ef-b679-0ee26b31704c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b809e329-40e1-43ef-b679-0ee26b31704c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:58:23.388480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:23.389696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:23.390622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:23.390622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:23.390622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:23.390622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:23.390622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:58:23.390622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:58:23.390622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:58:23.390622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:58:23.390622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:58:23.390622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:58:23.390622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:58:23.390622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:23.390622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 535/1087] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:58:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:23.395675 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e63fca-cd3a-4398-a1c5-8ad103b8be2b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:23.488200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e63fca-cd3a-4398-a1c5-8ad103b8be2b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:23.521027 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb417b-e20a-4deb-98d7-7dc39be5d7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:23.521682 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb417b-e20a-4deb-98d7-7dc39be5d7cb None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:23.521958 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb417b-e20a-4deb-98d7-7dc39be5d7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:23.522228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb417b-e20a-4deb-98d7-7dc39be5d7cb None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:23.522958 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb417b-e20a-4deb-98d7-7dc39be5d7cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:23.523256 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb417b-e20a-4deb-98d7-7dc39be5d7cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:23.524670 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb417b-e20a-4deb-98d7-7dc39be5d7cb None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:23.532561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 553/1088] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 16:58:23.538159 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809e329-40e1-43ef-b679-0ee26b31704c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:23.633853 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809e329-40e1-43ef-b679-0ee26b31704c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:23.666003 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774e9ac-a5eb-4a05-9cc2-19d4f5f12f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:23.666877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e9ac-a5eb-4a05-9cc2-19d4f5f12f9c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:23.667153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e9ac-a5eb-4a05-9cc2-19d4f5f12f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:23.667421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e9ac-a5eb-4a05-9cc2-19d4f5f12f9c None admin] PATH_INFO: `/v3/users/b4fc8d74ab594d31aa6c138c5d828694` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:23.668635 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774e9ac-a5eb-4a05-9cc2-19d4f5f12f9c None admin] RBAC: Authorizing `identity:get_user(user_id=b4fc8d74ab594d31aa6c138c5d828694)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:23.670055 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774e9ac-a5eb-4a05-9cc2-19d4f5f12f9c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:23.671689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 536/1089] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:58:23 2022] GET /identity/v3/users/b4fc8d74ab594d31aa6c138c5d828694 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:23.677534 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb417b-e20a-4deb-98d7-7dc39be5d7cb None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:23.771243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb417b-e20a-4deb-98d7-7dc39be5d7cb None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:23.806413 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6782d1e-5e13-47b2-a939-692674f6bd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:23.807051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6782d1e-5e13-47b2-a939-692674f6bd1a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:23.807329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6782d1e-5e13-47b2-a939-692674f6bd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:23.807629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6782d1e-5e13-47b2-a939-692674f6bd1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:23.870394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6782d1e-5e13-47b2-a939-692674f6bd1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:23.871860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6782d1e-5e13-47b2-a939-692674f6bd1a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:23.967298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 554/1090] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:58:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 16:58:23.972901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774e9ac-a5eb-4a05-9cc2-19d4f5f12f9c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:24.068407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774e9ac-a5eb-4a05-9cc2-19d4f5f12f9c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:24.101147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24065237-8fbb-4cfd-829e-26b19378ac52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:24.102510 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24065237-8fbb-4cfd-829e-26b19378ac52 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:24.102788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24065237-8fbb-4cfd-829e-26b19378ac52 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:24.103058 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24065237-8fbb-4cfd-829e-26b19378ac52 None admin] PATH_INFO: `/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:24.104252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24065237-8fbb-4cfd-829e-26b19378ac52 None admin] RBAC: Authorizing `identity:get_project(project_id=9c882a32c3c54dea8092c86b4bfd2f0d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:24.105684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24065237-8fbb-4cfd-829e-26b19378ac52 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:24.107397 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 537/1091] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:58:23 2022] GET /identity/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:24.111431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37901cd2-86b7-4723-a811-f935a7fcb2fd None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:24.111811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37901cd2-86b7-4723-a811-f935a7fcb2fd None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:24.112152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37901cd2-86b7-4723-a811-f935a7fcb2fd None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:24.113109 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24065237-8fbb-4cfd-829e-26b19378ac52 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:24.113643 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 555/1092] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:24.119315 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5b272-4359-4a45-a619-a0709ea1b05e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:24.119596 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5b272-4359-4a45-a619-a0709ea1b05e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:24.119900 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5b272-4359-4a45-a619-a0709ea1b05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:24.136284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d9e5b272-4359-4a45-a619-a0709ea1b05e None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:24.137439 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d9e5b272-4359-4a45-a619-a0709ea1b05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:24.200643 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 556/1093] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:58:24.208229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24065237-8fbb-4cfd-829e-26b19378ac52 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:24.224054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5b272-4359-4a45-a619-a0709ea1b05e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:24.239981 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c79159-f6f6-4c66-be1f-0ee16fbff91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:24.240634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c79159-f6f6-4c66-be1f-0ee16fbff91d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:24.240933 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c79159-f6f6-4c66-be1f-0ee16fbff91d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:24.241308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c79159-f6f6-4c66-be1f-0ee16fbff91d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:24.242208 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c79159-f6f6-4c66-be1f-0ee16fbff91d None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=9c882a32c3c54dea8092c86b4bfd2f0d, user.id=b4fc8d74ab594d31aa6c138c5d828694) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:24.242653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c79159-f6f6-4c66-be1f-0ee16fbff91d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:24.244097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c79159-f6f6-4c66-be1f-0ee16fbff91d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:24.249890 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 538/1094] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:58:24 2022] GET /identity/v3/role_assignments?user.id=b4fc8d74ab594d31aa6c138c5d828694&scope.project.id=9c882a32c3c54dea8092c86b4bfd2f0d&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:24.324478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5b272-4359-4a45-a619-a0709ea1b05e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:24.359650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a19017-5e29-4701-9d63-b038d1bec2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:24.360483 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a19017-5e29-4701-9d63-b038d1bec2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:24.360765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a19017-5e29-4701-9d63-b038d1bec2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:24.361039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a19017-5e29-4701-9d63-b038d1bec2d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:24.372433 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a19017-5e29-4701-9d63-b038d1bec2d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-68a19017-5e29-4701-9d63-b038d1bec2d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:58:24.380859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:24.382059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:24.383128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:24.383128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:24.383128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:24.383128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:24.383128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:58:24.383128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:58:24.383128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:58:24.383128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:58:24.383128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:58:24.383128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:58:24.383128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 16:58:24.383128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:24.383128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 557/1095] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 17 16:58:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 16:58:24.388403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c79159-f6f6-4c66-be1f-0ee16fbff91d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:24.491139 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c79159-f6f6-4c66-be1f-0ee16fbff91d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:24.523356 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d4dfb-2d8d-4969-8c52-bde2460ddff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:24.524076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d4dfb-2d8d-4969-8c52-bde2460ddff1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:24.524362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d4dfb-2d8d-4969-8c52-bde2460ddff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:24.524637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d4dfb-2d8d-4969-8c52-bde2460ddff1 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:24.525376 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d4dfb-2d8d-4969-8c52-bde2460ddff1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:24.525680 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d4dfb-2d8d-4969-8c52-bde2460ddff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:24.527043 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d4dfb-2d8d-4969-8c52-bde2460ddff1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:24.534649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 539/1096] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 17 16:58:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:24.540303 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a19017-5e29-4701-9d63-b038d1bec2d4 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:24.635959 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a19017-5e29-4701-9d63-b038d1bec2d4 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:24.667956 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9de6c9-27d3-48db-a02f-2470fc2003bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:24.668748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9de6c9-27d3-48db-a02f-2470fc2003bb None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:24.669030 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9de6c9-27d3-48db-a02f-2470fc2003bb None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:24.669306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9de6c9-27d3-48db-a02f-2470fc2003bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:24.680857 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9de6c9-27d3-48db-a02f-2470fc2003bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:24.682381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9de6c9-27d3-48db-a02f-2470fc2003bb None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:24.699763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-4c9de6c9-27d3-48db-a02f-2470fc2003bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:24.699763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:24.699763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:24.699763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:24.699763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:24.699763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:24.699763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:24.699763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:24.699763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:24.699763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:24.699763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:24.699763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:24.699763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:58:24.699763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:58:24.699763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:24.700877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:24.701917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:58:24.701917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:58:24.701917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:24.701917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:24.701917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 558/1097] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:24.706609 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d4dfb-2d8d-4969-8c52-bde2460ddff1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:24.801018 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d4dfb-2d8d-4969-8c52-bde2460ddff1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:24.832794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32306859-e3d8-4f45-953d-33ef5114a560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:24.833446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32306859-e3d8-4f45-953d-33ef5114a560 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:24.833724 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32306859-e3d8-4f45-953d-33ef5114a560 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:24.833990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32306859-e3d8-4f45-953d-33ef5114a560 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:24.834696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32306859-e3d8-4f45-953d-33ef5114a560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:24.834996 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32306859-e3d8-4f45-953d-33ef5114a560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:24.836466 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32306859-e3d8-4f45-953d-33ef5114a560 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:24.847586 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 540/1098] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:24.854087 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9de6c9-27d3-48db-a02f-2470fc2003bb None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:24.946759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9de6c9-27d3-48db-a02f-2470fc2003bb None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:24.978013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf3bf8-f5ab-4e6b-a736-3029b8957742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:24.978797 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf3bf8-f5ab-4e6b-a736-3029b8957742 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:24.979072 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf3bf8-f5ab-4e6b-a736-3029b8957742 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:24.979342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf3bf8-f5ab-4e6b-a736-3029b8957742 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:24.986549 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf3bf8-f5ab-4e6b-a736-3029b8957742 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:24.987999 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf3bf8-f5ab-4e6b-a736-3029b8957742 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-e2cf3bf8-f5ab-4e6b-a736-3029b8957742 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 16:58:25.001893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:25.002996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:25.004052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:25.004052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:25.004052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 16:58:25.004052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 16:58:25.004052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 16:58:25.004052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 16:58:25.004052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 16:58:25.004052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 16:58:25.004052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 16:58:25.004052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:25.004052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 559/1099] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 16:58:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:25.009444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32306859-e3d8-4f45-953d-33ef5114a560 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:25.102538 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32306859-e3d8-4f45-953d-33ef5114a560 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:25.136321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9aee55-7193-42c7-a02a-502571107730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:25.137002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aee55-7193-42c7-a02a-502571107730 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:25.137283 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aee55-7193-42c7-a02a-502571107730 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:25.137556 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aee55-7193-42c7-a02a-502571107730 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:25.138386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9aee55-7193-42c7-a02a-502571107730 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:25.138690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9aee55-7193-42c7-a02a-502571107730 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:25.140143 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9aee55-7193-42c7-a02a-502571107730 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:25.157260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 541/1100] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 16:58:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:25.162888 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf3bf8-f5ab-4e6b-a736-3029b8957742 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:25.256636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf3bf8-f5ab-4e6b-a736-3029b8957742 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:25.287440 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80760736-f10e-470c-87c8-425f38915d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:25.288095 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80760736-f10e-470c-87c8-425f38915d1f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:25.288376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80760736-f10e-470c-87c8-425f38915d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:25.288648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80760736-f10e-470c-87c8-425f38915d1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:25.350443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80760736-f10e-470c-87c8-425f38915d1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:25.351868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80760736-f10e-470c-87c8-425f38915d1f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:25.445979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 560/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:58:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 16:58:25.451487 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9aee55-7193-42c7-a02a-502571107730 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:25.544550 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9aee55-7193-42c7-a02a-502571107730 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:25.585083 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d49f6d-0648-4f77-9ed0-d2f44919eb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:25.586840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d49f6d-0648-4f77-9ed0-d2f44919eb38 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:25.587277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d49f6d-0648-4f77-9ed0-d2f44919eb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:25.587681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d49f6d-0648-4f77-9ed0-d2f44919eb38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:25.597315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d49f6d-0648-4f77-9ed0-d2f44919eb38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:25.598751 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d49f6d-0648-4f77-9ed0-d2f44919eb38 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:25.615546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-d2d49f6d-0648-4f77-9ed0-d2f44919eb38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:25.615546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:25.615546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:25.615546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:25.615546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:25.615546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:25.615546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:25.615546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:25.615546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:25.615546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:25.615546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:25.615546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:25.615546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:58:25.615546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:58:25.615546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:25.616557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:25.618057 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 16:58:25.618057 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:58:25.618057 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 16:58:25.618057 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:25.618057 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 542/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:25.622292 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80760736-f10e-470c-87c8-425f38915d1f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:25.723947 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80760736-f10e-470c-87c8-425f38915d1f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:25.755670 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05fbf6-5ca8-40cc-9f56-c0a54c2af37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:25.756320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05fbf6-5ca8-40cc-9f56-c0a54c2af37e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:25.756596 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05fbf6-5ca8-40cc-9f56-c0a54c2af37e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:25.756863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05fbf6-5ca8-40cc-9f56-c0a54c2af37e None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:25.757567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05fbf6-5ca8-40cc-9f56-c0a54c2af37e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:25.757873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05fbf6-5ca8-40cc-9f56-c0a54c2af37e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:25.759740 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05fbf6-5ca8-40cc-9f56-c0a54c2af37e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:25.770448 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 561/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 16:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:25.776620 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d49f6d-0648-4f77-9ed0-d2f44919eb38 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:25.869548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d49f6d-0648-4f77-9ed0-d2f44919eb38 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:25.901409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d60db1-f0c7-4cc7-84cd-dce7507c59f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:25.902191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d60db1-f0c7-4cc7-84cd-dce7507c59f9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:25.902468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d60db1-f0c7-4cc7-84cd-dce7507c59f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:25.902738 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d60db1-f0c7-4cc7-84cd-dce7507c59f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:25.909204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d60db1-f0c7-4cc7-84cd-dce7507c59f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:25.910624 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d60db1-f0c7-4cc7-84cd-dce7507c59f9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:25.923822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-43d60db1-f0c7-4cc7-84cd-dce7507c59f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:58:25.923822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:25.923822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:25.923822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:25.923822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:25.923822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:25.923822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:25.923822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:25.923822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:25.923822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:25.923822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:25.923822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:25.923822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 16:58:25.923822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 16:58:25.923822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:25.924858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:25.925778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 16:58:25.925778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 16:58:25.925778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:58:25.925778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:58:25.925778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:58:25.925778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:58:25.925778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 16:58:25.925778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:25.927910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 543/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 16:58:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:25.931228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05fbf6-5ca8-40cc-9f56-c0a54c2af37e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:26.027270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05fbf6-5ca8-40cc-9f56-c0a54c2af37e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:26.063093 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0057aa3-0ee4-45cf-be3c-dc5f8dc94056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:26.063780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0057aa3-0ee4-45cf-be3c-dc5f8dc94056 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:26.064071 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0057aa3-0ee4-45cf-be3c-dc5f8dc94056 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:26.064356 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0057aa3-0ee4-45cf-be3c-dc5f8dc94056 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:26.065133 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0057aa3-0ee4-45cf-be3c-dc5f8dc94056 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:26.065437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0057aa3-0ee4-45cf-be3c-dc5f8dc94056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:26.066849 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0057aa3-0ee4-45cf-be3c-dc5f8dc94056 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:26.078992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 562/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 16:58:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:26.085158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d60db1-f0c7-4cc7-84cd-dce7507c59f9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:26.179804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d60db1-f0c7-4cc7-84cd-dce7507c59f9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:26.210387 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39045e-59f7-4d43-8297-cae4685ca073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:26.211538 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39045e-59f7-4d43-8297-cae4685ca073 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:26.211844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39045e-59f7-4d43-8297-cae4685ca073 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:26.212115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39045e-59f7-4d43-8297-cae4685ca073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:26.212932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39045e-59f7-4d43-8297-cae4685ca073 None admin] RBAC: Adding query filter params (role.id=a21fc21c2d6c4f2d9ac51e7ae4e71e6a, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=5becb135afbd43e9bc0b1347ba04e2b5) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:26.213239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39045e-59f7-4d43-8297-cae4685ca073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:26.214656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39045e-59f7-4d43-8297-cae4685ca073 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:26.220531 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 544/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:58:26 2022] GET /identity/v3/role_assignments?user.id=5becb135afbd43e9bc0b1347ba04e2b5&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=a21fc21c2d6c4f2d9ac51e7ae4e71e6a => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:26.508211 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5f19c-b7e0-4743-8e47-f58a5380d206 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:26.508722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5f19c-b7e0-4743-8e47-f58a5380d206 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:26.508722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5f19c-b7e0-4743-8e47-f58a5380d206 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:26.510034 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 563/1107] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:26.515506 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d09a9-2bc9-49ca-8533-bc4ebf7b6d42 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:26.515967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d09a9-2bc9-49ca-8533-bc4ebf7b6d42 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:26.516085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d09a9-2bc9-49ca-8533-bc4ebf7b6d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:26.532601 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f09d09a9-2bc9-49ca-8533-bc4ebf7b6d42 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:26.533760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f09d09a9-2bc9-49ca-8533-bc4ebf7b6d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:26.602810 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 545/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:26.628421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5f19c-b7e0-4743-8e47-f58a5380d206 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:26.728567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5f19c-b7e0-4743-8e47-f58a5380d206 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:26.761762 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a3650-5390-4870-99f5-1258ee59d2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:26.762486 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a3650-5390-4870-99f5-1258ee59d2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:26.762766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a3650-5390-4870-99f5-1258ee59d2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:26.763039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a3650-5390-4870-99f5-1258ee59d2c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:26.764249 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a3650-5390-4870-99f5-1258ee59d2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:26.765664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a3650-5390-4870-99f5-1258ee59d2c6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:26.767287 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 564/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:26.773207 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d09a9-2bc9-49ca-8533-bc4ebf7b6d42 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:26.871498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d09a9-2bc9-49ca-8533-bc4ebf7b6d42 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:26.904800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecae29-a362-4e7c-a17c-aaefc2ff4727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:26.905472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecae29-a362-4e7c-a17c-aaefc2ff4727 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:26.905752 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecae29-a362-4e7c-a17c-aaefc2ff4727 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:26.906032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecae29-a362-4e7c-a17c-aaefc2ff4727 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:26.906759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecae29-a362-4e7c-a17c-aaefc2ff4727 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:26.908252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecae29-a362-4e7c-a17c-aaefc2ff4727 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:26.928887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 546/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:58:26 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:58:29.185844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c037c-01bb-48da-a5c1-b2f0136ef919 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:29.186377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c037c-01bb-48da-a5c1-b2f0136ef919 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:29.186377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c037c-01bb-48da-a5c1-b2f0136ef919 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:29.188041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 565/1111] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:29.193202 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35140d-782d-4099-80a5-ab43e2138010 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:29.193605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35140d-782d-4099-80a5-ab43e2138010 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:29.193761 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35140d-782d-4099-80a5-ab43e2138010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:29.210425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4b35140d-782d-4099-80a5-ab43e2138010 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:29.211622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4b35140d-782d-4099-80a5-ab43e2138010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:29.276257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 547/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:29.300336 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c037c-01bb-48da-a5c1-b2f0136ef919 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:29.399426 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c037c-01bb-48da-a5c1-b2f0136ef919 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:29.432729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601fdbd-697b-4662-a847-cdd03f15465d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:29.433595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601fdbd-697b-4662-a847-cdd03f15465d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:29.433878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601fdbd-697b-4662-a847-cdd03f15465d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:29.434156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601fdbd-697b-4662-a847-cdd03f15465d None admin] PATH_INFO: `/v3/roles/f47d350de184449f9ce5e84ebe7753da` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:29.435655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601fdbd-697b-4662-a847-cdd03f15465d None admin] RBAC: Authorizing `identity:get_role(role_id=f47d350de184449f9ce5e84ebe7753da)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:29.437306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601fdbd-697b-4662-a847-cdd03f15465d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:29.438681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 566/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:58:29 2022] GET /identity/v3/roles/f47d350de184449f9ce5e84ebe7753da => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:29.444538 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35140d-782d-4099-80a5-ab43e2138010 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:29.539537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35140d-782d-4099-80a5-ab43e2138010 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:29.571596 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc55fa6-5066-47cc-8f5a-f56b5b93c5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:29.572482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc55fa6-5066-47cc-8f5a-f56b5b93c5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:29.572759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc55fa6-5066-47cc-8f5a-f56b5b93c5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:29.573029 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc55fa6-5066-47cc-8f5a-f56b5b93c5c7 None admin] PATH_INFO: `/v3/users/380c7eef804742638c688c2b3ade723c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:29.585273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc55fa6-5066-47cc-8f5a-f56b5b93c5c7 None admin] RBAC: Authorizing `identity:get_user(user_id=380c7eef804742638c688c2b3ade723c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:29.587390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc55fa6-5066-47cc-8f5a-f56b5b93c5c7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:29.589035 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 548/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:58:29 2022] GET /identity/v3/users/380c7eef804742638c688c2b3ade723c => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:29.596288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601fdbd-697b-4662-a847-cdd03f15465d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:29.689267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601fdbd-697b-4662-a847-cdd03f15465d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:29.720575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d6ad1-d501-4e0c-b9d5-48b37a1a7094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:29.721201 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d6ad1-d501-4e0c-b9d5-48b37a1a7094 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:29.721478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d6ad1-d501-4e0c-b9d5-48b37a1a7094 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:29.721747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d6ad1-d501-4e0c-b9d5-48b37a1a7094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:29.783822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d6ad1-d501-4e0c-b9d5-48b37a1a7094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:29.785257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d6ad1-d501-4e0c-b9d5-48b37a1a7094 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:29.876108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 567/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:58:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 16:58:29.881933 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc55fa6-5066-47cc-8f5a-f56b5b93c5c7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:29.974270 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc55fa6-5066-47cc-8f5a-f56b5b93c5c7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:30.005747 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd79e65-c314-4bb4-ab7f-f5f6cd51c511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:30.006589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd79e65-c314-4bb4-ab7f-f5f6cd51c511 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:30.006868 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd79e65-c314-4bb4-ab7f-f5f6cd51c511 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:30.007140 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd79e65-c314-4bb4-ab7f-f5f6cd51c511 None admin] PATH_INFO: `/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:30.009037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd79e65-c314-4bb4-ab7f-f5f6cd51c511 None admin] RBAC: Authorizing `identity:get_project(project_id=9c882a32c3c54dea8092c86b4bfd2f0d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:30.010466 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd79e65-c314-4bb4-ab7f-f5f6cd51c511 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:30.012182 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 549/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:58:29 2022] GET /identity/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:30.018041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d6ad1-d501-4e0c-b9d5-48b37a1a7094 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:30.110591 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d6ad1-d501-4e0c-b9d5-48b37a1a7094 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:30.143292 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb5331-3472-407d-82a4-c31e55cbccce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:30.143965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb5331-3472-407d-82a4-c31e55cbccce None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:30.144245 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb5331-3472-407d-82a4-c31e55cbccce None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:30.144515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb5331-3472-407d-82a4-c31e55cbccce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:30.145331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb5331-3472-407d-82a4-c31e55cbccce None admin] RBAC: Adding query filter params (role.id=f47d350de184449f9ce5e84ebe7753da, scope.project.id=9c882a32c3c54dea8092c86b4bfd2f0d, user.id=380c7eef804742638c688c2b3ade723c) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:30.145642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb5331-3472-407d-82a4-c31e55cbccce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:30.147051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb5331-3472-407d-82a4-c31e55cbccce None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:30.152339 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 568/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:58:30 2022] GET /identity/v3/role_assignments?user.id=380c7eef804742638c688c2b3ade723c&scope.project.id=9c882a32c3c54dea8092c86b4bfd2f0d&role.id=f47d350de184449f9ce5e84ebe7753da => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:32.328616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ddcd0-eb51-472a-a656-ade01c3f1479 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:32.329141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ddcd0-eb51-472a-a656-ade01c3f1479 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:32.329141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ddcd0-eb51-472a-a656-ade01c3f1479 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:32.330513 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 550/1118] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:32.335623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e78f37-3aab-4b2a-81fe-b2cdcafc84f8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:32.336403 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e78f37-3aab-4b2a-81fe-b2cdcafc84f8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:32.336698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e78f37-3aab-4b2a-81fe-b2cdcafc84f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:32.353443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-88e78f37-3aab-4b2a-81fe-b2cdcafc84f8 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:32.354545 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-88e78f37-3aab-4b2a-81fe-b2cdcafc84f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:32.417984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 569/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:32.440837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ddcd0-eb51-472a-a656-ade01c3f1479 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:32.533718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ddcd0-eb51-472a-a656-ade01c3f1479 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:32.565749 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bab3f-1c59-4e50-a822-fb038fe06367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:32.566584 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bab3f-1c59-4e50-a822-fb038fe06367 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:32.566860 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bab3f-1c59-4e50-a822-fb038fe06367 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:32.567130 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bab3f-1c59-4e50-a822-fb038fe06367 None admin] PATH_INFO: `/v3/roles/f47d350de184449f9ce5e84ebe7753da` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:32.568570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bab3f-1c59-4e50-a822-fb038fe06367 None admin] RBAC: Authorizing `identity:get_role(role_id=f47d350de184449f9ce5e84ebe7753da)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:32.569918 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bab3f-1c59-4e50-a822-fb038fe06367 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:32.571519 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 551/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:58:32 2022] GET /identity/v3/roles/f47d350de184449f9ce5e84ebe7753da => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:32.577395 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e78f37-3aab-4b2a-81fe-b2cdcafc84f8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:32.669874 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e78f37-3aab-4b2a-81fe-b2cdcafc84f8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:32.700989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba72d6-5861-4293-9a4f-ccc2059e24cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:32.701841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba72d6-5861-4293-9a4f-ccc2059e24cf None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:32.702119 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba72d6-5861-4293-9a4f-ccc2059e24cf None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:32.702389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba72d6-5861-4293-9a4f-ccc2059e24cf None admin] PATH_INFO: `/v3/users/380c7eef804742638c688c2b3ade723c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:32.703545 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba72d6-5861-4293-9a4f-ccc2059e24cf None admin] RBAC: Authorizing `identity:get_user(user_id=380c7eef804742638c688c2b3ade723c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:32.704984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba72d6-5861-4293-9a4f-ccc2059e24cf None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:32.706568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 570/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:58:32 2022] GET /identity/v3/users/380c7eef804742638c688c2b3ade723c => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:32.712750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bab3f-1c59-4e50-a822-fb038fe06367 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:32.806578 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bab3f-1c59-4e50-a822-fb038fe06367 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:32.838341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd252a2-ab28-4825-b0ba-aca06a824968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:32.839174 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd252a2-ab28-4825-b0ba-aca06a824968 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:32.839450 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd252a2-ab28-4825-b0ba-aca06a824968 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:32.839748 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd252a2-ab28-4825-b0ba-aca06a824968 None admin] PATH_INFO: `/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:32.840894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd252a2-ab28-4825-b0ba-aca06a824968 None admin] RBAC: Authorizing `identity:get_project(project_id=9c882a32c3c54dea8092c86b4bfd2f0d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:32.842301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd252a2-ab28-4825-b0ba-aca06a824968 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:32.843980 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 552/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:58:32 2022] GET /identity/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:32.849829 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba72d6-5861-4293-9a4f-ccc2059e24cf None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:32.944957 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba72d6-5861-4293-9a4f-ccc2059e24cf None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:32.976341 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2373c5-9ce8-4e7e-8d53-a3c296028b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:32.977724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2373c5-9ce8-4e7e-8d53-a3c296028b97 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:32.977996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2373c5-9ce8-4e7e-8d53-a3c296028b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:32.978263 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2373c5-9ce8-4e7e-8d53-a3c296028b97 None admin] PATH_INFO: `/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d/users/380c7eef804742638c688c2b3ade723c/roles/f47d350de184449f9ce5e84ebe7753da` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:32.980415 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2373c5-9ce8-4e7e-8d53-a3c296028b97 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c882a32c3c54dea8092c86b4bfd2f0d, user_id=380c7eef804742638c688c2b3ade723c, role_id=f47d350de184449f9ce5e84ebe7753da)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:32.981813 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2373c5-9ce8-4e7e-8d53-a3c296028b97 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:32.994723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 571/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:58:32 2022] PUT /identity/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d/users/380c7eef804742638c688c2b3ade723c/roles/f47d350de184449f9ce5e84ebe7753da => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:58:35.176711 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad5b6c-488a-48ac-95aa-c73ef59036f3 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:35.177202 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad5b6c-488a-48ac-95aa-c73ef59036f3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:35.177293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad5b6c-488a-48ac-95aa-c73ef59036f3 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:35.178624 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 553/1124] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:35.184495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb341b82-d536-459f-af91-df8461983f10 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:35.184909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb341b82-d536-459f-af91-df8461983f10 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:35.185056 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb341b82-d536-459f-af91-df8461983f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:35.201924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-bb341b82-d536-459f-af91-df8461983f10 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:35.203091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-bb341b82-d536-459f-af91-df8461983f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:35.265196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 572/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:35.289166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad5b6c-488a-48ac-95aa-c73ef59036f3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:35.384473 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad5b6c-488a-48ac-95aa-c73ef59036f3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:35.415974 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c1e6c-e944-400e-83ac-7cb2944d653b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:35.416813 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c1e6c-e944-400e-83ac-7cb2944d653b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:35.417094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c1e6c-e944-400e-83ac-7cb2944d653b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:35.417367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c1e6c-e944-400e-83ac-7cb2944d653b None admin] PATH_INFO: `/v3/roles/f47d350de184449f9ce5e84ebe7753da` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:35.418813 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c1e6c-e944-400e-83ac-7cb2944d653b None admin] RBAC: Authorizing `identity:get_role(role_id=f47d350de184449f9ce5e84ebe7753da)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:35.420200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c1e6c-e944-400e-83ac-7cb2944d653b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:35.421541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 554/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:58:35 2022] GET /identity/v3/roles/f47d350de184449f9ce5e84ebe7753da => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:35.427303 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb341b82-d536-459f-af91-df8461983f10 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:35.520430 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb341b82-d536-459f-af91-df8461983f10 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:35.552672 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0099d44-edcb-4774-a21a-dcec3b5e279a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:35.553530 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0099d44-edcb-4774-a21a-dcec3b5e279a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:35.553812 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0099d44-edcb-4774-a21a-dcec3b5e279a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:35.554086 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0099d44-edcb-4774-a21a-dcec3b5e279a None admin] PATH_INFO: `/v3/users/380c7eef804742638c688c2b3ade723c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:35.555520 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0099d44-edcb-4774-a21a-dcec3b5e279a None admin] RBAC: Authorizing `identity:get_user(user_id=380c7eef804742638c688c2b3ade723c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:35.556958 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0099d44-edcb-4774-a21a-dcec3b5e279a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:35.558553 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 573/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:58:35 2022] GET /identity/v3/users/380c7eef804742638c688c2b3ade723c => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:35.564299 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c1e6c-e944-400e-83ac-7cb2944d653b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:35.660412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c1e6c-e944-400e-83ac-7cb2944d653b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:35.691909 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe8fd4-af38-4ccb-a752-a7a1ca91395b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:35.692543 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe8fd4-af38-4ccb-a752-a7a1ca91395b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:35.692820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe8fd4-af38-4ccb-a752-a7a1ca91395b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:35.693093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe8fd4-af38-4ccb-a752-a7a1ca91395b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:35.755102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe8fd4-af38-4ccb-a752-a7a1ca91395b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:35.756584 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe8fd4-af38-4ccb-a752-a7a1ca91395b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:35.847409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 555/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:58:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 16:58:35.853291 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0099d44-edcb-4774-a21a-dcec3b5e279a None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:35.945984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0099d44-edcb-4774-a21a-dcec3b5e279a None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:35.977451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abcbc0-e21e-4449-915f-24e21dbfd134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:35.978282 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abcbc0-e21e-4449-915f-24e21dbfd134 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:35.978554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abcbc0-e21e-4449-915f-24e21dbfd134 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:35.978819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abcbc0-e21e-4449-915f-24e21dbfd134 None admin] PATH_INFO: `/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:35.979983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abcbc0-e21e-4449-915f-24e21dbfd134 None admin] RBAC: Authorizing `identity:get_project(project_id=9c882a32c3c54dea8092c86b4bfd2f0d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:35.981403 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abcbc0-e21e-4449-915f-24e21dbfd134 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:35.983033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 574/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:58:35 2022] GET /identity/v3/projects/9c882a32c3c54dea8092c86b4bfd2f0d => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:35.989016 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe8fd4-af38-4ccb-a752-a7a1ca91395b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:36.082889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe8fd4-af38-4ccb-a752-a7a1ca91395b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:36.114891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aebc2-eefc-4ec1-9faf-d2af934155fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:36.115541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aebc2-eefc-4ec1-9faf-d2af934155fc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:36.115851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aebc2-eefc-4ec1-9faf-d2af934155fc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:36.116125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aebc2-eefc-4ec1-9faf-d2af934155fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:36.117558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aebc2-eefc-4ec1-9faf-d2af934155fc None admin] RBAC: Adding query filter params (role.id=f47d350de184449f9ce5e84ebe7753da, scope.project.id=9c882a32c3c54dea8092c86b4bfd2f0d, user.id=380c7eef804742638c688c2b3ade723c) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:36.117868 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aebc2-eefc-4ec1-9faf-d2af934155fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:36.119286 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aebc2-eefc-4ec1-9faf-d2af934155fc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:36.124846 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 556/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:58:35 2022] GET /identity/v3/role_assignments?user.id=380c7eef804742638c688c2b3ade723c&scope.project.id=9c882a32c3c54dea8092c86b4bfd2f0d&role.id=f47d350de184449f9ce5e84ebe7753da => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:38.338510 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b1f3d-b9df-4f5c-ab97-d003e380c032 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:38.339041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b1f3d-b9df-4f5c-ab97-d003e380c032 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:38.339041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b1f3d-b9df-4f5c-ab97-d003e380c032 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:38.340455 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 575/1131] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:38.345758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b363dc2-cbed-40f6-8247-954bfb01002a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:38.346176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b363dc2-cbed-40f6-8247-954bfb01002a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:38.346279 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b363dc2-cbed-40f6-8247-954bfb01002a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:38.362666 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6b363dc2-cbed-40f6-8247-954bfb01002a None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:38.363874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6b363dc2-cbed-40f6-8247-954bfb01002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:38.426167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 557/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:38.449658 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b1f3d-b9df-4f5c-ab97-d003e380c032 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:38.542869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b1f3d-b9df-4f5c-ab97-d003e380c032 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:38.574391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebf427-f392-4f0d-80ac-c209af226524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:38.575153 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebf427-f392-4f0d-80ac-c209af226524 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:38.575429 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebf427-f392-4f0d-80ac-c209af226524 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:38.575724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebf427-f392-4f0d-80ac-c209af226524 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:38.576868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebf427-f392-4f0d-80ac-c209af226524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:38.578278 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebf427-f392-4f0d-80ac-c209af226524 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:38.579855 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 576/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:38.585995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b363dc2-cbed-40f6-8247-954bfb01002a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:38.677233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b363dc2-cbed-40f6-8247-954bfb01002a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:38.709890 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da9bca-8018-46b9-ac3f-2d4b18fb8445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:38.711139 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da9bca-8018-46b9-ac3f-2d4b18fb8445 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:38.711417 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da9bca-8018-46b9-ac3f-2d4b18fb8445 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:38.711718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da9bca-8018-46b9-ac3f-2d4b18fb8445 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:38.712409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da9bca-8018-46b9-ac3f-2d4b18fb8445 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:38.713835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da9bca-8018-46b9-ac3f-2d4b18fb8445 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:38.737537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 558/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 16:58:38 2022] POST /identity/v3/projects => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:58:40.962856 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be01b38-4b1d-4ac6-8289-44ce0e262a2e None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:40.963394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be01b38-4b1d-4ac6-8289-44ce0e262a2e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:40.963394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be01b38-4b1d-4ac6-8289-44ce0e262a2e None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:40.964800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 577/1135] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:40.969932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e260f75-1410-46b8-8892-8cb1c63c89ce None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:40.970325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e260f75-1410-46b8-8892-8cb1c63c89ce None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:40.970496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e260f75-1410-46b8-8892-8cb1c63c89ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:40.987251 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8e260f75-1410-46b8-8892-8cb1c63c89ce None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:40.988865 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8e260f75-1410-46b8-8892-8cb1c63c89ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:41.057350 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 559/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:41.082084 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be01b38-4b1d-4ac6-8289-44ce0e262a2e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:41.175578 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be01b38-4b1d-4ac6-8289-44ce0e262a2e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:41.207586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30fa65-bb7f-4504-a840-ad31068867a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:41.208379 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30fa65-bb7f-4504-a840-ad31068867a7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:41.208657 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30fa65-bb7f-4504-a840-ad31068867a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:41.208928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30fa65-bb7f-4504-a840-ad31068867a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:41.210062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30fa65-bb7f-4504-a840-ad31068867a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:41.211492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30fa65-bb7f-4504-a840-ad31068867a7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:41.213134 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 578/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 16:58:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:41.218773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e260f75-1410-46b8-8892-8cb1c63c89ce None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:41.310715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e260f75-1410-46b8-8892-8cb1c63c89ce None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:41.343230 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4126a18-b9ae-4618-ae20-cd75f2c92595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:41.343935 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4126a18-b9ae-4618-ae20-cd75f2c92595 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:41.344218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4126a18-b9ae-4618-ae20-cd75f2c92595 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:41.344493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4126a18-b9ae-4618-ae20-cd75f2c92595 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:41.345197 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4126a18-b9ae-4618-ae20-cd75f2c92595 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:41.346650 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4126a18-b9ae-4618-ae20-cd75f2c92595 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:41.366168 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 560/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:58:41 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:58:43.590581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7ecf3-7602-40ff-8d29-396b2a3f519e None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:43.591124 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7ecf3-7602-40ff-8d29-396b2a3f519e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:43.591124 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7ecf3-7602-40ff-8d29-396b2a3f519e None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:43.592512 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 579/1139] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:43.597715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a562125-792d-4663-b896-519dcccca102 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:43.598155 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a562125-792d-4663-b896-519dcccca102 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:43.598257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a562125-792d-4663-b896-519dcccca102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:43.614817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0a562125-792d-4663-b896-519dcccca102 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:43.616011 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0a562125-792d-4663-b896-519dcccca102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:43.682803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 561/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:43.709524 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7ecf3-7602-40ff-8d29-396b2a3f519e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:43.806298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7ecf3-7602-40ff-8d29-396b2a3f519e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:43.837395 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d438e-8fdf-43de-846c-363aa4c6bf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:43.838173 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d438e-8fdf-43de-846c-363aa4c6bf87 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:43.838454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d438e-8fdf-43de-846c-363aa4c6bf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:43.838728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d438e-8fdf-43de-846c-363aa4c6bf87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:43.848257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d438e-8fdf-43de-846c-363aa4c6bf87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-d11d438e-8fdf-43de-846c-363aa4c6bf87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:58:43.856255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:43.857332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:43.858361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:43.858361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:43.858361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:43.858361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:43.858361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:58:43.858361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:58:43.858361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:58:43.858361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:58:43.858361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:58:43.858361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:58:43.858361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:58:43.858361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:43.858361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 580/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:58:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:43.863651 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a562125-792d-4663-b896-519dcccca102 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:43.955735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a562125-792d-4663-b896-519dcccca102 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:43.987978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeda55-2674-48d3-9933-964690ea7c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:43.988626 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeda55-2674-48d3-9933-964690ea7c9d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:43.988908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeda55-2674-48d3-9933-964690ea7c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:43.989180 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeda55-2674-48d3-9933-964690ea7c9d None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:43.989912 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baeda55-2674-48d3-9933-964690ea7c9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:43.990216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baeda55-2674-48d3-9933-964690ea7c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:43.991671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baeda55-2674-48d3-9933-964690ea7c9d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:43.999499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 562/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:58:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:44.005051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d438e-8fdf-43de-846c-363aa4c6bf87 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:44.098516 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d438e-8fdf-43de-846c-363aa4c6bf87 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:44.129901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb941c73-cbbd-426d-ba71-2fd8575c4ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:44.130763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb941c73-cbbd-426d-ba71-2fd8575c4ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:44.131040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb941c73-cbbd-426d-ba71-2fd8575c4ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:44.131319 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb941c73-cbbd-426d-ba71-2fd8575c4ac9 None admin] PATH_INFO: `/v3/users/2d70c7b365634496bdec2b1b805bd287` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:44.144032 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb941c73-cbbd-426d-ba71-2fd8575c4ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=2d70c7b365634496bdec2b1b805bd287)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:44.145455 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb941c73-cbbd-426d-ba71-2fd8575c4ac9 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:44.147085 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 581/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:58:44 2022] GET /identity/v3/users/2d70c7b365634496bdec2b1b805bd287 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:44.153321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeda55-2674-48d3-9933-964690ea7c9d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:44.246526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeda55-2674-48d3-9933-964690ea7c9d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:44.278205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb35ddb-aaff-40d5-9476-592a5327e144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:44.278840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb35ddb-aaff-40d5-9476-592a5327e144 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:44.279121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb35ddb-aaff-40d5-9476-592a5327e144 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:44.279392 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb35ddb-aaff-40d5-9476-592a5327e144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:44.342658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb35ddb-aaff-40d5-9476-592a5327e144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:44.344281 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb35ddb-aaff-40d5-9476-592a5327e144 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:44.434465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 563/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:58:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 16:58:44.440489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb941c73-cbbd-426d-ba71-2fd8575c4ac9 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:44.533037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb941c73-cbbd-426d-ba71-2fd8575c4ac9 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:44.564519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ddc04-298d-4c8a-a5ce-8bcee8d84438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:44.565355 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ddc04-298d-4c8a-a5ce-8bcee8d84438 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:44.565631 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ddc04-298d-4c8a-a5ce-8bcee8d84438 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:44.565902 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ddc04-298d-4c8a-a5ce-8bcee8d84438 None admin] PATH_INFO: `/v3/projects/9fb1a08e453742cfb1a81db6df3eaf2c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:44.567040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ddc04-298d-4c8a-a5ce-8bcee8d84438 None admin] RBAC: Authorizing `identity:get_project(project_id=9fb1a08e453742cfb1a81db6df3eaf2c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:44.568476 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ddc04-298d-4c8a-a5ce-8bcee8d84438 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:44.570723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 582/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:58:44 2022] GET /identity/v3/projects/9fb1a08e453742cfb1a81db6df3eaf2c => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:44.576737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb35ddb-aaff-40d5-9476-592a5327e144 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:44.668808 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb35ddb-aaff-40d5-9476-592a5327e144 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:44.702506 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7b5e3-7e7f-4616-b0b9-c5764e35565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:44.703083 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7b5e3-7e7f-4616-b0b9-c5764e35565d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:44.703363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7b5e3-7e7f-4616-b0b9-c5764e35565d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:44.703660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7b5e3-7e7f-4616-b0b9-c5764e35565d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:44.704471 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7b5e3-7e7f-4616-b0b9-c5764e35565d None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=9fb1a08e453742cfb1a81db6df3eaf2c, user.id=2d70c7b365634496bdec2b1b805bd287) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:44.704780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7b5e3-7e7f-4616-b0b9-c5764e35565d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:44.706212 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7b5e3-7e7f-4616-b0b9-c5764e35565d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:44.711617 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 564/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:58:44 2022] GET /identity/v3/role_assignments?user.id=2d70c7b365634496bdec2b1b805bd287&scope.project.id=9fb1a08e453742cfb1a81db6df3eaf2c&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:46.884643 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a328696-5d01-4bc8-8550-4e3f8cbcd80a None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:46.885184 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a328696-5d01-4bc8-8550-4e3f8cbcd80a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:46.885184 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a328696-5d01-4bc8-8550-4e3f8cbcd80a None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:46.886549 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 583/1147] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:46.891645 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4439a-4ce0-410d-a418-ab9686cebea0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:46.892090 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4439a-4ce0-410d-a418-ab9686cebea0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:46.892184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4439a-4ce0-410d-a418-ab9686cebea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:46.908803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-33f4439a-4ce0-410d-a418-ab9686cebea0 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:46.909945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-33f4439a-4ce0-410d-a418-ab9686cebea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:46.974653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 565/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:46.997632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a328696-5d01-4bc8-8550-4e3f8cbcd80a None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:47.093494 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a328696-5d01-4bc8-8550-4e3f8cbcd80a None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:47.125093 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8cc9a-5fb7-4219-b38e-8e8acef027de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:47.125872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8cc9a-5fb7-4219-b38e-8e8acef027de None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:47.126151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8cc9a-5fb7-4219-b38e-8e8acef027de None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:47.126431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8cc9a-5fb7-4219-b38e-8e8acef027de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:47.136193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8cc9a-5fb7-4219-b38e-8e8acef027de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-a3d8cc9a-5fb7-4219-b38e-8e8acef027de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:58:47.143595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:47.144729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:47.145765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:47.145765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:47.145765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:47.145765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:47.145765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:58:47.145765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:58:47.145765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:58:47.145765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:58:47.145765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:58:47.145765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:58:47.145765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:58:47.145765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:47.145765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 584/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:58:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:47.151210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4439a-4ce0-410d-a418-ab9686cebea0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:47.243762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4439a-4ce0-410d-a418-ab9686cebea0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:47.276582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7251b8e-a136-4ba9-813c-b201ec97cfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:47.277229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7251b8e-a136-4ba9-813c-b201ec97cfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:47.277509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7251b8e-a136-4ba9-813c-b201ec97cfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:47.277781 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7251b8e-a136-4ba9-813c-b201ec97cfc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:47.278511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7251b8e-a136-4ba9-813c-b201ec97cfc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:47.278817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7251b8e-a136-4ba9-813c-b201ec97cfc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:47.280211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7251b8e-a136-4ba9-813c-b201ec97cfc9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:47.288049 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 566/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:58:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:47.294435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8cc9a-5fb7-4219-b38e-8e8acef027de None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:47.404069 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8cc9a-5fb7-4219-b38e-8e8acef027de None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:47.439524 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72901783-0768-4de4-84a5-70cc2a723468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:47.440413 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72901783-0768-4de4-84a5-70cc2a723468 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:47.440693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72901783-0768-4de4-84a5-70cc2a723468 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:47.440964 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72901783-0768-4de4-84a5-70cc2a723468 None admin] PATH_INFO: `/v3/users/2d70c7b365634496bdec2b1b805bd287` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:47.442144 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72901783-0768-4de4-84a5-70cc2a723468 None admin] RBAC: Authorizing `identity:get_user(user_id=2d70c7b365634496bdec2b1b805bd287)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:47.443569 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72901783-0768-4de4-84a5-70cc2a723468 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:47.446059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 585/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:58:47 2022] GET /identity/v3/users/2d70c7b365634496bdec2b1b805bd287 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:47.451950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7251b8e-a136-4ba9-813c-b201ec97cfc9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:47.544132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7251b8e-a136-4ba9-813c-b201ec97cfc9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:47.576080 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d44d7-bcbb-48a2-81b5-628a2c37e7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:47.576924 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d44d7-bcbb-48a2-81b5-628a2c37e7ae None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:47.577199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d44d7-bcbb-48a2-81b5-628a2c37e7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:47.577465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d44d7-bcbb-48a2-81b5-628a2c37e7ae None admin] PATH_INFO: `/v3/projects/9fb1a08e453742cfb1a81db6df3eaf2c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:47.578619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d44d7-bcbb-48a2-81b5-628a2c37e7ae None admin] RBAC: Authorizing `identity:get_project(project_id=9fb1a08e453742cfb1a81db6df3eaf2c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:47.580076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d44d7-bcbb-48a2-81b5-628a2c37e7ae None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:47.581723 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 567/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:58:47 2022] GET /identity/v3/projects/9fb1a08e453742cfb1a81db6df3eaf2c => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:47.588268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72901783-0768-4de4-84a5-70cc2a723468 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:47.680981 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72901783-0768-4de4-84a5-70cc2a723468 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:47.713438 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549c3cb-8601-48b5-bc74-22a930f13eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:47.714329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549c3cb-8601-48b5-bc74-22a930f13eef None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:47.714607 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549c3cb-8601-48b5-bc74-22a930f13eef None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:47.714879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549c3cb-8601-48b5-bc74-22a930f13eef None admin] PATH_INFO: `/v3/projects/9fb1a08e453742cfb1a81db6df3eaf2c/users/2d70c7b365634496bdec2b1b805bd287/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:47.716891 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549c3cb-8601-48b5-bc74-22a930f13eef None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb1a08e453742cfb1a81db6df3eaf2c, user_id=2d70c7b365634496bdec2b1b805bd287, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:47.718366 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549c3cb-8601-48b5-bc74-22a930f13eef None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:47.731649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 586/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:58:47 2022] PUT /identity/v3/projects/9fb1a08e453742cfb1a81db6df3eaf2c/users/2d70c7b365634496bdec2b1b805bd287/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:58:49.899138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72404c6f-825a-4ed5-a97b-8a0762030b72 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:49.899692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72404c6f-825a-4ed5-a97b-8a0762030b72 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:49.899692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72404c6f-825a-4ed5-a97b-8a0762030b72 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:49.901078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 568/1154] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:49.906303 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f453a7-304e-4691-8d5e-78d7a9001f6b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:49.906699 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f453a7-304e-4691-8d5e-78d7a9001f6b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:49.906852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f453a7-304e-4691-8d5e-78d7a9001f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:49.923766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e9f453a7-304e-4691-8d5e-78d7a9001f6b None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:49.924934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e9f453a7-304e-4691-8d5e-78d7a9001f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:49.986056 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 587/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:50.009086 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72404c6f-825a-4ed5-a97b-8a0762030b72 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:50.104853 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72404c6f-825a-4ed5-a97b-8a0762030b72 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:50.136263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f179d6f-db40-42e6-8a32-635589c8023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:50.137046 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f179d6f-db40-42e6-8a32-635589c8023c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:50.137326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f179d6f-db40-42e6-8a32-635589c8023c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:50.137599 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f179d6f-db40-42e6-8a32-635589c8023c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:50.147146 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f179d6f-db40-42e6-8a32-635589c8023c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6f179d6f-db40-42e6-8a32-635589c8023c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:58:50.155404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:50.156498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:50.157377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:50.157377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:50.157377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:50.157377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:50.157377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:58:50.157377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:58:50.157377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:58:50.157377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:58:50.157377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:58:50.157377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:58:50.157377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:58:50.157377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:58:50.157377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 569/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:58:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:50.162582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f453a7-304e-4691-8d5e-78d7a9001f6b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:50.256446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f453a7-304e-4691-8d5e-78d7a9001f6b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:50.288515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b114d-6976-433d-a3a6-d5e176a9b01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:50.289166 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b114d-6976-433d-a3a6-d5e176a9b01f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:50.289473 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b114d-6976-433d-a3a6-d5e176a9b01f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:50.289845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b114d-6976-433d-a3a6-d5e176a9b01f None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:50.290580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b114d-6976-433d-a3a6-d5e176a9b01f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:50.290877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b114d-6976-433d-a3a6-d5e176a9b01f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:50.292261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b114d-6976-433d-a3a6-d5e176a9b01f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:50.299836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 588/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:58:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:50.305626 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f179d6f-db40-42e6-8a32-635589c8023c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:50.397869 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f179d6f-db40-42e6-8a32-635589c8023c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:50.429343 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555fdb9-bc35-4456-806a-45ac3f3a2c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:50.430214 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555fdb9-bc35-4456-806a-45ac3f3a2c34 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:50.430591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555fdb9-bc35-4456-806a-45ac3f3a2c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:50.430858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555fdb9-bc35-4456-806a-45ac3f3a2c34 None admin] PATH_INFO: `/v3/users/2d70c7b365634496bdec2b1b805bd287` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:50.432038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555fdb9-bc35-4456-806a-45ac3f3a2c34 None admin] RBAC: Authorizing `identity:get_user(user_id=2d70c7b365634496bdec2b1b805bd287)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:50.433460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555fdb9-bc35-4456-806a-45ac3f3a2c34 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:50.435040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 570/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:58:50 2022] GET /identity/v3/users/2d70c7b365634496bdec2b1b805bd287 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:50.440844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b114d-6976-433d-a3a6-d5e176a9b01f None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:50.534719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b114d-6976-433d-a3a6-d5e176a9b01f None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:50.565715 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03e95f-43a4-4f85-af85-35f890e92608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:50.566424 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03e95f-43a4-4f85-af85-35f890e92608 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:50.566712 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03e95f-43a4-4f85-af85-35f890e92608 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:50.566987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03e95f-43a4-4f85-af85-35f890e92608 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:50.630824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03e95f-43a4-4f85-af85-35f890e92608 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:50.632285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03e95f-43a4-4f85-af85-35f890e92608 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:50.724321 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 589/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:58:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 16:58:50.730038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555fdb9-bc35-4456-806a-45ac3f3a2c34 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:50.823224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555fdb9-bc35-4456-806a-45ac3f3a2c34 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:50.853563 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0c97c-10a4-4462-bfff-279a1c8d87af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:50.854401 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0c97c-10a4-4462-bfff-279a1c8d87af None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:50.854676 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0c97c-10a4-4462-bfff-279a1c8d87af None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:50.854942 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0c97c-10a4-4462-bfff-279a1c8d87af None admin] PATH_INFO: `/v3/projects/9fb1a08e453742cfb1a81db6df3eaf2c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:50.856113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0c97c-10a4-4462-bfff-279a1c8d87af None admin] RBAC: Authorizing `identity:get_project(project_id=9fb1a08e453742cfb1a81db6df3eaf2c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:50.857525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0c97c-10a4-4462-bfff-279a1c8d87af None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:50.859155 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 571/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:58:50 2022] GET /identity/v3/projects/9fb1a08e453742cfb1a81db6df3eaf2c => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:50.864995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03e95f-43a4-4f85-af85-35f890e92608 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:50.957123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03e95f-43a4-4f85-af85-35f890e92608 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:50.988447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1059f5b-bd17-480f-918c-d2259c724eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:50.989021 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1059f5b-bd17-480f-918c-d2259c724eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:50.989296 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1059f5b-bd17-480f-918c-d2259c724eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:50.989564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1059f5b-bd17-480f-918c-d2259c724eb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:50.990364 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1059f5b-bd17-480f-918c-d2259c724eb4 None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=9fb1a08e453742cfb1a81db6df3eaf2c, user.id=2d70c7b365634496bdec2b1b805bd287) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:50.990668 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1059f5b-bd17-480f-918c-d2259c724eb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:50.992107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1059f5b-bd17-480f-918c-d2259c724eb4 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:50.998241 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 590/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:58:50 2022] GET /identity/v3/role_assignments?user.id=2d70c7b365634496bdec2b1b805bd287&scope.project.id=9fb1a08e453742cfb1a81db6df3eaf2c&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:53.209241 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6cf60-f39f-4f6d-8275-b323c842de21 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:53.209797 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6cf60-f39f-4f6d-8275-b323c842de21 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:53.209797 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6cf60-f39f-4f6d-8275-b323c842de21 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:53.211205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 572/1162] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:53.216551 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362434-5bbf-4d45-8b70-4d7e4caa7752 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:53.216973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362434-5bbf-4d45-8b70-4d7e4caa7752 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:53.217112 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362434-5bbf-4d45-8b70-4d7e4caa7752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:53.233745 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-15362434-5bbf-4d45-8b70-4d7e4caa7752 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:53.234899 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-15362434-5bbf-4d45-8b70-4d7e4caa7752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:53.296601 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 591/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:53.319261 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6cf60-f39f-4f6d-8275-b323c842de21 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:53.419867 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6cf60-f39f-4f6d-8275-b323c842de21 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:53.451776 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70200259-5590-4370-b6de-e44a04cfde85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:53.452408 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70200259-5590-4370-b6de-e44a04cfde85 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:53.452688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70200259-5590-4370-b6de-e44a04cfde85 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:53.452958 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70200259-5590-4370-b6de-e44a04cfde85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:53.514390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70200259-5590-4370-b6de-e44a04cfde85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:53.515844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70200259-5590-4370-b6de-e44a04cfde85 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:53.605326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 573/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:58:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 16:58:53.611351 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15362434-5bbf-4d45-8b70-4d7e4caa7752 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:53.703184 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15362434-5bbf-4d45-8b70-4d7e4caa7752 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:53.735758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a62ea-7d45-46c7-ab43-2c4059bdb19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:53.736548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a62ea-7d45-46c7-ab43-2c4059bdb19d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:53.736825 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a62ea-7d45-46c7-ab43-2c4059bdb19d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:53.737095 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a62ea-7d45-46c7-ab43-2c4059bdb19d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:53.743457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a62ea-7d45-46c7-ab43-2c4059bdb19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:53.744895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a62ea-7d45-46c7-ab43-2c4059bdb19d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-537a62ea-7d45-46c7-ab43-2c4059bdb19d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:58:53.758636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:58:53.760028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:58:53.761107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:58:53.761107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:58:53.761107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:58:53.761107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:58:53.761107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:58:53.761107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:58:53.761107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:58:53.761107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:58:53.761107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:58:53.761107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:58:53.761107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 17 16:58:53.761107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 16:58:53.761107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 17 16:58:53.761107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:58:53.761107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 592/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 16:58:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:58:53.765786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70200259-5590-4370-b6de-e44a04cfde85 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:53.859009 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70200259-5590-4370-b6de-e44a04cfde85 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:53.891485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816eefe-2943-4eb2-a8d2-f34a0f2c3b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:53.892161 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816eefe-2943-4eb2-a8d2-f34a0f2c3b09 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:53.892444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816eefe-2943-4eb2-a8d2-f34a0f2c3b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:53.892719 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816eefe-2943-4eb2-a8d2-f34a0f2c3b09 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:53.893434 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816eefe-2943-4eb2-a8d2-f34a0f2c3b09 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:58:53.893740 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816eefe-2943-4eb2-a8d2-f34a0f2c3b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:53.895105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816eefe-2943-4eb2-a8d2-f34a0f2c3b09 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:53.902106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 574/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 17 16:58:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:56.080092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf974f-1db5-4eb7-be03-d31ec0443be3 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:56.080626 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf974f-1db5-4eb7-be03-d31ec0443be3 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:56.080626 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf974f-1db5-4eb7-be03-d31ec0443be3 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:56.081990 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 593/1167] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:56.087661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a84d4-9733-4873-adbf-d78c7b5392f7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:56.088114 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a84d4-9733-4873-adbf-d78c7b5392f7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:56.088215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a84d4-9733-4873-adbf-d78c7b5392f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:56.105218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1d7a84d4-9733-4873-adbf-d78c7b5392f7 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:56.106377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1d7a84d4-9733-4873-adbf-d78c7b5392f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:56.169267 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 575/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:56.192045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf974f-1db5-4eb7-be03-d31ec0443be3 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:56.288160 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf974f-1db5-4eb7-be03-d31ec0443be3 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:56.319555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16739651-dcfe-446f-b3a4-951e4d2a87ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:56.320233 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16739651-dcfe-446f-b3a4-951e4d2a87ad None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:56.321183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16739651-dcfe-446f-b3a4-951e4d2a87ad None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:56.321473 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16739651-dcfe-446f-b3a4-951e4d2a87ad None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:56.322204 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16739651-dcfe-446f-b3a4-951e4d2a87ad None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:56.323564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16739651-dcfe-446f-b3a4-951e4d2a87ad None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:56.338410 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 594/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Tue May 17 16:58:56 2022] POST /identity/v3/domains => generated 267 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:58:58.568621 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165a4cc-f7c1-43e8-b7f8-a7c5f6f350a3 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:58.569166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165a4cc-f7c1-43e8-b7f8-a7c5f6f350a3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:58.569166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165a4cc-f7c1-43e8-b7f8-a7c5f6f350a3 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:58.571030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 576/1170] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:58:58.576476 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803553b-405d-4e5d-892a-e8915d659ed5 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:58.576914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803553b-405d-4e5d-892a-e8915d659ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:58.577033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803553b-405d-4e5d-892a-e8915d659ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:58.593732 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-9803553b-405d-4e5d-892a-e8915d659ed5 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:58:58.594887 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9803553b-405d-4e5d-892a-e8915d659ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:58:58.657792 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 595/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:58:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:58:58.681183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165a4cc-f7c1-43e8-b7f8-a7c5f6f350a3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:58.777383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165a4cc-f7c1-43e8-b7f8-a7c5f6f350a3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:58.808707 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a1e5a-b9b7-4bda-8c5e-19a38cc304f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:58.809553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1e5a-b9b7-4bda-8c5e-19a38cc304f7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:58.809830 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1e5a-b9b7-4bda-8c5e-19a38cc304f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:58.810100 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1e5a-b9b7-4bda-8c5e-19a38cc304f7 None admin] PATH_INFO: `/v3/domains/3b6bd6c2ed7e42ccb4759f2b0cd8af48` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:58.820729 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a1e5a-b9b7-4bda-8c5e-19a38cc304f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3b6bd6c2ed7e42ccb4759f2b0cd8af48)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:58.822326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a1e5a-b9b7-4bda-8c5e-19a38cc304f7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:58.823972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 577/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Tue May 17 16:58:58 2022] GET /identity/v3/domains/3b6bd6c2ed7e42ccb4759f2b0cd8af48 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:58:58.829760 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803553b-405d-4e5d-892a-e8915d659ed5 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:58:58.919975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803553b-405d-4e5d-892a-e8915d659ed5 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:58:58.951454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c50a3c-d1dd-4612-8c9f-20ec9f67ed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:58:58.952113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c50a3c-d1dd-4612-8c9f-20ec9f67ed40 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:58:58.952392 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c50a3c-d1dd-4612-8c9f-20ec9f67ed40 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:58:58.952664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c50a3c-d1dd-4612-8c9f-20ec9f67ed40 None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:58:58.953350 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c50a3c-d1dd-4612-8c9f-20ec9f67ed40 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:58:58.954753 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c50a3c-d1dd-4612-8c9f-20ec9f67ed40 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:58:58.979802 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 596/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 16:58:58 2022] POST /identity/v3/projects => generated 361 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:59:01.213384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91cd21-53f1-43de-a579-868268328f76 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:01.213920 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91cd21-53f1-43de-a579-868268328f76 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:01.213920 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91cd21-53f1-43de-a579-868268328f76 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:01.215279 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 578/1174] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:59:01.220441 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dd3f7-deaf-4ea1-a5ba-06f7f6bdf70e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:01.220860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dd3f7-deaf-4ea1-a5ba-06f7f6bdf70e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:01.220989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dd3f7-deaf-4ea1-a5ba-06f7f6bdf70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:01.237673 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4d3dd3f7-deaf-4ea1-a5ba-06f7f6bdf70e None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:59:01.238828 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4d3dd3f7-deaf-4ea1-a5ba-06f7f6bdf70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:59:01.300871 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 597/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:59:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 16:59:01.326222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91cd21-53f1-43de-a579-868268328f76 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:01.423369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91cd21-53f1-43de-a579-868268328f76 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:01.454255 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c5706-396c-475e-a5c5-690ab9b598e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:01.455096 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c5706-396c-475e-a5c5-690ab9b598e6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:01.455372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c5706-396c-475e-a5c5-690ab9b598e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:01.455664 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c5706-396c-475e-a5c5-690ab9b598e6 None admin] PATH_INFO: `/v3/domains/3b6bd6c2ed7e42ccb4759f2b0cd8af48` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:01.456806 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c5706-396c-475e-a5c5-690ab9b598e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3b6bd6c2ed7e42ccb4759f2b0cd8af48)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:01.458218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c5706-396c-475e-a5c5-690ab9b598e6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:01.459827 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 579/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Tue May 17 16:59:01 2022] GET /identity/v3/domains/3b6bd6c2ed7e42ccb4759f2b0cd8af48 => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:59:01.466126 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3dd3f7-deaf-4ea1-a5ba-06f7f6bdf70e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:01.558119 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3dd3f7-deaf-4ea1-a5ba-06f7f6bdf70e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:01.590067 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd76fe3-53e7-4aad-9ae1-152cb50729c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:01.590717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd76fe3-53e7-4aad-9ae1-152cb50729c0 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:01.590995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd76fe3-53e7-4aad-9ae1-152cb50729c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:01.591267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd76fe3-53e7-4aad-9ae1-152cb50729c0 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:01.592048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd76fe3-53e7-4aad-9ae1-152cb50729c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:01.593451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd76fe3-53e7-4aad-9ae1-152cb50729c0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:01.611841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 598/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 16:59:01 2022] POST /identity/v3/users => generated 311 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 16:59:03.858029 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5fc72-140c-46e3-ae7c-e93da37ac637 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:03.858581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5fc72-140c-46e3-ae7c-e93da37ac637 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:03.858581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5fc72-140c-46e3-ae7c-e93da37ac637 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:03.859994 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 580/1178] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:59:03.865226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c1a4-fd75-432b-950f-ca8ef939056a None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:03.865663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c1a4-fd75-432b-950f-ca8ef939056a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:03.865784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c1a4-fd75-432b-950f-ca8ef939056a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:03.882549 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c588c1a4-fd75-432b-950f-ca8ef939056a None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:59:03.883724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c588c1a4-fd75-432b-950f-ca8ef939056a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:59:03.945646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 599/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:59:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:59:03.968541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5fc72-140c-46e3-ae7c-e93da37ac637 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:04.063279 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5fc72-140c-46e3-ae7c-e93da37ac637 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:04.094161 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed966ea2-9060-47c3-83bf-eed33fd4c7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:04.094951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966ea2-9060-47c3-83bf-eed33fd4c7af None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:04.095228 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966ea2-9060-47c3-83bf-eed33fd4c7af None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:04.095499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966ea2-9060-47c3-83bf-eed33fd4c7af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:04.105817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed966ea2-9060-47c3-83bf-eed33fd4c7af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ed966ea2-9060-47c3-83bf-eed33fd4c7af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:59:04.113403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:59:04.114502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:59:04.115541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:59:04.115541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:59:04.115541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:59:04.115541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:59:04.115541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:59:04.115541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:59:04.115541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:59:04.115541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:59:04.115541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:59:04.115541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:59:04.115541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:59:04.115541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:59:04.115541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 581/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:59:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:59:04.120998 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588c1a4-fd75-432b-950f-ca8ef939056a None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:04.212281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588c1a4-fd75-432b-950f-ca8ef939056a None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:04.243483 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fa8ee-f2eb-42bd-ba82-434c7e129dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:04.244221 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fa8ee-f2eb-42bd-ba82-434c7e129dde None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:04.244448 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fa8ee-f2eb-42bd-ba82-434c7e129dde None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:04.244808 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fa8ee-f2eb-42bd-ba82-434c7e129dde None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:04.245588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fa8ee-f2eb-42bd-ba82-434c7e129dde None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:59:04.245963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fa8ee-f2eb-42bd-ba82-434c7e129dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:04.247543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fa8ee-f2eb-42bd-ba82-434c7e129dde None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:04.255409 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 600/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:59:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:59:04.261436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed966ea2-9060-47c3-83bf-eed33fd4c7af None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:04.355047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed966ea2-9060-47c3-83bf-eed33fd4c7af None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:04.385328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3270148-fecc-4511-a75e-ca5aff6f55c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:04.386114 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3270148-fecc-4511-a75e-ca5aff6f55c1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:04.386388 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3270148-fecc-4511-a75e-ca5aff6f55c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:04.386656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3270148-fecc-4511-a75e-ca5aff6f55c1 None admin] PATH_INFO: `/v3/users/e1f5592fce9a4b028b08fee0d5c39b8f` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:04.399237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3270148-fecc-4511-a75e-ca5aff6f55c1 None admin] RBAC: Authorizing `identity:get_user(user_id=e1f5592fce9a4b028b08fee0d5c39b8f)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:04.400681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3270148-fecc-4511-a75e-ca5aff6f55c1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:04.402275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 582/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:59:04 2022] GET /identity/v3/users/e1f5592fce9a4b028b08fee0d5c39b8f => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:59:04.407838 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fa8ee-f2eb-42bd-ba82-434c7e129dde None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:04.500948 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fa8ee-f2eb-42bd-ba82-434c7e129dde None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:04.532486 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1cef8-9e55-4fff-a30a-f2722357a141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:04.533105 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1cef8-9e55-4fff-a30a-f2722357a141 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:04.533382 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1cef8-9e55-4fff-a30a-f2722357a141 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:04.533652 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1cef8-9e55-4fff-a30a-f2722357a141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:04.595437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1cef8-9e55-4fff-a30a-f2722357a141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:04.596892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1cef8-9e55-4fff-a30a-f2722357a141 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:04.685906 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 601/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:59:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 16:59:04.691905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3270148-fecc-4511-a75e-ca5aff6f55c1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:04.785474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3270148-fecc-4511-a75e-ca5aff6f55c1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:04.817489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08899d-ebaa-45a5-b136-faf9d5fcdb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:04.818332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08899d-ebaa-45a5-b136-faf9d5fcdb0a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:04.818606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08899d-ebaa-45a5-b136-faf9d5fcdb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:04.818871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08899d-ebaa-45a5-b136-faf9d5fcdb0a None admin] PATH_INFO: `/v3/projects/fe58366f33c34876a9ce7a3927f1a675` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:04.820620 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08899d-ebaa-45a5-b136-faf9d5fcdb0a None admin] RBAC: Authorizing `identity:get_project(project_id=fe58366f33c34876a9ce7a3927f1a675)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:04.821967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08899d-ebaa-45a5-b136-faf9d5fcdb0a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:04.823661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 583/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:59:04 2022] GET /identity/v3/projects/fe58366f33c34876a9ce7a3927f1a675 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:59:04.829463 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1cef8-9e55-4fff-a30a-f2722357a141 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:04.922346 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1cef8-9e55-4fff-a30a-f2722357a141 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:04.954154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ad72a-7e06-4bfc-870a-0e7df84c4ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:04.954726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ad72a-7e06-4bfc-870a-0e7df84c4ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:04.955002 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ad72a-7e06-4bfc-870a-0e7df84c4ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:04.955270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ad72a-7e06-4bfc-870a-0e7df84c4ec7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:04.956104 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ad72a-7e06-4bfc-870a-0e7df84c4ec7 None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=fe58366f33c34876a9ce7a3927f1a675, user.id=e1f5592fce9a4b028b08fee0d5c39b8f) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:59:04.956412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ad72a-7e06-4bfc-870a-0e7df84c4ec7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:04.957816 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ad72a-7e06-4bfc-870a-0e7df84c4ec7 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:04.963569 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 602/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:59:04 2022] GET /identity/v3/role_assignments?user.id=e1f5592fce9a4b028b08fee0d5c39b8f&scope.project.id=fe58366f33c34876a9ce7a3927f1a675&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:59:07.135748 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388620-d991-4cb8-b5b2-94effe9005cb None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:07.136220 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388620-d991-4cb8-b5b2-94effe9005cb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:07.136311 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388620-d991-4cb8-b5b2-94effe9005cb None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:07.137655 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 584/1186] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:59:07.142771 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6de07-5223-4b72-a415-cc5f8743856d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:07.143158 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6de07-5223-4b72-a415-cc5f8743856d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:07.143320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6de07-5223-4b72-a415-cc5f8743856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:07.159853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e1e6de07-5223-4b72-a415-cc5f8743856d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:59:07.161002 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e1e6de07-5223-4b72-a415-cc5f8743856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:59:07.240911 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 603/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:59:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:59:07.264057 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6388620-d991-4cb8-b5b2-94effe9005cb None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:07.367411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6388620-d991-4cb8-b5b2-94effe9005cb None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:07.401245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3d21e-e741-4146-afab-2ae75b39d8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:07.402035 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3d21e-e741-4146-afab-2ae75b39d8cf None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:07.402313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3d21e-e741-4146-afab-2ae75b39d8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:07.402586 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3d21e-e741-4146-afab-2ae75b39d8cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:07.413238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3d21e-e741-4146-afab-2ae75b39d8cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-02f3d21e-e741-4146-afab-2ae75b39d8cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:59:07.421481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:59:07.422616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:59:07.423511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:59:07.423511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 16:59:07.423511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:59:07.423511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 16:59:07.423511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:59:07.423511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:59:07.423511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:59:07.423511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:59:07.423511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:59:07.423511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:59:07.423511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:59:07.423511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 16:59:07.423511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 585/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:59:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:59:07.428983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6de07-5223-4b72-a415-cc5f8743856d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:07.535548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6de07-5223-4b72-a415-cc5f8743856d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:07.571295 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930663f-6410-4f23-bc70-adf065ac35ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:07.571984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930663f-6410-4f23-bc70-adf065ac35ff None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:07.572344 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930663f-6410-4f23-bc70-adf065ac35ff None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:07.572681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930663f-6410-4f23-bc70-adf065ac35ff None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:07.573433 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930663f-6410-4f23-bc70-adf065ac35ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:59:07.573740 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930663f-6410-4f23-bc70-adf065ac35ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:07.575163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930663f-6410-4f23-bc70-adf065ac35ff None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:07.583478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 604/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:59:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:59:07.590714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3d21e-e741-4146-afab-2ae75b39d8cf None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:07.696278 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3d21e-e741-4146-afab-2ae75b39d8cf None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:07.732580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02476ddf-f792-4d36-bf70-ca1a968d3aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:07.733442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02476ddf-f792-4d36-bf70-ca1a968d3aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:07.733716 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02476ddf-f792-4d36-bf70-ca1a968d3aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:07.733983 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02476ddf-f792-4d36-bf70-ca1a968d3aa0 None admin] PATH_INFO: `/v3/users/e1f5592fce9a4b028b08fee0d5c39b8f` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:07.735145 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02476ddf-f792-4d36-bf70-ca1a968d3aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=e1f5592fce9a4b028b08fee0d5c39b8f)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:07.736987 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02476ddf-f792-4d36-bf70-ca1a968d3aa0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:07.738610 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 586/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:59:07 2022] GET /identity/v3/users/e1f5592fce9a4b028b08fee0d5c39b8f => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:59:07.745646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930663f-6410-4f23-bc70-adf065ac35ff None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:07.844281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930663f-6410-4f23-bc70-adf065ac35ff None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:07.876322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acb82f-887e-4975-b47b-8de0a4f4260a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:07.877171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acb82f-887e-4975-b47b-8de0a4f4260a None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:07.877450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acb82f-887e-4975-b47b-8de0a4f4260a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:07.877725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acb82f-887e-4975-b47b-8de0a4f4260a None admin] PATH_INFO: `/v3/projects/fe58366f33c34876a9ce7a3927f1a675` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:07.878889 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acb82f-887e-4975-b47b-8de0a4f4260a None admin] RBAC: Authorizing `identity:get_project(project_id=fe58366f33c34876a9ce7a3927f1a675)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:07.880348 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acb82f-887e-4975-b47b-8de0a4f4260a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:07.882025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 605/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:59:07 2022] GET /identity/v3/projects/fe58366f33c34876a9ce7a3927f1a675 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:59:07.888514 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02476ddf-f792-4d36-bf70-ca1a968d3aa0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:07.981381 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02476ddf-f792-4d36-bf70-ca1a968d3aa0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:08.012821 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b60f7f-9f9d-4a1f-aa1e-becd8486db36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:08.013689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b60f7f-9f9d-4a1f-aa1e-becd8486db36 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:08.013961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b60f7f-9f9d-4a1f-aa1e-becd8486db36 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:08.014225 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b60f7f-9f9d-4a1f-aa1e-becd8486db36 None admin] PATH_INFO: `/v3/projects/fe58366f33c34876a9ce7a3927f1a675/users/e1f5592fce9a4b028b08fee0d5c39b8f/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:08.016151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b60f7f-9f9d-4a1f-aa1e-becd8486db36 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe58366f33c34876a9ce7a3927f1a675, user_id=e1f5592fce9a4b028b08fee0d5c39b8f, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:08.017557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b60f7f-9f9d-4a1f-aa1e-becd8486db36 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:08.030811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 587/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 16:59:07 2022] PUT /identity/v3/projects/fe58366f33c34876a9ce7a3927f1a675/users/e1f5592fce9a4b028b08fee0d5c39b8f/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 16:59:10.209226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f0fa9-8a3c-4782-aeb6-31376e0ce04f None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:10.209728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f0fa9-8a3c-4782-aeb6-31376e0ce04f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:10.209831 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f0fa9-8a3c-4782-aeb6-31376e0ce04f None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:10.211696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 606/1193] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 16:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 16:59:10.217007 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fead4f-06e8-4381-bb0b-4e2244c6c07a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:10.217420 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fead4f-06e8-4381-bb0b-4e2244c6c07a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:10.217557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fead4f-06e8-4381-bb0b-4e2244c6c07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:10.234250 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c9fead4f-06e8-4381-bb0b-4e2244c6c07a None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 16:59:10.235406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c9fead4f-06e8-4381-bb0b-4e2244c6c07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 16:59:10.298388 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 588/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 16:59:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 16:59:10.322125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f0fa9-8a3c-4782-aeb6-31376e0ce04f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:10.418629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f0fa9-8a3c-4782-aeb6-31376e0ce04f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:10.449568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ed42b-22f4-471e-9437-0335a2944d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:10.450335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ed42b-22f4-471e-9437-0335a2944d0c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:10.450614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ed42b-22f4-471e-9437-0335a2944d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:10.450891 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ed42b-22f4-471e-9437-0335a2944d0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:10.461311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ed42b-22f4-471e-9437-0335a2944d0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-7e5ed42b-22f4-471e-9437-0335a2944d0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 16:59:10.468790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 16:59:10.469879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 16:59:10.470782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 16:59:10.470782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 16:59:10.470782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 16:59:10.470782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 16:59:10.470782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 16:59:10.470782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 16:59:10.470782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 16:59:10.470782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 16:59:10.470782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 16:59:10.470782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 16:59:10.470782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 16:59:10.470782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 16:59:10.470782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 607/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 16:59:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 16:59:10.475800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fead4f-06e8-4381-bb0b-4e2244c6c07a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:10.567494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fead4f-06e8-4381-bb0b-4e2244c6c07a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:10.599111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d91afe-2098-425d-9b4a-3a7acb3e9af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:10.599785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d91afe-2098-425d-9b4a-3a7acb3e9af1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:10.600062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d91afe-2098-425d-9b4a-3a7acb3e9af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:10.600327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d91afe-2098-425d-9b4a-3a7acb3e9af1 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:10.601096 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d91afe-2098-425d-9b4a-3a7acb3e9af1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:59:10.601395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d91afe-2098-425d-9b4a-3a7acb3e9af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:10.602740 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d91afe-2098-425d-9b4a-3a7acb3e9af1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:10.610238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 589/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 16:59:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:59:10.615874 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ed42b-22f4-471e-9437-0335a2944d0c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:10.708435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ed42b-22f4-471e-9437-0335a2944d0c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:10.739915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374aee8-deec-4798-ac51-4a0a9d13983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:10.740759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374aee8-deec-4798-ac51-4a0a9d13983d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:10.741040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374aee8-deec-4798-ac51-4a0a9d13983d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:10.741312 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374aee8-deec-4798-ac51-4a0a9d13983d None admin] PATH_INFO: `/v3/users/e1f5592fce9a4b028b08fee0d5c39b8f` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:10.742834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374aee8-deec-4798-ac51-4a0a9d13983d None admin] RBAC: Authorizing `identity:get_user(user_id=e1f5592fce9a4b028b08fee0d5c39b8f)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:10.744390 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374aee8-deec-4798-ac51-4a0a9d13983d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:10.746035 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 608/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 16:59:10 2022] GET /identity/v3/users/e1f5592fce9a4b028b08fee0d5c39b8f => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:59:10.751553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d91afe-2098-425d-9b4a-3a7acb3e9af1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:10.845642 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d91afe-2098-425d-9b4a-3a7acb3e9af1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:10.877114 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac584aa8-4b7a-4925-8f1e-b5ee35761768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:10.877751 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac584aa8-4b7a-4925-8f1e-b5ee35761768 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:10.878042 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac584aa8-4b7a-4925-8f1e-b5ee35761768 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:10.878318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac584aa8-4b7a-4925-8f1e-b5ee35761768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:10.941393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac584aa8-4b7a-4925-8f1e-b5ee35761768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:10.942843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac584aa8-4b7a-4925-8f1e-b5ee35761768 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:11.043368 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 590/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 16:59:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 16:59:11.049190 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374aee8-deec-4798-ac51-4a0a9d13983d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:11.142612 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374aee8-deec-4798-ac51-4a0a9d13983d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:11.173553 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10bd32-2864-4a52-b7e3-dc89f0c0a085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:11.174384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10bd32-2864-4a52-b7e3-dc89f0c0a085 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:11.174661 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10bd32-2864-4a52-b7e3-dc89f0c0a085 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:11.174929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10bd32-2864-4a52-b7e3-dc89f0c0a085 None admin] PATH_INFO: `/v3/projects/fe58366f33c34876a9ce7a3927f1a675` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:11.176097 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10bd32-2864-4a52-b7e3-dc89f0c0a085 None admin] RBAC: Authorizing `identity:get_project(project_id=fe58366f33c34876a9ce7a3927f1a675)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:11.177506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10bd32-2864-4a52-b7e3-dc89f0c0a085 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:11.179777 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 609/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 16:59:11 2022] GET /identity/v3/projects/fe58366f33c34876a9ce7a3927f1a675 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 16:59:11.185738 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac584aa8-4b7a-4925-8f1e-b5ee35761768 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 16:59:11.278277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac584aa8-4b7a-4925-8f1e-b5ee35761768 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 16:59:11.310731 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91581ba3-2694-4b5a-acbc-5d437301e24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 16:59:11.311645 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91581ba3-2694-4b5a-acbc-5d437301e24a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 16:59:11.311929 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91581ba3-2694-4b5a-acbc-5d437301e24a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 16:59:11.312201 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91581ba3-2694-4b5a-acbc-5d437301e24a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 16:59:11.313013 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91581ba3-2694-4b5a-acbc-5d437301e24a None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=fe58366f33c34876a9ce7a3927f1a675, user.id=e1f5592fce9a4b028b08fee0d5c39b8f) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 16:59:11.313323 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91581ba3-2694-4b5a-acbc-5d437301e24a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 16:59:11.314735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91581ba3-2694-4b5a-acbc-5d437301e24a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 16:59:11.320312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 591/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 16:59:11 2022] GET /identity/v3/role_assignments?user.id=e1f5592fce9a4b028b08fee0d5c39b8f&scope.project.id=fe58366f33c34876a9ce7a3927f1a675&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:11.612078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821fda2-b687-440d-87b6-50a9472e8744 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:11.612682 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821fda2-b687-440d-87b6-50a9472e8744 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:11.612682 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821fda2-b687-440d-87b6-50a9472e8744 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:11.614792 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 610/1201] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:00:11.621728 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a015a84-fb0f-4a0f-a96a-4f0df1a35196 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:11.622313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a015a84-fb0f-4a0f-a96a-4f0df1a35196 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:11.622313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a015a84-fb0f-4a0f-a96a-4f0df1a35196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:11.650465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1a015a84-fb0f-4a0f-a96a-4f0df1a35196 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:00:11.651739 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1a015a84-fb0f-4a0f-a96a-4f0df1a35196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:00:11.735694 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 592/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:00:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 17:00:11.764881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821fda2-b687-440d-87b6-50a9472e8744 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:11.894025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821fda2-b687-440d-87b6-50a9472e8744 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:11.932964 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e533a0-0867-47fe-9981-af2808fab808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:11.933683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e533a0-0867-47fe-9981-af2808fab808 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:11.933965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e533a0-0867-47fe-9981-af2808fab808 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:11.934535 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e533a0-0867-47fe-9981-af2808fab808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:11.946362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e533a0-0867-47fe-9981-af2808fab808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:11.948212 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e533a0-0867-47fe-9981-af2808fab808 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:11.972254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-c1e533a0-0867-47fe-9981-af2808fab808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:11.972254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:11.972254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:11.972254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:11.972254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:11.972254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:11.972254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:11.972254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:11.972254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:11.972254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:11.972254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:11.972254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:11.972254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:00:11.972254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:00:11.972254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:11.974001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:11.974965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:00:11.974965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:00:11.974965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:11.974965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:11.974965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 611/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:11.980568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a015a84-fb0f-4a0f-a96a-4f0df1a35196 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:12.111654 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a015a84-fb0f-4a0f-a96a-4f0df1a35196 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:12.156198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173be97-5253-4fde-b2af-c8dbcad3fabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:12.157032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173be97-5253-4fde-b2af-c8dbcad3fabd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:12.157368 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173be97-5253-4fde-b2af-c8dbcad3fabd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:12.157683 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173be97-5253-4fde-b2af-c8dbcad3fabd None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:12.158683 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173be97-5253-4fde-b2af-c8dbcad3fabd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:12.159099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173be97-5253-4fde-b2af-c8dbcad3fabd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:12.161220 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173be97-5253-4fde-b2af-c8dbcad3fabd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:12.183564 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 593/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 17:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:00:12.188507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e533a0-0867-47fe-9981-af2808fab808 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:12.318735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e533a0-0867-47fe-9981-af2808fab808 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:12.358784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678b103-04b8-46f5-938b-849dcf3dc337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:12.359458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678b103-04b8-46f5-938b-849dcf3dc337 None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:12.359912 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678b103-04b8-46f5-938b-849dcf3dc337 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:12.360196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678b103-04b8-46f5-938b-849dcf3dc337 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:12.360906 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678b103-04b8-46f5-938b-849dcf3dc337 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:12.362336 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678b103-04b8-46f5-938b-849dcf3dc337 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:12.386206 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 612/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 17:00:12 2022] POST /identity/v3/users => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:00:14.912876 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741cb12-9800-4177-97f8-ac1ce0db0770 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:14.913441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741cb12-9800-4177-97f8-ac1ce0db0770 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:14.913441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741cb12-9800-4177-97f8-ac1ce0db0770 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:14.914929 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 594/1206] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:00:14.920145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916386d-5b52-4be5-aa77-4138f20e0613 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:14.920647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916386d-5b52-4be5-aa77-4138f20e0613 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:14.920748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916386d-5b52-4be5-aa77-4138f20e0613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:14.940235 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d916386d-5b52-4be5-aa77-4138f20e0613 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:00:14.941707 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d916386d-5b52-4be5-aa77-4138f20e0613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:00:15.015814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 613/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:00:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 17:00:15.039802 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741cb12-9800-4177-97f8-ac1ce0db0770 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:15.157718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741cb12-9800-4177-97f8-ac1ce0db0770 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:15.197554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4f750-12d5-4906-bae3-8fbe50d8fb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:15.198313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4f750-12d5-4906-bae3-8fbe50d8fb5c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:15.198631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4f750-12d5-4906-bae3-8fbe50d8fb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:15.198930 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4f750-12d5-4906-bae3-8fbe50d8fb5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:15.212101 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4f750-12d5-4906-bae3-8fbe50d8fb5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8cf4f750-12d5-4906-bae3-8fbe50d8fb5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:00:15.220256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:15.221288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:15.227658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:15.227658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:15.227658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:15.227658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:15.227658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:00:15.227658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:00:15.227658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:00:15.227658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:00:15.227658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:00:15.227658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:00:15.227658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:00:15.227658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:15.227658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 595/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 17:00:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:15.228409 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916386d-5b52-4be5-aa77-4138f20e0613 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:15.340822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916386d-5b52-4be5-aa77-4138f20e0613 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:15.378629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2e983-4125-40c9-92f8-2d293f958887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:15.379376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e983-4125-40c9-92f8-2d293f958887 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:15.379695 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e983-4125-40c9-92f8-2d293f958887 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:15.379977 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e983-4125-40c9-92f8-2d293f958887 None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:15.380719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2e983-4125-40c9-92f8-2d293f958887 None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:15.381095 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2e983-4125-40c9-92f8-2d293f958887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:15.382549 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2e983-4125-40c9-92f8-2d293f958887 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:15.391164 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 614/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 17:00:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:15.397554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4f750-12d5-4906-bae3-8fbe50d8fb5c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:15.508860 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4f750-12d5-4906-bae3-8fbe50d8fb5c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:15.545647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd82e57-ce51-481b-8c46-705446db35fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:15.546361 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd82e57-ce51-481b-8c46-705446db35fc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:15.546828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd82e57-ce51-481b-8c46-705446db35fc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:15.546972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd82e57-ce51-481b-8c46-705446db35fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:15.559965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd82e57-ce51-481b-8c46-705446db35fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:15.561431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd82e57-ce51-481b-8c46-705446db35fc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:15.579573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5fd82e57-ce51-481b-8c46-705446db35fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:15.579573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:15.579573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:15.579573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:15.579573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:15.579573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:15.579573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:15.579573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:15.579573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:15.579573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:15.579573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:15.579573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:15.579573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:00:15.579573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:00:15.579573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:15.580721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:15.582464 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:00:15.582464 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:00:15.582464 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:15.582464 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:15.586421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 596/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:15.587488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2e983-4125-40c9-92f8-2d293f958887 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:15.697570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2e983-4125-40c9-92f8-2d293f958887 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:15.739364 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8cb40-9027-4620-b02c-18c8f3884161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:15.740072 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8cb40-9027-4620-b02c-18c8f3884161 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:15.740414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8cb40-9027-4620-b02c-18c8f3884161 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:15.740703 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8cb40-9027-4620-b02c-18c8f3884161 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:15.741458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8cb40-9027-4620-b02c-18c8f3884161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:15.741769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8cb40-9027-4620-b02c-18c8f3884161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:15.743195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8cb40-9027-4620-b02c-18c8f3884161 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:15.756443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 615/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 17:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:15.762188 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd82e57-ce51-481b-8c46-705446db35fc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:15.876602 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd82e57-ce51-481b-8c46-705446db35fc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:15.919045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d38343-b429-486b-a438-e0e8a2a97ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:15.920614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d38343-b429-486b-a438-e0e8a2a97ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:15.920614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d38343-b429-486b-a438-e0e8a2a97ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:15.920614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d38343-b429-486b-a438-e0e8a2a97ed2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:15.930489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d38343-b429-486b-a438-e0e8a2a97ed2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:15.932095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d38343-b429-486b-a438-e0e8a2a97ed2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-f1d38343-b429-486b-a438-e0e8a2a97ed2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:00:15.949688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:15.950770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:15.951945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:15.951945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:15.951945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:00:15.951945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:00:15.951945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:00:15.951945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:00:15.951945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:00:15.951945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:00:15.951945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 17:00:15.951945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:15.951945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 597/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:00:15.957571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8cb40-9027-4620-b02c-18c8f3884161 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:16.065867 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8cb40-9027-4620-b02c-18c8f3884161 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:16.106667 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567666b6-fa0e-41fd-9a40-26ab3c27a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:16.107345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567666b6-fa0e-41fd-9a40-26ab3c27a984 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:16.107656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567666b6-fa0e-41fd-9a40-26ab3c27a984 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:16.107940 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567666b6-fa0e-41fd-9a40-26ab3c27a984 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:16.108859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567666b6-fa0e-41fd-9a40-26ab3c27a984 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:16.109196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567666b6-fa0e-41fd-9a40-26ab3c27a984 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:16.110740 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567666b6-fa0e-41fd-9a40-26ab3c27a984 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:16.131594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 616/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 17 17:00:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:16.136910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d38343-b429-486b-a438-e0e8a2a97ed2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:16.257494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d38343-b429-486b-a438-e0e8a2a97ed2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:16.300404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bd7cd-1f82-4c0b-8177-ed44802fc998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:16.301180 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bd7cd-1f82-4c0b-8177-ed44802fc998 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:16.301566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bd7cd-1f82-4c0b-8177-ed44802fc998 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:16.301826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bd7cd-1f82-4c0b-8177-ed44802fc998 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:16.375804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bd7cd-1f82-4c0b-8177-ed44802fc998 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:16.377211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bd7cd-1f82-4c0b-8177-ed44802fc998 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:16.483583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 598/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 17:00:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 17:00:16.489653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567666b6-fa0e-41fd-9a40-26ab3c27a984 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:16.592701 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567666b6-fa0e-41fd-9a40-26ab3c27a984 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:16.629157 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798271d5-18b3-4ae5-b3d9-daa67895d304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:16.629886 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798271d5-18b3-4ae5-b3d9-daa67895d304 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:16.630163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798271d5-18b3-4ae5-b3d9-daa67895d304 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:16.630433 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798271d5-18b3-4ae5-b3d9-daa67895d304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:16.641768 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798271d5-18b3-4ae5-b3d9-daa67895d304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:16.643278 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798271d5-18b3-4ae5-b3d9-daa67895d304 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:16.664343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-798271d5-18b3-4ae5-b3d9-daa67895d304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:16.664343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:16.664343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:16.664343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:16.664343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:16.664343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:16.664343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:16.664343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:16.664343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:16.664343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:16.664343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:16.664343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:16.664343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:00:16.664343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:00:16.664343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:16.665522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:16.666469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:00:16.666469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:00:16.666469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:16.666469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:16.666469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 617/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:16.673339 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bd7cd-1f82-4c0b-8177-ed44802fc998 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:16.781587 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bd7cd-1f82-4c0b-8177-ed44802fc998 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:16.820286 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361390e-4d0d-496d-a463-a6737f89a097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:16.821306 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361390e-4d0d-496d-a463-a6737f89a097 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:16.821627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361390e-4d0d-496d-a463-a6737f89a097 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:16.821896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361390e-4d0d-496d-a463-a6737f89a097 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:16.822639 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361390e-4d0d-496d-a463-a6737f89a097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:16.822960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361390e-4d0d-496d-a463-a6737f89a097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:16.824409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361390e-4d0d-496d-a463-a6737f89a097 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:16.837323 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 599/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 17:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:16.843166 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798271d5-18b3-4ae5-b3d9-daa67895d304 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:16.950019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798271d5-18b3-4ae5-b3d9-daa67895d304 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:16.987439 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cda9a4-c67c-47dc-b1a9-5afe86f821e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:16.990345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda9a4-c67c-47dc-b1a9-5afe86f821e0 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:16.990345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda9a4-c67c-47dc-b1a9-5afe86f821e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:16.990345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda9a4-c67c-47dc-b1a9-5afe86f821e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:16.996353 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cda9a4-c67c-47dc-b1a9-5afe86f821e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:16.997802 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cda9a4-c67c-47dc-b1a9-5afe86f821e0 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:17.012811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-16cda9a4-c67c-47dc-b1a9-5afe86f821e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:00:17.012811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:17.012811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:17.012811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:17.012811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:17.012811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:17.012811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:17.012811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:17.012811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:17.012811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:17.012811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:17.012811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:17.012811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:00:17.012811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:00:17.012811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:17.019394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:17.020349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:00:17.020349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:00:17.020349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:00:17.020349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:00:17.020349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:00:17.020349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:00:17.020349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:00:17.020349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:17.020349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 618/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 17:00:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:17.020916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361390e-4d0d-496d-a463-a6737f89a097 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:17.135064 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361390e-4d0d-496d-a463-a6737f89a097 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:17.176454 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848297e4-0cfc-4245-9c14-e29b74d4f8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:17.177234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848297e4-0cfc-4245-9c14-e29b74d4f8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:17.178369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848297e4-0cfc-4245-9c14-e29b74d4f8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:17.178369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848297e4-0cfc-4245-9c14-e29b74d4f8f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:17.178560 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848297e4-0cfc-4245-9c14-e29b74d4f8f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:17.178846 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848297e4-0cfc-4245-9c14-e29b74d4f8f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:17.180322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848297e4-0cfc-4245-9c14-e29b74d4f8f1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:17.193912 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 600/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 17:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:17.200415 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cda9a4-c67c-47dc-b1a9-5afe86f821e0 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:17.321269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cda9a4-c67c-47dc-b1a9-5afe86f821e0 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:17.359373 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993db93-68f9-4ad4-afce-d47bf7d4f92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:17.360185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993db93-68f9-4ad4-afce-d47bf7d4f92e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:17.360475 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993db93-68f9-4ad4-afce-d47bf7d4f92e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:17.360769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993db93-68f9-4ad4-afce-d47bf7d4f92e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:17.361755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993db93-68f9-4ad4-afce-d47bf7d4f92e None admin] RBAC: Adding query filter params (role.id=958871a8463d49d89ddade803adb47c4, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=7730d6cad2ba40c19cb671268cf04d1d) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:17.362064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993db93-68f9-4ad4-afce-d47bf7d4f92e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:17.363809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993db93-68f9-4ad4-afce-d47bf7d4f92e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:17.370757 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 619/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 17:00:17 2022] GET /identity/v3/role_assignments?user.id=7730d6cad2ba40c19cb671268cf04d1d&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=958871a8463d49d89ddade803adb47c4 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:19.746207 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f0572-388b-43d4-93d5-25f81cbcb37b None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:19.746794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f0572-388b-43d4-93d5-25f81cbcb37b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:19.746794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f0572-388b-43d4-93d5-25f81cbcb37b None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:19.748684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 601/1220] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:00:19.757946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f490246-2ee8-4513-970f-af96af70b665 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:19.757946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f490246-2ee8-4513-970f-af96af70b665 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:19.757946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f490246-2ee8-4513-970f-af96af70b665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:19.774483 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0f490246-2ee8-4513-970f-af96af70b665 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:00:19.775742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0f490246-2ee8-4513-970f-af96af70b665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:00:19.851759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 620/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:00:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 17:00:19.868639 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f0572-388b-43d4-93d5-25f81cbcb37b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:19.977819 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f0572-388b-43d4-93d5-25f81cbcb37b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:20.012342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e987fe7-e593-4009-bc7a-a818c82ae21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:20.013111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e987fe7-e593-4009-bc7a-a818c82ae21e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:20.013338 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e987fe7-e593-4009-bc7a-a818c82ae21e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:20.013623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e987fe7-e593-4009-bc7a-a818c82ae21e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:20.023828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e987fe7-e593-4009-bc7a-a818c82ae21e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-4e987fe7-e593-4009-bc7a-a818c82ae21e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:00:20.031385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:20.032589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:20.038555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:20.038555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:20.038555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:20.038555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:20.038555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:00:20.038555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:00:20.038555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:00:20.038555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:00:20.038555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:00:20.038555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:00:20.038555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:00:20.038555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:20.038555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 602/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 17:00:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:20.041031 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f490246-2ee8-4513-970f-af96af70b665 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:20.146230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f490246-2ee8-4513-970f-af96af70b665 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:20.185244 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0a090-da29-4336-9fa9-9c396aefd0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:20.186066 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0a090-da29-4336-9fa9-9c396aefd0cb None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:20.186320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0a090-da29-4336-9fa9-9c396aefd0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:20.186663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0a090-da29-4336-9fa9-9c396aefd0cb None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:20.187418 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0a090-da29-4336-9fa9-9c396aefd0cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:20.187821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0a090-da29-4336-9fa9-9c396aefd0cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:20.189242 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0a090-da29-4336-9fa9-9c396aefd0cb None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:20.199481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 621/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 17:00:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:20.206046 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e987fe7-e593-4009-bc7a-a818c82ae21e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:20.323096 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e987fe7-e593-4009-bc7a-a818c82ae21e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:20.358525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806455b-9e3b-4ec3-be55-a203f41767d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:20.359402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806455b-9e3b-4ec3-be55-a203f41767d7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:20.359737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806455b-9e3b-4ec3-be55-a203f41767d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:20.360037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806455b-9e3b-4ec3-be55-a203f41767d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:20.371135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806455b-9e3b-4ec3-be55-a203f41767d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:20.372607 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806455b-9e3b-4ec3-be55-a203f41767d7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:20.392176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6806455b-9e3b-4ec3-be55-a203f41767d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:20.392176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:20.392176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:20.392176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:20.392176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:20.392176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:20.392176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:20.392176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:20.392176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:20.392176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:20.392176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:20.392176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:20.392176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:00:20.392176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:00:20.392176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:20.393351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:20.399815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:00:20.399815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:00:20.399815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:20.399815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:20.399815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 603/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:20.400405 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0a090-da29-4336-9fa9-9c396aefd0cb None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:20.516072 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0a090-da29-4336-9fa9-9c396aefd0cb None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:20.551232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51315502-972f-4f63-9ea1-fe4586c37e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:20.551933 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51315502-972f-4f63-9ea1-fe4586c37e78 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:20.552213 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51315502-972f-4f63-9ea1-fe4586c37e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:20.552488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51315502-972f-4f63-9ea1-fe4586c37e78 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:20.553208 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51315502-972f-4f63-9ea1-fe4586c37e78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:20.553511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51315502-972f-4f63-9ea1-fe4586c37e78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:20.554866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51315502-972f-4f63-9ea1-fe4586c37e78 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:20.568067 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 622/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 17:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:20.574083 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806455b-9e3b-4ec3-be55-a203f41767d7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:20.680157 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806455b-9e3b-4ec3-be55-a203f41767d7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:20.730491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d14e0-3a68-4b18-b3e5-87bd12d863cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:20.731805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d14e0-3a68-4b18-b3e5-87bd12d863cb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:20.732316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d14e0-3a68-4b18-b3e5-87bd12d863cb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:20.732829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d14e0-3a68-4b18-b3e5-87bd12d863cb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:20.744329 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d14e0-3a68-4b18-b3e5-87bd12d863cb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:20.747244 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d14e0-3a68-4b18-b3e5-87bd12d863cb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a20d14e0-3a68-4b18-b3e5-87bd12d863cb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:00:20.770593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:20.771663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:20.772618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:20.772618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:20.772618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:00:20.772618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:00:20.772618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:00:20.772618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:00:20.772618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:00:20.772618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:00:20.772618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 17:00:20.772618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:20.772618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 604/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:00:20.778645 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51315502-972f-4f63-9ea1-fe4586c37e78 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:20.880363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51315502-972f-4f63-9ea1-fe4586c37e78 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:20.915050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fac076-1169-4d01-b409-2557496a7aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:20.915751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fac076-1169-4d01-b409-2557496a7aab None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:20.916032 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fac076-1169-4d01-b409-2557496a7aab None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:20.916299 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fac076-1169-4d01-b409-2557496a7aab None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:20.917119 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fac076-1169-4d01-b409-2557496a7aab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:20.917418 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fac076-1169-4d01-b409-2557496a7aab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:20.918822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fac076-1169-4d01-b409-2557496a7aab None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:20.938937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 623/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 17 17:00:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:20.944646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d14e0-3a68-4b18-b3e5-87bd12d863cb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:21.062284 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d14e0-3a68-4b18-b3e5-87bd12d863cb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:21.104568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176adce1-153a-4f95-8bd9-e1ad9291b6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:21.105364 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176adce1-153a-4f95-8bd9-e1ad9291b6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:21.105643 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176adce1-153a-4f95-8bd9-e1ad9291b6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:21.105911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176adce1-153a-4f95-8bd9-e1ad9291b6e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:21.117111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176adce1-153a-4f95-8bd9-e1ad9291b6e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:21.118886 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176adce1-153a-4f95-8bd9-e1ad9291b6e1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:21.138421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-176adce1-153a-4f95-8bd9-e1ad9291b6e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:21.138421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:21.138421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:21.138421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:21.138421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:21.138421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:21.138421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:21.138421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:21.138421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:21.138421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:21.138421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:21.138421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:21.138421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:00:21.138421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:00:21.138421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:21.139843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:21.140995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:00:21.140995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:00:21.140995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:21.140995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:21.140995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 605/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:21.146235 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fac076-1169-4d01-b409-2557496a7aab None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:21.259229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fac076-1169-4d01-b409-2557496a7aab None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:21.303724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37454518-b724-4e13-a9dd-8fd0b3b5868d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:21.304387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37454518-b724-4e13-a9dd-8fd0b3b5868d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:21.304666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37454518-b724-4e13-a9dd-8fd0b3b5868d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:21.305068 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37454518-b724-4e13-a9dd-8fd0b3b5868d None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:21.305856 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37454518-b724-4e13-a9dd-8fd0b3b5868d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:21.306096 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37454518-b724-4e13-a9dd-8fd0b3b5868d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:21.307634 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37454518-b724-4e13-a9dd-8fd0b3b5868d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:21.319896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 624/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 17:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:21.325768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176adce1-153a-4f95-8bd9-e1ad9291b6e1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:21.439242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176adce1-153a-4f95-8bd9-e1ad9291b6e1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:21.476412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4795c-575b-4176-8d47-6b18423cb02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:21.477273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4795c-575b-4176-8d47-6b18423cb02b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:21.477561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4795c-575b-4176-8d47-6b18423cb02b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:21.477866 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4795c-575b-4176-8d47-6b18423cb02b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:21.485268 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4795c-575b-4176-8d47-6b18423cb02b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:21.486860 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4795c-575b-4176-8d47-6b18423cb02b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:21.502144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c8a4795c-575b-4176-8d47-6b18423cb02b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:00:21.502144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:21.502144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:21.502144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:21.502144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:21.502144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:21.502144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:21.502144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:21.502144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:21.502144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:21.502144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:21.502144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:21.502144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:00:21.502144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:00:21.502144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:21.503910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:21.505097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:00:21.505097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:00:21.505097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:00:21.505097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:00:21.505097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:00:21.505097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:00:21.505097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:00:21.505097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:21.510427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 606/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 17:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:21.510555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37454518-b724-4e13-a9dd-8fd0b3b5868d None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:21.615746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37454518-b724-4e13-a9dd-8fd0b3b5868d None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:21.649914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9b7dd-c2f6-4400-a249-84f870a1568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:21.650613 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9b7dd-c2f6-4400-a249-84f870a1568b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:21.650921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9b7dd-c2f6-4400-a249-84f870a1568b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:21.651209 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9b7dd-c2f6-4400-a249-84f870a1568b None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:21.652112 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9b7dd-c2f6-4400-a249-84f870a1568b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:21.652444 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9b7dd-c2f6-4400-a249-84f870a1568b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:21.654107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9b7dd-c2f6-4400-a249-84f870a1568b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:21.666204 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 625/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 17:00:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:21.672438 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4795c-575b-4176-8d47-6b18423cb02b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:21.780294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4795c-575b-4176-8d47-6b18423cb02b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:21.816568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5f258-2fb2-4281-9a97-972e6b459023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:21.817499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5f258-2fb2-4281-9a97-972e6b459023 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:21.817798 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5f258-2fb2-4281-9a97-972e6b459023 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:21.818136 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5f258-2fb2-4281-9a97-972e6b459023 None admin] PATH_INFO: `/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/7730d6cad2ba40c19cb671268cf04d1d/roles/958871a8463d49d89ddade803adb47c4` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:21.833220 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5f258-2fb2-4281-9a97-972e6b459023 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2b356e72cf84d099f2ce8678103ecef, user_id=7730d6cad2ba40c19cb671268cf04d1d, role_id=958871a8463d49d89ddade803adb47c4)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:21.834793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5f258-2fb2-4281-9a97-972e6b459023 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:21.848568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 607/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 17:00:21 2022] PUT /identity/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/7730d6cad2ba40c19cb671268cf04d1d/roles/958871a8463d49d89ddade803adb47c4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:00:24.172747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c633b9-2123-46e6-b3f6-d475560236be None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:24.173393 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c633b9-2123-46e6-b3f6-d475560236be None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:24.173393 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c633b9-2123-46e6-b3f6-d475560236be None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:24.174807 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 626/1233] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:00:24.181594 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0c3be-a5c0-4d79-b13f-12804144e497 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:24.182074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0c3be-a5c0-4d79-b13f-12804144e497 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:24.182272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0c3be-a5c0-4d79-b13f-12804144e497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:24.199468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-dda0c3be-a5c0-4d79-b13f-12804144e497 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:00:24.200871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-dda0c3be-a5c0-4d79-b13f-12804144e497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:00:24.272341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 608/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:00:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 17:00:24.300611 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c633b9-2123-46e6-b3f6-d475560236be None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:24.418129 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c633b9-2123-46e6-b3f6-d475560236be None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:24.452610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8af2e-77b7-4232-bdd2-47844b709f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:24.453409 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8af2e-77b7-4232-bdd2-47844b709f47 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:24.453704 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8af2e-77b7-4232-bdd2-47844b709f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:24.453959 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8af2e-77b7-4232-bdd2-47844b709f47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:24.464531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8af2e-77b7-4232-bdd2-47844b709f47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-82b8af2e-77b7-4232-bdd2-47844b709f47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:00:24.472834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:24.474120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:24.475205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:24.475205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:24.475205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:24.475205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:24.475205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:00:24.475205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:00:24.475205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:00:24.475205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:00:24.475205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:00:24.475205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:00:24.475205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:00:24.475205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:24.475205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 627/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 17:00:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:24.480677 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0c3be-a5c0-4d79-b13f-12804144e497 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:24.584992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0c3be-a5c0-4d79-b13f-12804144e497 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:24.622516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872084be-aeb3-4442-9671-89f1aea16d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:24.623194 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872084be-aeb3-4442-9671-89f1aea16d93 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:24.623460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872084be-aeb3-4442-9671-89f1aea16d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:24.623884 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872084be-aeb3-4442-9671-89f1aea16d93 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:24.624625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872084be-aeb3-4442-9671-89f1aea16d93 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:24.624932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872084be-aeb3-4442-9671-89f1aea16d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:24.626301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872084be-aeb3-4442-9671-89f1aea16d93 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:24.635819 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 609/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 17:00:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:24.641751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8af2e-77b7-4232-bdd2-47844b709f47 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:24.747275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8af2e-77b7-4232-bdd2-47844b709f47 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:24.780469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa3b98-1de0-4e64-a4a3-1615626af3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:24.781317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3b98-1de0-4e64-a4a3-1615626af3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:24.781611 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3b98-1de0-4e64-a4a3-1615626af3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:24.781886 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3b98-1de0-4e64-a4a3-1615626af3f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:24.796598 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa3b98-1de0-4e64-a4a3-1615626af3f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:24.798152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa3b98-1de0-4e64-a4a3-1615626af3f6 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:24.817850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-34fa3b98-1de0-4e64-a4a3-1615626af3f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:24.817850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:24.817850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:24.817850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:24.817850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:24.817850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:24.817850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:24.817850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:24.817850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:24.817850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:24.817850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:24.817850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:24.817850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:00:24.817850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:00:24.817850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:24.819094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:24.820281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:00:24.820281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:00:24.820281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:24.820281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:24.820281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 628/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:24.825983 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872084be-aeb3-4442-9671-89f1aea16d93 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:24.932397 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872084be-aeb3-4442-9671-89f1aea16d93 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:24.969689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0daa5f-0792-45d9-8a7a-8ae7c716e9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:24.970450 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0daa5f-0792-45d9-8a7a-8ae7c716e9ee None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:24.970757 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0daa5f-0792-45d9-8a7a-8ae7c716e9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:24.971036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0daa5f-0792-45d9-8a7a-8ae7c716e9ee None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:24.972013 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0daa5f-0792-45d9-8a7a-8ae7c716e9ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:24.972570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0daa5f-0792-45d9-8a7a-8ae7c716e9ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:24.974215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0daa5f-0792-45d9-8a7a-8ae7c716e9ee None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:24.986957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 610/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 17:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:24.993099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa3b98-1de0-4e64-a4a3-1615626af3f6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:25.102265 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa3b98-1de0-4e64-a4a3-1615626af3f6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:25.135730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed3847-95be-483e-94a1-3c6c77b33e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:25.136568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed3847-95be-483e-94a1-3c6c77b33e3c None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:25.136850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed3847-95be-483e-94a1-3c6c77b33e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:25.137132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed3847-95be-483e-94a1-3c6c77b33e3c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:25.147524 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed3847-95be-483e-94a1-3c6c77b33e3c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:25.149205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed3847-95be-483e-94a1-3c6c77b33e3c None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-80ed3847-95be-483e-94a1-3c6c77b33e3c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:00:25.165431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:25.166747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:25.167706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:25.167706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:25.167706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:00:25.167706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:00:25.167706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:00:25.167706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:00:25.167706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:00:25.167706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:00:25.167706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 17:00:25.167706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:25.167706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 629/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:25.172936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0daa5f-0792-45d9-8a7a-8ae7c716e9ee None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:25.296516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0daa5f-0792-45d9-8a7a-8ae7c716e9ee None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:25.336744 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b5ff9-2488-448c-8ddd-2dc4bbba0381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:25.337491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b5ff9-2488-448c-8ddd-2dc4bbba0381 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:25.337840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b5ff9-2488-448c-8ddd-2dc4bbba0381 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:25.338115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b5ff9-2488-448c-8ddd-2dc4bbba0381 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:25.339053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b5ff9-2488-448c-8ddd-2dc4bbba0381 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:25.339429 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b5ff9-2488-448c-8ddd-2dc4bbba0381 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:25.340883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b5ff9-2488-448c-8ddd-2dc4bbba0381 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:25.360110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 611/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 17 17:00:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:25.366561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed3847-95be-483e-94a1-3c6c77b33e3c None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:25.478587 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed3847-95be-483e-94a1-3c6c77b33e3c None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:25.519502 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee118643-8b18-41c3-8132-e8af686d6c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:25.520309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee118643-8b18-41c3-8132-e8af686d6c11 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:25.520635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee118643-8b18-41c3-8132-e8af686d6c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:25.520914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee118643-8b18-41c3-8132-e8af686d6c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:25.598111 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee118643-8b18-41c3-8132-e8af686d6c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:25.599562 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee118643-8b18-41c3-8132-e8af686d6c11 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:25.702730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 630/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 17:00:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 17:00:25.708881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b5ff9-2488-448c-8ddd-2dc4bbba0381 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:25.811124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b5ff9-2488-448c-8ddd-2dc4bbba0381 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:25.845812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d124cc-ea9e-4847-b019-f36e602d3fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:25.847276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d124cc-ea9e-4847-b019-f36e602d3fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:25.847650 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d124cc-ea9e-4847-b019-f36e602d3fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:25.847967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d124cc-ea9e-4847-b019-f36e602d3fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:25.858521 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d124cc-ea9e-4847-b019-f36e602d3fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:25.860410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d124cc-ea9e-4847-b019-f36e602d3fb4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:25.880957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-66d124cc-ea9e-4847-b019-f36e602d3fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:25.880957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:25.880957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:25.880957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:25.880957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:25.880957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:25.880957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:25.880957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:25.880957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:25.880957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:25.880957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:25.880957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:25.880957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:00:25.880957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:00:25.880957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:25.882903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:25.884928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:00:25.884928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:00:25.884928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:25.884928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:25.884928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 612/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:25.890251 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee118643-8b18-41c3-8132-e8af686d6c11 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:26.015306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee118643-8b18-41c3-8132-e8af686d6c11 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:26.053603 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e5bf0-381c-469d-87d3-c36b828d8b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:26.054266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e5bf0-381c-469d-87d3-c36b828d8b86 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:26.054550 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e5bf0-381c-469d-87d3-c36b828d8b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:26.054826 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e5bf0-381c-469d-87d3-c36b828d8b86 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:26.055538 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e5bf0-381c-469d-87d3-c36b828d8b86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:26.055877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e5bf0-381c-469d-87d3-c36b828d8b86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:26.057234 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e5bf0-381c-469d-87d3-c36b828d8b86 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:26.069792 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 631/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 17:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:26.076076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d124cc-ea9e-4847-b019-f36e602d3fb4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:26.185214 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d124cc-ea9e-4847-b019-f36e602d3fb4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:26.220157 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce7bba-501b-4392-a1a2-e9e330025dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:26.220950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce7bba-501b-4392-a1a2-e9e330025dad None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:26.221230 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce7bba-501b-4392-a1a2-e9e330025dad None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:26.222064 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce7bba-501b-4392-a1a2-e9e330025dad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:26.229265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce7bba-501b-4392-a1a2-e9e330025dad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:26.230728 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce7bba-501b-4392-a1a2-e9e330025dad None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:26.244891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-acce7bba-501b-4392-a1a2-e9e330025dad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:00:26.244891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:26.244891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:26.244891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:26.244891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:26.244891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:26.244891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:26.244891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:26.244891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:26.244891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:26.244891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:26.244891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:26.244891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:00:26.244891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:00:26.244891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:26.246085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:26.247193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:00:26.247193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:00:26.247193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:00:26.247193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:00:26.247193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:00:26.247193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:00:26.247193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:00:26.247193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:26.247193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 613/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 17:00:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:26.252545 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e5bf0-381c-469d-87d3-c36b828d8b86 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:26.372262 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e5bf0-381c-469d-87d3-c36b828d8b86 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:26.410552 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf1c68-1024-40ec-88f5-eaf8883f9a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:26.411509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf1c68-1024-40ec-88f5-eaf8883f9a7d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:26.411854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf1c68-1024-40ec-88f5-eaf8883f9a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:26.412173 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf1c68-1024-40ec-88f5-eaf8883f9a7d None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:26.413083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf1c68-1024-40ec-88f5-eaf8883f9a7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:26.413480 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf1c68-1024-40ec-88f5-eaf8883f9a7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:26.415369 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf1c68-1024-40ec-88f5-eaf8883f9a7d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:26.430545 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 632/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 17:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:26.437113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce7bba-501b-4392-a1a2-e9e330025dad None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:26.552266 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce7bba-501b-4392-a1a2-e9e330025dad None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:26.587354 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72056ad-fb79-4b03-8ef4-035fa7ecd330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:26.588071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72056ad-fb79-4b03-8ef4-035fa7ecd330 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:26.588351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72056ad-fb79-4b03-8ef4-035fa7ecd330 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:26.588625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72056ad-fb79-4b03-8ef4-035fa7ecd330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:26.589488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72056ad-fb79-4b03-8ef4-035fa7ecd330 None admin] RBAC: Adding query filter params (role.id=958871a8463d49d89ddade803adb47c4, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=7730d6cad2ba40c19cb671268cf04d1d) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:26.589803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72056ad-fb79-4b03-8ef4-035fa7ecd330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:26.591267 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72056ad-fb79-4b03-8ef4-035fa7ecd330 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:26.597686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 614/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 17:00:26 2022] GET /identity/v3/role_assignments?user.id=7730d6cad2ba40c19cb671268cf04d1d&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=958871a8463d49d89ddade803adb47c4 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:29.083700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef320fdc-8ae2-44c4-992c-43b2474fc2a5 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:29.084267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef320fdc-8ae2-44c4-992c-43b2474fc2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:29.084418 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef320fdc-8ae2-44c4-992c-43b2474fc2a5 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:29.086078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 633/1247] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:00:29.093071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55408b-7e66-4ad7-818b-887b2e5b60ed None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:29.093071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55408b-7e66-4ad7-818b-887b2e5b60ed None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:29.093518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55408b-7e66-4ad7-818b-887b2e5b60ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:29.111420 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2a55408b-7e66-4ad7-818b-887b2e5b60ed None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:00:29.113229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2a55408b-7e66-4ad7-818b-887b2e5b60ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:00:29.192610 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 615/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:00:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 17:00:29.219521 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef320fdc-8ae2-44c4-992c-43b2474fc2a5 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:29.341235 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef320fdc-8ae2-44c4-992c-43b2474fc2a5 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:29.383098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a297a3-30b8-414d-b17c-8e875cd6ce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:29.383919 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a297a3-30b8-414d-b17c-8e875cd6ce72 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:29.384204 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a297a3-30b8-414d-b17c-8e875cd6ce72 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:29.384479 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a297a3-30b8-414d-b17c-8e875cd6ce72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:29.395240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a297a3-30b8-414d-b17c-8e875cd6ce72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-95a297a3-30b8-414d-b17c-8e875cd6ce72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:00:29.403177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:29.404252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:29.405118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:29.405118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:29.405118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:29.405118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:29.405118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:00:29.405118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:00:29.405118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:00:29.405118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:00:29.405118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:00:29.405118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:00:29.405118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:00:29.405118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:29.405118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 634/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 17:00:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:29.410936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55408b-7e66-4ad7-818b-887b2e5b60ed None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:29.511370 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55408b-7e66-4ad7-818b-887b2e5b60ed None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:29.546535 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2734ef6-a9a2-4209-ae61-9ef9a0d8567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:29.547196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2734ef6-a9a2-4209-ae61-9ef9a0d8567a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:29.547559 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2734ef6-a9a2-4209-ae61-9ef9a0d8567a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:29.547897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2734ef6-a9a2-4209-ae61-9ef9a0d8567a None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:29.548802 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2734ef6-a9a2-4209-ae61-9ef9a0d8567a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:29.549140 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2734ef6-a9a2-4209-ae61-9ef9a0d8567a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:29.551417 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2734ef6-a9a2-4209-ae61-9ef9a0d8567a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:29.560106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 616/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 17:00:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:00:29.565868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a297a3-30b8-414d-b17c-8e875cd6ce72 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:29.678275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a297a3-30b8-414d-b17c-8e875cd6ce72 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:29.715702 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4556e15-63b9-475f-bacf-eda8bf77cb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:29.716732 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4556e15-63b9-475f-bacf-eda8bf77cb48 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:29.717106 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4556e15-63b9-475f-bacf-eda8bf77cb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:29.717551 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4556e15-63b9-475f-bacf-eda8bf77cb48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:29.730182 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4556e15-63b9-475f-bacf-eda8bf77cb48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:29.731770 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4556e15-63b9-475f-bacf-eda8bf77cb48 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:29.751259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-e4556e15-63b9-475f-bacf-eda8bf77cb48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:29.751259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:29.751259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:29.751259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:29.751259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:29.751259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:29.751259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:29.751259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:29.751259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:29.751259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:29.751259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:29.751259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:29.751259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:00:29.751259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:00:29.751259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:29.752642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:29.753914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:00:29.753914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:00:29.753914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:29.753914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:29.753914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 635/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:00:29.758475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2734ef6-a9a2-4209-ae61-9ef9a0d8567a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:29.872873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2734ef6-a9a2-4209-ae61-9ef9a0d8567a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:29.910459 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b20fbc-f6da-4b42-9bb4-8272e7db79bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:29.911399 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b20fbc-f6da-4b42-9bb4-8272e7db79bb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:29.911886 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b20fbc-f6da-4b42-9bb4-8272e7db79bb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:29.912164 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b20fbc-f6da-4b42-9bb4-8272e7db79bb None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:29.912950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b20fbc-f6da-4b42-9bb4-8272e7db79bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:29.913257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b20fbc-f6da-4b42-9bb4-8272e7db79bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:29.914822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b20fbc-f6da-4b42-9bb4-8272e7db79bb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:29.936956 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 617/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 17:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:00:29.938610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4556e15-63b9-475f-bacf-eda8bf77cb48 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:30.045817 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4556e15-63b9-475f-bacf-eda8bf77cb48 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:30.080172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e04b5-016a-4a8c-a7c1-284e5b3747e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:30.081313 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e04b5-016a-4a8c-a7c1-284e5b3747e4 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:30.081623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e04b5-016a-4a8c-a7c1-284e5b3747e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:30.081976 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e04b5-016a-4a8c-a7c1-284e5b3747e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:30.090698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e04b5-016a-4a8c-a7c1-284e5b3747e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:30.092248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e04b5-016a-4a8c-a7c1-284e5b3747e4 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-ea2e04b5-016a-4a8c-a7c1-284e5b3747e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:00:30.108749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:30.109973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:30.111347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:30.111347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:30.111347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:00:30.111347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:00:30.111347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:00:30.111347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:00:30.111347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:00:30.111347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:00:30.111347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 17:00:30.111347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:30.111347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 636/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:30.116736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b20fbc-f6da-4b42-9bb4-8272e7db79bb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:30.220878 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b20fbc-f6da-4b42-9bb4-8272e7db79bb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:30.258002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90eb7b1-e50a-4652-936d-18c0d56ce59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:30.258697 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90eb7b1-e50a-4652-936d-18c0d56ce59d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:30.259041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90eb7b1-e50a-4652-936d-18c0d56ce59d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:30.259342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90eb7b1-e50a-4652-936d-18c0d56ce59d None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:30.260365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90eb7b1-e50a-4652-936d-18c0d56ce59d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:30.260680 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90eb7b1-e50a-4652-936d-18c0d56ce59d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:30.262384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90eb7b1-e50a-4652-936d-18c0d56ce59d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:30.283411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 618/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 17 17:00:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:30.290303 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e04b5-016a-4a8c-a7c1-284e5b3747e4 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:30.404121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e04b5-016a-4a8c-a7c1-284e5b3747e4 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:30.441875 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b9e6f-aaf8-49f3-8006-3a15a59bb61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:30.442498 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b9e6f-aaf8-49f3-8006-3a15a59bb61b None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:30.442793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b9e6f-aaf8-49f3-8006-3a15a59bb61b None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:30.443054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b9e6f-aaf8-49f3-8006-3a15a59bb61b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:30.513657 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b9e6f-aaf8-49f3-8006-3a15a59bb61b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:30.515797 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b9e6f-aaf8-49f3-8006-3a15a59bb61b None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:30.618986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 637/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 17:00:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 17:00:30.624924 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90eb7b1-e50a-4652-936d-18c0d56ce59d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:30.729072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90eb7b1-e50a-4652-936d-18c0d56ce59d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:30.764711 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b5c1e-bf04-43d9-97ae-e34bf6400834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:30.765002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b5c1e-bf04-43d9-97ae-e34bf6400834 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:30.765280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b5c1e-bf04-43d9-97ae-e34bf6400834 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:30.765549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b5c1e-bf04-43d9-97ae-e34bf6400834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:30.777096 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b5c1e-bf04-43d9-97ae-e34bf6400834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:30.778667 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b5c1e-bf04-43d9-97ae-e34bf6400834 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:30.797238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8a3b5c1e-bf04-43d9-97ae-e34bf6400834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:30.797238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:30.797238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:30.797238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:30.797238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:30.797238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:30.797238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:30.797238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:30.797238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:30.797238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:30.797238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:30.797238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:30.797238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:00:30.797238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:00:30.797238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:30.798301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:30.799184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:00:30.799184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:00:30.799184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:30.799184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:30.799184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 619/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:30.804977 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b9e6f-aaf8-49f3-8006-3a15a59bb61b None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:30.903950 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b9e6f-aaf8-49f3-8006-3a15a59bb61b None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:30.938922 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5317cf-5a7b-4d81-ae6a-9d3a11393a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:30.939539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5317cf-5a7b-4d81-ae6a-9d3a11393a2e None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:30.939851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5317cf-5a7b-4d81-ae6a-9d3a11393a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:30.940126 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5317cf-5a7b-4d81-ae6a-9d3a11393a2e None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:30.941019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5317cf-5a7b-4d81-ae6a-9d3a11393a2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:30.941332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5317cf-5a7b-4d81-ae6a-9d3a11393a2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:30.942752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5317cf-5a7b-4d81-ae6a-9d3a11393a2e None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:30.954586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 638/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 17:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:30.960765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b5c1e-bf04-43d9-97ae-e34bf6400834 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:31.059404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b5c1e-bf04-43d9-97ae-e34bf6400834 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:31.093730 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad252c-bfef-4d79-ab13-67fa33a35bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:31.094537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad252c-bfef-4d79-ab13-67fa33a35bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:31.094817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad252c-bfef-4d79-ab13-67fa33a35bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:31.095090 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad252c-bfef-4d79-ab13-67fa33a35bb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:31.103217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad252c-bfef-4d79-ab13-67fa33a35bb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:31.104722 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad252c-bfef-4d79-ab13-67fa33a35bb5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:31.118916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-17ad252c-bfef-4d79-ab13-67fa33a35bb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:00:31.118916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:31.118916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:31.118916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:31.118916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:31.118916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:31.118916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:31.118916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:31.118916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:31.118916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:31.118916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:31.118916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:31.118916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:00:31.118916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:00:31.118916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:31.120309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:31.121224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:00:31.121224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:00:31.121224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:00:31.121224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:00:31.121224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:00:31.121224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:00:31.121224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:00:31.121224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:31.121224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 620/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 17:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:31.125944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5317cf-5a7b-4d81-ae6a-9d3a11393a2e None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:31.227814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5317cf-5a7b-4d81-ae6a-9d3a11393a2e None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:31.262013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6435ca-cd44-4d3b-a3ea-4b8b7c6ecc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:31.262668 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6435ca-cd44-4d3b-a3ea-4b8b7c6ecc4f None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:31.262951 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6435ca-cd44-4d3b-a3ea-4b8b7c6ecc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:31.263229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6435ca-cd44-4d3b-a3ea-4b8b7c6ecc4f None admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:31.264049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6435ca-cd44-4d3b-a3ea-4b8b7c6ecc4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:31.264358 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6435ca-cd44-4d3b-a3ea-4b8b7c6ecc4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:31.265946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6435ca-cd44-4d3b-a3ea-4b8b7c6ecc4f None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:31.278716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 639/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 17:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:31.285359 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad252c-bfef-4d79-ab13-67fa33a35bb5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:31.383018 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad252c-bfef-4d79-ab13-67fa33a35bb5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:31.415251 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5b8b2-1e23-427d-9ec8-b47482c2d51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:31.415921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5b8b2-1e23-427d-9ec8-b47482c2d51d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:31.416205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5b8b2-1e23-427d-9ec8-b47482c2d51d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:31.416482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5b8b2-1e23-427d-9ec8-b47482c2d51d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:31.417295 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5b8b2-1e23-427d-9ec8-b47482c2d51d None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=7730d6cad2ba40c19cb671268cf04d1d) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:31.417607 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5b8b2-1e23-427d-9ec8-b47482c2d51d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:31.419028 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5b8b2-1e23-427d-9ec8-b47482c2d51d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:31.424486 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 621/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 17:00:31 2022] GET /identity/v3/role_assignments?user.id=7730d6cad2ba40c19cb671268cf04d1d&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:00:33.596520 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975f796-bc4b-4d9c-9f25-ca25ce70ec1e None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:33.597061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975f796-bc4b-4d9c-9f25-ca25ce70ec1e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:33.597061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975f796-bc4b-4d9c-9f25-ca25ce70ec1e None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:33.598428 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 640/1261] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:00:33.603568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb1893-69b9-4662-8d00-d3b2143ee766 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:33.603994 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb1893-69b9-4662-8d00-d3b2143ee766 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:33.604135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb1893-69b9-4662-8d00-d3b2143ee766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:33.620201 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d5bb1893-69b9-4662-8d00-d3b2143ee766 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:00:33.621347 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d5bb1893-69b9-4662-8d00-d3b2143ee766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:00:33.682782 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 622/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:00:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 17:00:33.705132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975f796-bc4b-4d9c-9f25-ca25ce70ec1e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:33.803082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975f796-bc4b-4d9c-9f25-ca25ce70ec1e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:33.835185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27de3c6-3b13-4e70-873e-fdbefe47edf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:33.835986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27de3c6-3b13-4e70-873e-fdbefe47edf6 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:33.836268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27de3c6-3b13-4e70-873e-fdbefe47edf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:33.836539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27de3c6-3b13-4e70-873e-fdbefe47edf6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:33.846018 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27de3c6-3b13-4e70-873e-fdbefe47edf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-a27de3c6-3b13-4e70-873e-fdbefe47edf6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:00:33.853735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:33.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:33.855733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:33.855733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:33.855733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:33.855733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:33.855733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:00:33.855733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:00:33.855733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:00:33.855733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:00:33.855733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:00:33.855733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:00:33.855733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:00:33.855733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:33.855733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 641/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 17:00:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:33.860923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb1893-69b9-4662-8d00-d3b2143ee766 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:33.953669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb1893-69b9-4662-8d00-d3b2143ee766 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:33.985174 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344b6ee-59c2-48e0-8a6f-70728c3f564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:33.985818 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344b6ee-59c2-48e0-8a6f-70728c3f564e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:33.986096 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344b6ee-59c2-48e0-8a6f-70728c3f564e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:33.986369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344b6ee-59c2-48e0-8a6f-70728c3f564e None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:33.987738 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344b6ee-59c2-48e0-8a6f-70728c3f564e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:33.988046 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344b6ee-59c2-48e0-8a6f-70728c3f564e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:33.989395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344b6ee-59c2-48e0-8a6f-70728c3f564e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:33.996990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 623/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 17:00:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:34.003345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27de3c6-3b13-4e70-873e-fdbefe47edf6 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:34.098316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27de3c6-3b13-4e70-873e-fdbefe47edf6 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:34.131159 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02c3aa-e07e-412e-a7f9-46ae02203a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:34.131900 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02c3aa-e07e-412e-a7f9-46ae02203a74 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:34.132181 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02c3aa-e07e-412e-a7f9-46ae02203a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:34.132456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02c3aa-e07e-412e-a7f9-46ae02203a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:34.143283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02c3aa-e07e-412e-a7f9-46ae02203a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:34.144895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02c3aa-e07e-412e-a7f9-46ae02203a74 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:34.161709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-ae02c3aa-e07e-412e-a7f9-46ae02203a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:34.161709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:34.161709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:34.161709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:34.161709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:34.161709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:34.161709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:34.161709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:34.161709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:34.161709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:34.161709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:34.161709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:34.161709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:00:34.161709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:00:34.161709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:34.162756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:34.163714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:00:34.163714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:00:34.163714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:34.163714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:34.163714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 642/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:34.168508 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344b6ee-59c2-48e0-8a6f-70728c3f564e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:34.264867 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344b6ee-59c2-48e0-8a6f-70728c3f564e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:34.309465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4664d3-b9f6-47d2-b66b-b97369c5c41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:34.310225 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4664d3-b9f6-47d2-b66b-b97369c5c41e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:34.310556 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4664d3-b9f6-47d2-b66b-b97369c5c41e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:34.310864 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4664d3-b9f6-47d2-b66b-b97369c5c41e None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:34.311677 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4664d3-b9f6-47d2-b66b-b97369c5c41e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:34.312044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4664d3-b9f6-47d2-b66b-b97369c5c41e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:34.313664 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4664d3-b9f6-47d2-b66b-b97369c5c41e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:34.326584 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 624/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 17:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:34.332621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02c3aa-e07e-412e-a7f9-46ae02203a74 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:34.431320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02c3aa-e07e-412e-a7f9-46ae02203a74 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:34.462645 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a55caf-d94e-42ff-b6f3-4affd3716733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:34.463432 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a55caf-d94e-42ff-b6f3-4affd3716733 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:34.463745 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a55caf-d94e-42ff-b6f3-4affd3716733 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:34.464025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a55caf-d94e-42ff-b6f3-4affd3716733 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:34.471634 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a55caf-d94e-42ff-b6f3-4affd3716733 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:34.473194 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a55caf-d94e-42ff-b6f3-4affd3716733 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-27a55caf-d94e-42ff-b6f3-4affd3716733 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:00:34.487482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:34.488765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:34.490098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:34.490098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:34.490098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:00:34.490098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:00:34.490098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:00:34.490098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:00:34.490098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:00:34.490098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:00:34.490098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 17:00:34.490098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:34.490098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 643/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:34.494398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4664d3-b9f6-47d2-b66b-b97369c5c41e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:34.586476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4664d3-b9f6-47d2-b66b-b97369c5c41e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:34.617722 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6458952-fd78-4fc0-a75d-96d9f0d43176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:34.618363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6458952-fd78-4fc0-a75d-96d9f0d43176 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:34.618638 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6458952-fd78-4fc0-a75d-96d9f0d43176 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:34.618905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6458952-fd78-4fc0-a75d-96d9f0d43176 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:34.619739 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6458952-fd78-4fc0-a75d-96d9f0d43176 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:34.620041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6458952-fd78-4fc0-a75d-96d9f0d43176 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:34.621447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6458952-fd78-4fc0-a75d-96d9f0d43176 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:34.637235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 625/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 17 17:00:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:34.642641 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a55caf-d94e-42ff-b6f3-4affd3716733 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:34.737086 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a55caf-d94e-42ff-b6f3-4affd3716733 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:34.767702 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f894b8-b1a1-4383-a59a-2f18c6b41d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:34.769077 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f894b8-b1a1-4383-a59a-2f18c6b41d48 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:34.769362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f894b8-b1a1-4383-a59a-2f18c6b41d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:34.769635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f894b8-b1a1-4383-a59a-2f18c6b41d48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:34.779508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f894b8-b1a1-4383-a59a-2f18c6b41d48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:34.780953 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f894b8-b1a1-4383-a59a-2f18c6b41d48 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:34.797852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-25f894b8-b1a1-4383-a59a-2f18c6b41d48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:34.797852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:34.797852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:34.797852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:34.797852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:34.797852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:34.797852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:34.797852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:34.797852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:34.797852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:34.797852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:34.797852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:34.797852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:00:34.797852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:00:34.797852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:34.798895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:34.800004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:00:34.800004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:00:34.800004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:34.800004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:34.800004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 644/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:34.804804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6458952-fd78-4fc0-a75d-96d9f0d43176 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:34.898042 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6458952-fd78-4fc0-a75d-96d9f0d43176 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:34.929457 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9627eb5-f2c5-4bc8-a369-fcb15dffa0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:34.930106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627eb5-f2c5-4bc8-a369-fcb15dffa0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:34.930385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627eb5-f2c5-4bc8-a369-fcb15dffa0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:34.930661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627eb5-f2c5-4bc8-a369-fcb15dffa0e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:34.931366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9627eb5-f2c5-4bc8-a369-fcb15dffa0e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:34.931696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9627eb5-f2c5-4bc8-a369-fcb15dffa0e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:34.933047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9627eb5-f2c5-4bc8-a369-fcb15dffa0e1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:34.944592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 626/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 17:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:34.950195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f894b8-b1a1-4383-a59a-2f18c6b41d48 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:35.042619 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f894b8-b1a1-4383-a59a-2f18c6b41d48 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:35.073877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24b71c-ea05-4535-a26b-8b9c3f266186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:35.074649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24b71c-ea05-4535-a26b-8b9c3f266186 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:35.074930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24b71c-ea05-4535-a26b-8b9c3f266186 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:35.075206 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24b71c-ea05-4535-a26b-8b9c3f266186 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:35.081689 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24b71c-ea05-4535-a26b-8b9c3f266186 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:35.083102 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24b71c-ea05-4535-a26b-8b9c3f266186 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:35.097389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-9b24b71c-ea05-4535-a26b-8b9c3f266186 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:00:35.097389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:35.097389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:35.097389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:35.097389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:35.097389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:35.097389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:35.097389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:35.097389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:35.097389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:35.097389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:35.097389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:35.097389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:00:35.097389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:00:35.097389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:35.098467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:35.099642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:00:35.099642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:00:35.099642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:00:35.099642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:00:35.099642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:00:35.099642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:00:35.099642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:00:35.099642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:35.099642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 645/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 17:00:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:35.104385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9627eb5-f2c5-4bc8-a369-fcb15dffa0e1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:35.197838 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9627eb5-f2c5-4bc8-a369-fcb15dffa0e1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:35.229533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba58423-0b72-4cc8-b7bc-363b74ce3d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:35.230169 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba58423-0b72-4cc8-b7bc-363b74ce3d9e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:35.230448 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba58423-0b72-4cc8-b7bc-363b74ce3d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:35.230715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba58423-0b72-4cc8-b7bc-363b74ce3d9e None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:35.231480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba58423-0b72-4cc8-b7bc-363b74ce3d9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:35.231810 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba58423-0b72-4cc8-b7bc-363b74ce3d9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:35.233219 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba58423-0b72-4cc8-b7bc-363b74ce3d9e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:35.245267 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 627/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 17:00:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:00:35.251097 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24b71c-ea05-4535-a26b-8b9c3f266186 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:35.359357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24b71c-ea05-4535-a26b-8b9c3f266186 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:35.390718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e9c2c-b592-49f7-840b-c90c6f30a638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:35.391591 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9c2c-b592-49f7-840b-c90c6f30a638 None admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:35.391900 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9c2c-b592-49f7-840b-c90c6f30a638 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:35.392174 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9c2c-b592-49f7-840b-c90c6f30a638 None admin] PATH_INFO: `/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/7730d6cad2ba40c19cb671268cf04d1d/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:35.394669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e9c2c-b592-49f7-840b-c90c6f30a638 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2b356e72cf84d099f2ce8678103ecef, user_id=7730d6cad2ba40c19cb671268cf04d1d, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:35.396114 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e9c2c-b592-49f7-840b-c90c6f30a638 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:35.408026 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 646/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 17:00:35 2022] PUT /identity/v3/projects/b2b356e72cf84d099f2ce8678103ecef/users/7730d6cad2ba40c19cb671268cf04d1d/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:00:37.603251 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c3f08-b08f-4398-ad98-9b258991d027 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:37.603802 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c3f08-b08f-4398-ad98-9b258991d027 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:37.603802 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c3f08-b08f-4398-ad98-9b258991d027 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:37.605176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 628/1274] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:00:37.610218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73846471-4b23-4899-aca7-6b42f7fd5579 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:37.610663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73846471-4b23-4899-aca7-6b42f7fd5579 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:37.610757 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73846471-4b23-4899-aca7-6b42f7fd5579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:37.628862 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-73846471-4b23-4899-aca7-6b42f7fd5579 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:00:37.630006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-73846471-4b23-4899-aca7-6b42f7fd5579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:00:37.692951 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 647/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:00:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 17:00:37.716169 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c3f08-b08f-4398-ad98-9b258991d027 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:37.809909 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c3f08-b08f-4398-ad98-9b258991d027 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:37.841166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ac3b2-5d7a-4de8-a1be-181a582748ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:37.841936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ac3b2-5d7a-4de8-a1be-181a582748ea None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:37.842238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ac3b2-5d7a-4de8-a1be-181a582748ea None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:37.842507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ac3b2-5d7a-4de8-a1be-181a582748ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:37.852048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ac3b2-5d7a-4de8-a1be-181a582748ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-751ac3b2-5d7a-4de8-a1be-181a582748ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:00:37.859463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:37.860598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:37.862133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:37.862133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:37.862133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:37.862133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:37.862133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:00:37.862133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:00:37.862133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:00:37.862133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:00:37.862133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:00:37.862133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:00:37.862133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:00:37.862133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:37.862133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 629/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 17:00:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:37.867064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73846471-4b23-4899-aca7-6b42f7fd5579 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:37.958675 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73846471-4b23-4899-aca7-6b42f7fd5579 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:37.990586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5a791-4951-4fdd-abca-02281ef311dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:37.991234 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5a791-4951-4fdd-abca-02281ef311dc None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:37.991510 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5a791-4951-4fdd-abca-02281ef311dc None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:37.991809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5a791-4951-4fdd-abca-02281ef311dc None admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:37.992539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5a791-4951-4fdd-abca-02281ef311dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:37.992839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5a791-4951-4fdd-abca-02281ef311dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:37.994190 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5a791-4951-4fdd-abca-02281ef311dc None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:38.001702 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 648/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 17:00:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:38.007151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ac3b2-5d7a-4de8-a1be-181a582748ea None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:38.101239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ac3b2-5d7a-4de8-a1be-181a582748ea None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:38.132226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c720c97-8132-48c5-a8a1-d867aeac253c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:38.132942 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c720c97-8132-48c5-a8a1-d867aeac253c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:38.133221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c720c97-8132-48c5-a8a1-d867aeac253c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:38.133492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c720c97-8132-48c5-a8a1-d867aeac253c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:38.143529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c720c97-8132-48c5-a8a1-d867aeac253c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:38.144985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c720c97-8132-48c5-a8a1-d867aeac253c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:38.161603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-0c720c97-8132-48c5-a8a1-d867aeac253c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:38.161603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:38.161603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:38.161603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:38.161603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:38.161603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:38.161603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:38.161603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:38.161603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:38.161603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:38.161603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:38.161603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:38.161603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:00:38.161603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:00:38.161603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:38.162652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:38.163795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:00:38.163795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:00:38.163795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:38.163795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:38.163795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 630/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:38.168380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5a791-4951-4fdd-abca-02281ef311dc None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:38.262951 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5a791-4951-4fdd-abca-02281ef311dc None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:38.301798 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cbf48-46ef-4dab-9420-b13e5cc35339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:38.302456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cbf48-46ef-4dab-9420-b13e5cc35339 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:38.302787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cbf48-46ef-4dab-9420-b13e5cc35339 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:38.303010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cbf48-46ef-4dab-9420-b13e5cc35339 None admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:38.303758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cbf48-46ef-4dab-9420-b13e5cc35339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:38.304071 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cbf48-46ef-4dab-9420-b13e5cc35339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:38.305472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cbf48-46ef-4dab-9420-b13e5cc35339 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:38.318532 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 649/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 17:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:38.324628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c720c97-8132-48c5-a8a1-d867aeac253c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:38.424288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c720c97-8132-48c5-a8a1-d867aeac253c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:38.456016 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ae0ac-69cc-4f85-99e2-a7370dfb855e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:38.456966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ae0ac-69cc-4f85-99e2-a7370dfb855e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:38.457243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ae0ac-69cc-4f85-99e2-a7370dfb855e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:38.457516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ae0ac-69cc-4f85-99e2-a7370dfb855e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:38.464603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ae0ac-69cc-4f85-99e2-a7370dfb855e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:38.466031 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ae0ac-69cc-4f85-99e2-a7370dfb855e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6c8ae0ac-69cc-4f85-99e2-a7370dfb855e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:00:38.479945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:38.481037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:38.482200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:38.482200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:38.482200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:00:38.482200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:00:38.482200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:00:38.482200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:00:38.482200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:00:38.482200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:00:38.482200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 17:00:38.482200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:38.482200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 631/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:38.487997 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cbf48-46ef-4dab-9420-b13e5cc35339 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:38.580716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cbf48-46ef-4dab-9420-b13e5cc35339 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:38.612019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb056c-cddb-4d32-8039-eb2f67f6d650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:38.612762 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb056c-cddb-4d32-8039-eb2f67f6d650 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:38.612939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb056c-cddb-4d32-8039-eb2f67f6d650 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:38.613209 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb056c-cddb-4d32-8039-eb2f67f6d650 None admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:38.614022 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb056c-cddb-4d32-8039-eb2f67f6d650 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:38.614327 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb056c-cddb-4d32-8039-eb2f67f6d650 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:38.615762 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb056c-cddb-4d32-8039-eb2f67f6d650 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:38.632281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 650/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 17 17:00:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:38.637822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ae0ac-69cc-4f85-99e2-a7370dfb855e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:38.730040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ae0ac-69cc-4f85-99e2-a7370dfb855e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:38.761099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d48fff-b71b-4ddf-be97-f44d3bde782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:38.761718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d48fff-b71b-4ddf-be97-f44d3bde782a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:38.761995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d48fff-b71b-4ddf-be97-f44d3bde782a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:38.762273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d48fff-b71b-4ddf-be97-f44d3bde782a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:38.824785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d48fff-b71b-4ddf-be97-f44d3bde782a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:38.826215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d48fff-b71b-4ddf-be97-f44d3bde782a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:38.917245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 632/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 17:00:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 17:00:38.922919 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb056c-cddb-4d32-8039-eb2f67f6d650 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:39.016121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb056c-cddb-4d32-8039-eb2f67f6d650 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:39.048327 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc7a2c-742e-47d3-a014-6b23ffca1858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:39.049131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc7a2c-742e-47d3-a014-6b23ffca1858 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:39.049412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc7a2c-742e-47d3-a014-6b23ffca1858 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:39.049686 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc7a2c-742e-47d3-a014-6b23ffca1858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:39.059337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc7a2c-742e-47d3-a014-6b23ffca1858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:39.060793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc7a2c-742e-47d3-a014-6b23ffca1858 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:39.078062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-48dc7a2c-742e-47d3-a014-6b23ffca1858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:39.078062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:39.078062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:39.078062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:39.078062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:39.078062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:39.078062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:39.078062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:39.078062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:39.078062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:39.078062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:39.078062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:39.078062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:00:39.078062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:00:39.078062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:39.079108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:39.080079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:00:39.080079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:00:39.080079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:00:39.080079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:39.080079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 651/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:39.085187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d48fff-b71b-4ddf-be97-f44d3bde782a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:39.178143 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d48fff-b71b-4ddf-be97-f44d3bde782a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:39.210125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92caad2c-2011-42d1-91d7-4e962e8a1906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:39.210765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92caad2c-2011-42d1-91d7-4e962e8a1906 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:39.211041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92caad2c-2011-42d1-91d7-4e962e8a1906 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:39.211312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92caad2c-2011-42d1-91d7-4e962e8a1906 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:39.212038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92caad2c-2011-42d1-91d7-4e962e8a1906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:39.212339 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92caad2c-2011-42d1-91d7-4e962e8a1906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:39.213678 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92caad2c-2011-42d1-91d7-4e962e8a1906 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:39.224984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 633/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 17:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:00:39.230520 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc7a2c-742e-47d3-a014-6b23ffca1858 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:39.330780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc7a2c-742e-47d3-a014-6b23ffca1858 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:39.362606 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428397a-1a2d-4cd7-8833-8e3e96129116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:39.363381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428397a-1a2d-4cd7-8833-8e3e96129116 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:39.363688 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428397a-1a2d-4cd7-8833-8e3e96129116 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:39.363962 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428397a-1a2d-4cd7-8833-8e3e96129116 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:39.370281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428397a-1a2d-4cd7-8833-8e3e96129116 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:39.371747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428397a-1a2d-4cd7-8833-8e3e96129116 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:39.385697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application [None req-5428397a-1a2d-4cd7-8833-8e3e96129116 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:00:39.385697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:39.385697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:39.385697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:39.385697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:39.385697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:39.385697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:39.385697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:39.385697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:39.385697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:39.385697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:39.385697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:39.385697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:00:39.385697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:00:39.385697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application with Lock( May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:39.386723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:39.387854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:00:39.387854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:00:39.387854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:00:39.387854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:00:39.387854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:00:39.387854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:00:39.387854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:00:39.387854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: ERROR keystone.server.flask.application May 17 17:00:39.387854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 652/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 17:00:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:39.393261 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92caad2c-2011-42d1-91d7-4e962e8a1906 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:39.485481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92caad2c-2011-42d1-91d7-4e962e8a1906 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:39.516691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af708926-dcd3-45d9-bf73-afe5de9dbcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:39.517332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af708926-dcd3-45d9-bf73-afe5de9dbcac None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:39.518237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af708926-dcd3-45d9-bf73-afe5de9dbcac None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:39.518574 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af708926-dcd3-45d9-bf73-afe5de9dbcac None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:39.519327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af708926-dcd3-45d9-bf73-afe5de9dbcac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:39.519658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af708926-dcd3-45d9-bf73-afe5de9dbcac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:39.521079 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af708926-dcd3-45d9-bf73-afe5de9dbcac None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:39.532313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 634/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 17:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:39.538231 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428397a-1a2d-4cd7-8833-8e3e96129116 None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:39.631327 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428397a-1a2d-4cd7-8833-8e3e96129116 None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:39.662339 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095a992-37a1-4c4d-be62-4766dfb1ca7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:39.662967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095a992-37a1-4c4d-be62-4766dfb1ca7d None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:39.663248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095a992-37a1-4c4d-be62-4766dfb1ca7d None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:39.663523 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095a992-37a1-4c4d-be62-4766dfb1ca7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:39.664486 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095a992-37a1-4c4d-be62-4766dfb1ca7d None admin] RBAC: Adding query filter params (role.id=04c37f430c9a4af3beb85a9f2c0f6bea, scope.project.id=b2b356e72cf84d099f2ce8678103ecef, user.id=7730d6cad2ba40c19cb671268cf04d1d) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:39.664798 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095a992-37a1-4c4d-be62-4766dfb1ca7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:39.666197 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095a992-37a1-4c4d-be62-4766dfb1ca7d None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:39.674453 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 653/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 17:00:39 2022] GET /identity/v3/role_assignments?user.id=7730d6cad2ba40c19cb671268cf04d1d&scope.project.id=b2b356e72cf84d099f2ce8678103ecef&role.id=04c37f430c9a4af3beb85a9f2c0f6bea => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:41.864324 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20face03-0843-4396-860b-af0eca7ce8c8 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:41.864860 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20face03-0843-4396-860b-af0eca7ce8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:41.864860 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20face03-0843-4396-860b-af0eca7ce8c8 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:41.866234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 635/1288] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:00:41.871357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc4693-6fdb-4e10-bb5a-501c933cdadd None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:41.871804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc4693-6fdb-4e10-bb5a-501c933cdadd None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:41.871932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc4693-6fdb-4e10-bb5a-501c933cdadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:41.888025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a0bc4693-6fdb-4e10-bb5a-501c933cdadd None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:00:41.889186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a0bc4693-6fdb-4e10-bb5a-501c933cdadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:00:41.951309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 654/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:00:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 17:00:41.973980 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20face03-0843-4396-860b-af0eca7ce8c8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:42.068960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20face03-0843-4396-860b-af0eca7ce8c8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:42.105330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cebee7-ba4c-4dc0-aa5d-9a46bad292e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:42.106130 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cebee7-ba4c-4dc0-aa5d-9a46bad292e0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:42.106412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cebee7-ba4c-4dc0-aa5d-9a46bad292e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:42.106689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cebee7-ba4c-4dc0-aa5d-9a46bad292e0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:42.107336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cebee7-ba4c-4dc0-aa5d-9a46bad292e0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:42.108739 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cebee7-ba4c-4dc0-aa5d-9a46bad292e0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c1cebee7-ba4c-4dc0-aa5d-9a46bad292e0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:42.121549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:42.122843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:42.123921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:42.123921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:42.123921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:42.123921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:42.123921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:42.123921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:42.123921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:42.123921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:42.123921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:42.123921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:42.123921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 17:00:42.123921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 17:00:42.123921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 17:00:42.123921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:42.124933 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 636/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 17:00:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:42.130176 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc4693-6fdb-4e10-bb5a-501c933cdadd None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:42.222090 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc4693-6fdb-4e10-bb5a-501c933cdadd None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:42.252841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52eac3-2fb0-493e-9f76-a7a54eb8f434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:42.253481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52eac3-2fb0-493e-9f76-a7a54eb8f434 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:42.253758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52eac3-2fb0-493e-9f76-a7a54eb8f434 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:42.254052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52eac3-2fb0-493e-9f76-a7a54eb8f434 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:42.254841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52eac3-2fb0-493e-9f76-a7a54eb8f434 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:42.255217 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52eac3-2fb0-493e-9f76-a7a54eb8f434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:42.256941 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52eac3-2fb0-493e-9f76-a7a54eb8f434 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:42.262652 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 655/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Tue May 17 17:00:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:00:42.269939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cebee7-ba4c-4dc0-aa5d-9a46bad292e0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:42.377489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cebee7-ba4c-4dc0-aa5d-9a46bad292e0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:42.408355 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d38c7-0f24-4b34-92c7-2a0c0195383c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:42.409006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d38c7-0f24-4b34-92c7-2a0c0195383c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:42.409281 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d38c7-0f24-4b34-92c7-2a0c0195383c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:42.409549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d38c7-0f24-4b34-92c7-2a0c0195383c None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:42.410240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d38c7-0f24-4b34-92c7-2a0c0195383c None admin] RBAC: Adding query filter params (type=placement) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:42.410542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d38c7-0f24-4b34-92c7-2a0c0195383c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:42.411940 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d38c7-0f24-4b34-92c7-2a0c0195383c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:42.416127 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 637/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Tue May 17 17:00:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:44.628452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236f968-7a0d-404c-a833-84a03215eced None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:44.629062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236f968-7a0d-404c-a833-84a03215eced None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:44.629062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236f968-7a0d-404c-a833-84a03215eced None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:44.630374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 656/1293] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:00:44.635404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d105b8-f751-4837-a228-99cc80df3e67 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:44.635863 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d105b8-f751-4837-a228-99cc80df3e67 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:44.636001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d105b8-f751-4837-a228-99cc80df3e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:44.652837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d7d105b8-f751-4837-a228-99cc80df3e67 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:00:44.653994 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d7d105b8-f751-4837-a228-99cc80df3e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:00:44.716423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 638/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:00:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 17:00:44.738501 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236f968-7a0d-404c-a833-84a03215eced None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:44.834315 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236f968-7a0d-404c-a833-84a03215eced None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:44.865287 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e666a6-7adc-4976-9304-b2b6cf86868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:44.865931 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e666a6-7adc-4976-9304-b2b6cf86868a None admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:44.866211 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e666a6-7adc-4976-9304-b2b6cf86868a None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:44.866483 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e666a6-7adc-4976-9304-b2b6cf86868a None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:44.867185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e666a6-7adc-4976-9304-b2b6cf86868a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:44.868579 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e666a6-7adc-4976-9304-b2b6cf86868a None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:44.881304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 657/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 17:00:44 2022] POST /identity/v3/services => generated 246 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:00:47.087066 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fb8a4-916a-42fd-a41e-1aac2898fbc4 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:47.087632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fb8a4-916a-42fd-a41e-1aac2898fbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:47.087632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fb8a4-916a-42fd-a41e-1aac2898fbc4 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:47.089018 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 639/1296] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:00:47.094478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eba3e6-8ddb-437a-a9c7-539136c7d6c6 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:47.094890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eba3e6-8ddb-437a-a9c7-539136c7d6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:47.095033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eba3e6-8ddb-437a-a9c7-539136c7d6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:47.111073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d4eba3e6-8ddb-437a-a9c7-539136c7d6c6 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:00:47.112252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d4eba3e6-8ddb-437a-a9c7-539136c7d6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:00:47.181142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 658/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:00:47 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 17:00:47.203911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fb8a4-916a-42fd-a41e-1aac2898fbc4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:47.305727 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fb8a4-916a-42fd-a41e-1aac2898fbc4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:47.337697 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfe896-4572-4e0b-b867-00dc91613cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:47.338423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe896-4572-4e0b-b867-00dc91613cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:47.338703 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe896-4572-4e0b-b867-00dc91613cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:47.338975 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe896-4572-4e0b-b867-00dc91613cf5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:47.339638 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfe896-4572-4e0b-b867-00dc91613cf5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:47.341015 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfe896-4572-4e0b-b867-00dc91613cf5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-e3dfe896-4572-4e0b-b867-00dc91613cf5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:47.352468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:47.353652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:47.354518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:47.354518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:47.354518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:47.354518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:47.354518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:47.354518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:47.354518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:47.354518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:47.354518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:47.354518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:47.354518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 17:00:47.354518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 17:00:47.354518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 17:00:47.354518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:47.354518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 640/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 17:00:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:47.359731 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eba3e6-8ddb-437a-a9c7-539136c7d6c6 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:47.451871 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eba3e6-8ddb-437a-a9c7-539136c7d6c6 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:47.482584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b2338-7aaa-49e6-abba-1439b947b5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:47.483226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b2338-7aaa-49e6-abba-1439b947b5de None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:47.483504 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b2338-7aaa-49e6-abba-1439b947b5de None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:47.483808 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b2338-7aaa-49e6-abba-1439b947b5de None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:47.484496 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b2338-7aaa-49e6-abba-1439b947b5de None admin] RBAC: Adding query filter params (name=placement) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:47.484794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b2338-7aaa-49e6-abba-1439b947b5de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:47.486136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b2338-7aaa-49e6-abba-1439b947b5de None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:47.491736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 659/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Tue May 17 17:00:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:47.497473 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfe896-4572-4e0b-b867-00dc91613cf5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:47.590581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfe896-4572-4e0b-b867-00dc91613cf5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:47.621919 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936944bc-d683-4488-a3d1-24bdf1c3c057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:47.622557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936944bc-d683-4488-a3d1-24bdf1c3c057 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:47.622837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936944bc-d683-4488-a3d1-24bdf1c3c057 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:47.623110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936944bc-d683-4488-a3d1-24bdf1c3c057 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:47.623909 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936944bc-d683-4488-a3d1-24bdf1c3c057 None admin] RBAC: Adding query filter params (interface=public, service_id=994200ed508f4234954d4f58e194355c, region_id=RegionOne) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:47.624223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936944bc-d683-4488-a3d1-24bdf1c3c057 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:47.625571 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936944bc-d683-4488-a3d1-24bdf1c3c057 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:47.630451 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 641/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 17:00:47 2022] GET /identity/v3/endpoints?service_id=994200ed508f4234954d4f58e194355c&interface=public®ion_id=RegionOne => generated 194 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:47.635851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b2338-7aaa-49e6-abba-1439b947b5de None admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:47.727812 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b2338-7aaa-49e6-abba-1439b947b5de None admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:47.759261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cdc49-d00d-47ad-a4da-391be690ab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:47.759927 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cdc49-d00d-47ad-a4da-391be690ab75 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:47.760206 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cdc49-d00d-47ad-a4da-391be690ab75 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:47.760475 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cdc49-d00d-47ad-a4da-391be690ab75 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:47.761156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8cdc49-d00d-47ad-a4da-391be690ab75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:47.762485 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8cdc49-d00d-47ad-a4da-391be690ab75 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:47.769141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 660/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 17:00:47 2022] GET /identity/v3/services => generated 2191 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:00:49.977581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27ff22-30f5-4dff-8ca4-bd757813c0a8 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:49.978137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27ff22-30f5-4dff-8ca4-bd757813c0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:49.978137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27ff22-30f5-4dff-8ca4-bd757813c0a8 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:49.979485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 642/1302] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:00:49.984536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113ab7f-5c8a-49f6-8ac9-702f8fef0122 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:49.984910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113ab7f-5c8a-49f6-8ac9-702f8fef0122 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:49.985083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113ab7f-5c8a-49f6-8ac9-702f8fef0122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:50.001878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0113ab7f-5c8a-49f6-8ac9-702f8fef0122 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:00:50.003054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0113ab7f-5c8a-49f6-8ac9-702f8fef0122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:00:50.065279 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 661/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:00:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 17:00:50.087187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27ff22-30f5-4dff-8ca4-bd757813c0a8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:50.183392 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27ff22-30f5-4dff-8ca4-bd757813c0a8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:50.214572 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637470f4-5e09-4d75-9754-bc773a6d5add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:50.215354 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637470f4-5e09-4d75-9754-bc773a6d5add None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:50.215658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637470f4-5e09-4d75-9754-bc773a6d5add None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:50.215933 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637470f4-5e09-4d75-9754-bc773a6d5add None admin] PATH_INFO: `/v3/services/placement` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:50.216570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637470f4-5e09-4d75-9754-bc773a6d5add None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:50.217913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637470f4-5e09-4d75-9754-bc773a6d5add None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-637470f4-5e09-4d75-9754-bc773a6d5add None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:00:50.230070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:00:50.231234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:00:50.232525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:00:50.232525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( May 17 17:00:50.232525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:00:50.232525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() May 17 17:00:50.232525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:00:50.232525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:00:50.232525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:00:50.232525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() May 17 17:00:50.232525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:00:50.232525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( May 17 17:00:50.232525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 17:00:50.232525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 17:00:50.232525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 17:00:50.232525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application May 17 17:00:50.232525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 643/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 17:00:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:00:50.237240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113ab7f-5c8a-49f6-8ac9-702f8fef0122 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:50.331019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113ab7f-5c8a-49f6-8ac9-702f8fef0122 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:50.364415 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36512e63-23c0-4672-9441-c4541fb73837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:50.365064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36512e63-23c0-4672-9441-c4541fb73837 None admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:50.365343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36512e63-23c0-4672-9441-c4541fb73837 None admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:50.365618 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36512e63-23c0-4672-9441-c4541fb73837 None admin] PATH_INFO: `/v3/services` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:50.366309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36512e63-23c0-4672-9441-c4541fb73837 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:00:50.366612 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36512e63-23c0-4672-9441-c4541fb73837 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:50.367997 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36512e63-23c0-4672-9441-c4541fb73837 None admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:50.372949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 662/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Tue May 17 17:00:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:00:50.379344 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637470f4-5e09-4d75-9754-bc773a6d5add None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:00:50.473761 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637470f4-5e09-4d75-9754-bc773a6d5add None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:00:50.505007 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a225cd9-e775-4089-bc9f-de98b9a1b1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:00:50.505585 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a225cd9-e775-4089-bc9f-de98b9a1b1ba None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:00:50.505864 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a225cd9-e775-4089-bc9f-de98b9a1b1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:00:50.506137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a225cd9-e775-4089-bc9f-de98b9a1b1ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:00:50.506864 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a225cd9-e775-4089-bc9f-de98b9a1b1ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:00:50.508245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a225cd9-e775-4089-bc9f-de98b9a1b1ba None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:00:50.527337 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 644/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 17:00:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:01:54.054472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fdd41-6acb-4861-ba74-910c9259424f None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:01:54.055391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fdd41-6acb-4861-ba74-910c9259424f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:01:54.055878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fdd41-6acb-4861-ba74-910c9259424f None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:01:54.057659 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 663/1307] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:01:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:01:54.063135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d6ea-42a5-4075-9217-46cdfe3fc878 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:01:54.063918 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d6ea-42a5-4075-9217-46cdfe3fc878 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:01:54.064346 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d6ea-42a5-4075-9217-46cdfe3fc878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:01:54.140088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-83d1d6ea-42a5-4075-9217-46cdfe3fc878 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:01:54.141688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-83d1d6ea-42a5-4075-9217-46cdfe3fc878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:01:54.247851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 645/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:01:54.299322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f0312-07df-4659-9ffe-f2a4b7c59ccd None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:01:54.300012 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f0312-07df-4659-9ffe-f2a4b7c59ccd None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:01:54.300481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f0312-07df-4659-9ffe-f2a4b7c59ccd None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:01:54.302474 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 664/1309] 10.222.0.48 () {54 vars in 964 bytes} [Tue May 17 17:01:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:01:54.309081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c79e-5f7c-4a48-af2e-cffc4522aa9d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:01:54.309371 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c79e-5f7c-4a48-af2e-cffc4522aa9d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:01:54.309648 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c79e-5f7c-4a48-af2e-cffc4522aa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:01:54.394446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-aff6c79e-5f7c-4a48-af2e-cffc4522aa9d None None] MFA Rules not processed for user `5819e022286b454e9e2f23d975c6e921`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:01:54.395675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-aff6c79e-5f7c-4a48-af2e-cffc4522aa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:01:54.473458 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 646/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Tue May 17 17:01:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:01:54.482161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f0312-07df-4659-9ffe-f2a4b7c59ccd None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:01:54.485700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-369f0312-07df-4659-9ffe-f2a4b7c59ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:01:54.684868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f0312-07df-4659-9ffe-f2a4b7c59ccd None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:01:54.803176 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb716dc5-a622-4aab-aab3-0f5bb754e4ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:01:54.803903 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb716dc5-a622-4aab-aab3-0f5bb754e4ed service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:01:54.805017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb716dc5-a622-4aab-aab3-0f5bb754e4ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:01:54.805307 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb716dc5-a622-4aab-aab3-0f5bb754e4ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:01:54.807255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-eb716dc5-a622-4aab-aab3-0f5bb754e4ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:01:54.930015 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb716dc5-a622-4aab-aab3-0f5bb754e4ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:01:54.932166 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb716dc5-a622-4aab-aab3-0f5bb754e4ed service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:01:54.952958 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 665/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:01:57.481220 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e54a7a-3dd4-4f26-9e38-3746334e7b66 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:01:57.481763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e54a7a-3dd4-4f26-9e38-3746334e7b66 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:01:57.481763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e54a7a-3dd4-4f26-9e38-3746334e7b66 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:01:57.484027 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 647/1312] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:01:57.489120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128376e-9ddc-40e6-a06e-7b3340b3699c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:01:57.489549 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128376e-9ddc-40e6-a06e-7b3340b3699c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:01:57.489660 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128376e-9ddc-40e6-a06e-7b3340b3699c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:01:57.572052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a128376e-9ddc-40e6-a06e-7b3340b3699c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:01:57.573232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a128376e-9ddc-40e6-a06e-7b3340b3699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:01:57.677574 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 666/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:01:57.731961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fb454-6945-4121-b4a1-775592e12798 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:01:57.732246 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fb454-6945-4121-b4a1-775592e12798 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:01:57.733474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fb454-6945-4121-b4a1-775592e12798 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:01:57.734942 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 648/1314] 10.222.0.48 () {54 vars in 964 bytes} [Tue May 17 17:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:01:57.741139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c1c87-af08-4094-9851-c14c852c3684 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:01:57.741434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c1c87-af08-4094-9851-c14c852c3684 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:01:57.741719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c1c87-af08-4094-9851-c14c852c3684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:01:57.820978 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-9c2c1c87-af08-4094-9851-c14c852c3684 None None] MFA Rules not processed for user `5819e022286b454e9e2f23d975c6e921`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:01:57.822344 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9c2c1c87-af08-4094-9851-c14c852c3684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:01:57.901049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 667/1315] 10.222.0.48 () {58 vars in 1061 bytes} [Tue May 17 17:01:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:01:57.910131 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fb454-6945-4121-b4a1-775592e12798 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:01:57.911641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c75fb454-6945-4121-b4a1-775592e12798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:01:58.019873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fb454-6945-4121-b4a1-775592e12798 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:01:58.097013 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf861b73-248a-4de3-8620-df66b1561cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:01:58.097671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf861b73-248a-4de3-8620-df66b1561cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:01:58.097955 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf861b73-248a-4de3-8620-df66b1561cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:01:58.098232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf861b73-248a-4de3-8620-df66b1561cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:01:58.099925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cf861b73-248a-4de3-8620-df66b1561cb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:01:58.208352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf861b73-248a-4de3-8620-df66b1561cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:01:58.209833 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf861b73-248a-4de3-8620-df66b1561cb1 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:01:58.228327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 649/1316] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:02:00.992670 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49debbf5-aa09-4afb-9bab-1db40b230d3f None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:00.993203 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49debbf5-aa09-4afb-9bab-1db40b230d3f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:00.993203 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49debbf5-aa09-4afb-9bab-1db40b230d3f None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:00.994581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 668/1317] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:01.000551 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12a3c3-c8d2-4681-89d4-112401d16498 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:01.000951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12a3c3-c8d2-4681-89d4-112401d16498 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:01.001102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12a3c3-c8d2-4681-89d4-112401d16498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:01.063560 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4d12a3c3-c8d2-4681-89d4-112401d16498 None None] MFA Rules not processed for user `3058449ec8824214b72208846e9a93f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:01.064790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4d12a3c3-c8d2-4681-89d4-112401d16498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:01.158409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 650/1318] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:02:01.197457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49debbf5-aa09-4afb-9bab-1db40b230d3f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:01.198970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-49debbf5-aa09-4afb-9bab-1db40b230d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:01.297041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49debbf5-aa09-4afb-9bab-1db40b230d3f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:01.365610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86447a10-9c7a-4d0c-a396-64712e5cc86a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:01.366249 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86447a10-9c7a-4d0c-a396-64712e5cc86a service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:01.366527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86447a10-9c7a-4d0c-a396-64712e5cc86a service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:01.366801 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86447a10-9c7a-4d0c-a396-64712e5cc86a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:01.368442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-86447a10-9c7a-4d0c-a396-64712e5cc86a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:01.471624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86447a10-9c7a-4d0c-a396-64712e5cc86a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:01.473065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86447a10-9c7a-4d0c-a396-64712e5cc86a service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:01.491270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 669/1319] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:02:04.227343 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a0948-795d-4beb-bc8e-f602c28988fd None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:04.227900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a0948-795d-4beb-bc8e-f602c28988fd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:04.228017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a0948-795d-4beb-bc8e-f602c28988fd None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:04.229578 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 651/1320] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:04.235023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd015a3-40dd-4e9a-a8f4-7e125b9b40e3 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:04.235462 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd015a3-40dd-4e9a-a8f4-7e125b9b40e3 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:04.235559 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd015a3-40dd-4e9a-a8f4-7e125b9b40e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:04.299659 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1bd015a3-40dd-4e9a-a8f4-7e125b9b40e3 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:04.300856 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1bd015a3-40dd-4e9a-a8f4-7e125b9b40e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:04.392879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 670/1321] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:04.431161 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a0948-795d-4beb-bc8e-f602c28988fd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:04.432752 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ba3a0948-795d-4beb-bc8e-f602c28988fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:04.530237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a0948-795d-4beb-bc8e-f602c28988fd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:04.599199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd77d78-291e-4958-a34d-c0b68d316a83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:04.599798 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd77d78-291e-4958-a34d-c0b68d316a83 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:04.600075 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd77d78-291e-4958-a34d-c0b68d316a83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:04.600342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd77d78-291e-4958-a34d-c0b68d316a83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:04.601924 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cbd77d78-291e-4958-a34d-c0b68d316a83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:04.704654 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd77d78-291e-4958-a34d-c0b68d316a83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:04.706081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd77d78-291e-4958-a34d-c0b68d316a83 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:04.723992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 652/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:02:07.844816 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d672641-d578-4b97-a739-be4eb0b23c62 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:07.845384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d672641-d578-4b97-a739-be4eb0b23c62 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:07.845384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d672641-d578-4b97-a739-be4eb0b23c62 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:07.846748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 671/1323] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:07.851991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5051361-1200-4785-8760-5eaac79785d0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:07.852417 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5051361-1200-4785-8760-5eaac79785d0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:07.852549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5051361-1200-4785-8760-5eaac79785d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:07.917273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f5051361-1200-4785-8760-5eaac79785d0 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:07.918445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f5051361-1200-4785-8760-5eaac79785d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:08.013029 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 653/1324] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:08.049598 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d672641-d578-4b97-a739-be4eb0b23c62 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:08.051037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3d672641-d578-4b97-a739-be4eb0b23c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:08.150514 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d672641-d578-4b97-a739-be4eb0b23c62 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:08.221829 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e9b98-6479-4870-92eb-25206ef53828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:08.222522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e9b98-6479-4870-92eb-25206ef53828 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:08.222806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e9b98-6479-4870-92eb-25206ef53828 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:08.223078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e9b98-6479-4870-92eb-25206ef53828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:08.224732 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-329e9b98-6479-4870-92eb-25206ef53828 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:08.331275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e9b98-6479-4870-92eb-25206ef53828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:08.332766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e9b98-6479-4870-92eb-25206ef53828 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:08.352717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 672/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:02:10.682182 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3d95e-910c-4501-b4bc-282f6970a952 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:10.682758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3d95e-910c-4501-b4bc-282f6970a952 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:10.682758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3d95e-910c-4501-b4bc-282f6970a952 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:10.684165 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 654/1326] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:10.690021 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15393e1-9d2f-4cf2-80fe-f2b986b79467 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:10.690429 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15393e1-9d2f-4cf2-80fe-f2b986b79467 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:10.690579 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15393e1-9d2f-4cf2-80fe-f2b986b79467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:10.754066 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c15393e1-9d2f-4cf2-80fe-f2b986b79467 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:10.755269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c15393e1-9d2f-4cf2-80fe-f2b986b79467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:10.851691 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 673/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:10.887749 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3d95e-910c-4501-b4bc-282f6970a952 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:10.889613 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-94b3d95e-910c-4501-b4bc-282f6970a952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:10.989989 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3d95e-910c-4501-b4bc-282f6970a952 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:11.060475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cd72f-bc71-4914-899f-4f868d70495a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:11.061482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cd72f-bc71-4914-899f-4f868d70495a service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:11.061763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cd72f-bc71-4914-899f-4f868d70495a service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:11.062033 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cd72f-bc71-4914-899f-4f868d70495a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:11.063652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c71cd72f-bc71-4914-899f-4f868d70495a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:11.171740 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cd72f-bc71-4914-899f-4f868d70495a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:11.173195 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cd72f-bc71-4914-899f-4f868d70495a service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:11.191998 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 655/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:02:13.675305 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8596f0-afd5-4497-bc2a-6074c54d1e49 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:13.675874 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8596f0-afd5-4497-bc2a-6074c54d1e49 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:13.675874 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8596f0-afd5-4497-bc2a-6074c54d1e49 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:13.677276 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 674/1329] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:13.682969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb780a0-be63-4c86-8e00-4cff4604ca32 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:13.683442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb780a0-be63-4c86-8e00-4cff4604ca32 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:13.683550 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb780a0-be63-4c86-8e00-4cff4604ca32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:13.760092 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2eb780a0-be63-4c86-8e00-4cff4604ca32 None None] MFA Rules not processed for user `3058449ec8824214b72208846e9a93f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:13.761305 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2eb780a0-be63-4c86-8e00-4cff4604ca32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:13.856495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 656/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:13 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:13.893612 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8596f0-afd5-4497-bc2a-6074c54d1e49 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:13.895200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4e8596f0-afd5-4497-bc2a-6074c54d1e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:13.997351 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8596f0-afd5-4497-bc2a-6074c54d1e49 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:14.068006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7bf27-fcc1-43c4-94df-ac205aaf6b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:14.068657 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7bf27-fcc1-43c4-94df-ac205aaf6b21 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:14.068938 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7bf27-fcc1-43c4-94df-ac205aaf6b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:14.069214 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7bf27-fcc1-43c4-94df-ac205aaf6b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:14.070819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c1c7bf27-fcc1-43c4-94df-ac205aaf6b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:14.175738 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7bf27-fcc1-43c4-94df-ac205aaf6b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:14.177212 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7bf27-fcc1-43c4-94df-ac205aaf6b21 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:14.194773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 675/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:13 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:02:16.748949 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe537096-3dc5-4691-97cb-cf8b9e53fc0b None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:16.749407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe537096-3dc5-4691-97cb-cf8b9e53fc0b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:16.749520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe537096-3dc5-4691-97cb-cf8b9e53fc0b None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:16.750852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 657/1332] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:16.756102 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ab45a-4d6f-4eb8-8405-21044f680026 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:16.756576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ab45a-4d6f-4eb8-8405-21044f680026 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:16.756681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ab45a-4d6f-4eb8-8405-21044f680026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:16.818976 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-552ab45a-4d6f-4eb8-8405-21044f680026 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:16.820196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-552ab45a-4d6f-4eb8-8405-21044f680026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:16.913389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 676/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:16.949566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe537096-3dc5-4691-97cb-cf8b9e53fc0b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:16.951780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fe537096-3dc5-4691-97cb-cf8b9e53fc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:17.057037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe537096-3dc5-4691-97cb-cf8b9e53fc0b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:17.131878 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d2f1f-279d-48ed-a0fa-bb6304282339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:17.132527 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d2f1f-279d-48ed-a0fa-bb6304282339 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:17.132804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d2f1f-279d-48ed-a0fa-bb6304282339 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:17.133074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d2f1f-279d-48ed-a0fa-bb6304282339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:17.134732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d57d2f1f-279d-48ed-a0fa-bb6304282339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:17.242411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d2f1f-279d-48ed-a0fa-bb6304282339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:17.243812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d2f1f-279d-48ed-a0fa-bb6304282339 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:17.262386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 658/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:02:19.540312 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d13fe5-a4a8-42b5-a4c0-d74eea6d8705 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:19.540851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d13fe5-a4a8-42b5-a4c0-d74eea6d8705 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:19.540851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d13fe5-a4a8-42b5-a4c0-d74eea6d8705 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:19.542372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 677/1335] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:19.547398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54bfb9-2f8a-48d5-a38e-14d93118ce96 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:19.547847 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54bfb9-2f8a-48d5-a38e-14d93118ce96 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:19.547995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54bfb9-2f8a-48d5-a38e-14d93118ce96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:19.610165 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6c54bfb9-2f8a-48d5-a38e-14d93118ce96 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:19.611350 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6c54bfb9-2f8a-48d5-a38e-14d93118ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:19.704047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 659/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:19.743581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d13fe5-a4a8-42b5-a4c0-d74eea6d8705 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:19.745142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-77d13fe5-a4a8-42b5-a4c0-d74eea6d8705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:19.845402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d13fe5-a4a8-42b5-a4c0-d74eea6d8705 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:19.915434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d3b83-0fa7-44f0-b32e-d019fb65179c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:19.916099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d3b83-0fa7-44f0-b32e-d019fb65179c service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:19.916381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d3b83-0fa7-44f0-b32e-d019fb65179c service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:19.916654 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d3b83-0fa7-44f0-b32e-d019fb65179c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:19.918274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8e3d3b83-0fa7-44f0-b32e-d019fb65179c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:20.021134 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d3b83-0fa7-44f0-b32e-d019fb65179c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:20.022555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d3b83-0fa7-44f0-b32e-d019fb65179c service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:20.039766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 678/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:02:22.580458 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bfb9c-92b9-446c-be11-b0d489f72b43 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:22.581008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bfb9c-92b9-446c-be11-b0d489f72b43 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:22.581008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bfb9c-92b9-446c-be11-b0d489f72b43 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:22.582359 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 660/1338] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:22.587475 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f984cd5-0267-4743-bd3c-3e476b5f2fe2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:22.587914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f984cd5-0267-4743-bd3c-3e476b5f2fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:22.588083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f984cd5-0267-4743-bd3c-3e476b5f2fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:22.650342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-8f984cd5-0267-4743-bd3c-3e476b5f2fe2 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:22.651544 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8f984cd5-0267-4743-bd3c-3e476b5f2fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:22.744842 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 679/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:22.780665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bfb9c-92b9-446c-be11-b0d489f72b43 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:22.782172 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ca4bfb9c-92b9-446c-be11-b0d489f72b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:22.880763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bfb9c-92b9-446c-be11-b0d489f72b43 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:22.951155 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b231bb-ea49-4022-b556-41b8954e3cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:22.951837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b231bb-ea49-4022-b556-41b8954e3cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:22.952112 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b231bb-ea49-4022-b556-41b8954e3cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:22.952379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b231bb-ea49-4022-b556-41b8954e3cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:22.954163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d5b231bb-ea49-4022-b556-41b8954e3cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:23.058201 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b231bb-ea49-4022-b556-41b8954e3cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:23.059786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b231bb-ea49-4022-b556-41b8954e3cb2 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:23.077665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 661/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:02:27.310533 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a013a-91cf-4472-b838-38e68a8a6de9 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:27.311065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a013a-91cf-4472-b838-38e68a8a6de9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:27.311065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a013a-91cf-4472-b838-38e68a8a6de9 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:27.312416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 680/1341] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:27.317574 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6720b-d138-49b7-bb45-2c631fd9b42b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:27.317991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6720b-d138-49b7-bb45-2c631fd9b42b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:27.318111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6720b-d138-49b7-bb45-2c631fd9b42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:27.389027 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a9d6720b-d138-49b7-bb45-2c631fd9b42b None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:27.390238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a9d6720b-d138-49b7-bb45-2c631fd9b42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:27.493688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 662/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:27.531708 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a013a-91cf-4472-b838-38e68a8a6de9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:27.533798 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-057a013a-91cf-4472-b838-38e68a8a6de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:27.628975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a013a-91cf-4472-b838-38e68a8a6de9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:27.632533 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a2537-7f5a-4d12-8b5b-dd1c7a3a383f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:27.633168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a2537-7f5a-4d12-8b5b-dd1c7a3a383f service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:27.633450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a2537-7f5a-4d12-8b5b-dd1c7a3a383f service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:27.633722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a2537-7f5a-4d12-8b5b-dd1c7a3a383f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:27.642685 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a2537-7f5a-4d12-8b5b-dd1c7a3a383f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:27.644096 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a2537-7f5a-4d12-8b5b-dd1c7a3a383f service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:27.653860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 681/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:02:30.526964 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c835cc-ded7-413a-a272-9a80bedf4a65 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:30.527500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c835cc-ded7-413a-a272-9a80bedf4a65 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:30.527500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c835cc-ded7-413a-a272-9a80bedf4a65 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:30.528875 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 663/1344] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:30.534166 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387609-d563-443c-aaed-95aec5ad4d71 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:30.534586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387609-d563-443c-aaed-95aec5ad4d71 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:30.534738 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387609-d563-443c-aaed-95aec5ad4d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:30.564470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-bc387609-d563-443c-aaed-95aec5ad4d71 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:30.565650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-bc387609-d563-443c-aaed-95aec5ad4d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:30.639575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 682/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:30.675860 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c835cc-ded7-413a-a272-9a80bedf4a65 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:30.687180 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c835cc-ded7-413a-a272-9a80bedf4a65 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:30.690812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479dde5-240c-46fe-b295-8dc40549da35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:30.691447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479dde5-240c-46fe-b295-8dc40549da35 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:30.691767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479dde5-240c-46fe-b295-8dc40549da35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:30.692043 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479dde5-240c-46fe-b295-8dc40549da35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:30.701424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479dde5-240c-46fe-b295-8dc40549da35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:30.702847 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479dde5-240c-46fe-b295-8dc40549da35 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:30.712138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 664/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:02:35.059583 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf4c74-a7fa-465c-a9c8-333d3b44d115 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:35.060120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf4c74-a7fa-465c-a9c8-333d3b44d115 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:35.060239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf4c74-a7fa-465c-a9c8-333d3b44d115 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:35.061542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 683/1347] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:35.066687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee6762-ef74-486b-8884-1059740ef9fe None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:35.067123 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee6762-ef74-486b-8884-1059740ef9fe None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:35.067246 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee6762-ef74-486b-8884-1059740ef9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:35.085322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8dee6762-ef74-486b-8884-1059740ef9fe None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:35.086499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8dee6762-ef74-486b-8884-1059740ef9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:35.096038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 665/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:35.133729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf4c74-a7fa-465c-a9c8-333d3b44d115 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:35.144436 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf4c74-a7fa-465c-a9c8-333d3b44d115 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:35.147865 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c31ab4-1cd7-4c27-b83e-fcbeb967ea56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:35.148495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c31ab4-1cd7-4c27-b83e-fcbeb967ea56 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:35.148831 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c31ab4-1cd7-4c27-b83e-fcbeb967ea56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:35.149113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c31ab4-1cd7-4c27-b83e-fcbeb967ea56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:35.158519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c31ab4-1cd7-4c27-b83e-fcbeb967ea56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:35.160011 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c31ab4-1cd7-4c27-b83e-fcbeb967ea56 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:35.170055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 684/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:02:40.613488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6d7a6-57bc-4bfd-9009-78bf634fa3e3 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:40.614368 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6d7a6-57bc-4bfd-9009-78bf634fa3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:40.614821 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6d7a6-57bc-4bfd-9009-78bf634fa3e3 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:40.616675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 666/1350] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 17:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:40.621736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995cd55-7a82-4d26-a4ff-82285dce4d8f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:40.622556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995cd55-7a82-4d26-a4ff-82285dce4d8f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:40.623917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995cd55-7a82-4d26-a4ff-82285dce4d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:40.703655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b995cd55-7a82-4d26-a4ff-82285dce4d8f None None] MFA Rules not processed for user `7730d6cad2ba40c19cb671268cf04d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:40.713445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b995cd55-7a82-4d26-a4ff-82285dce4d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:40.810533 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 685/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 17:02:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:44.875676 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadbb7c-b4f6-4b9a-8dbe-dce510ecb32f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:44.875676 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadbb7c-b4f6-4b9a-8dbe-dce510ecb32f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:44.875676 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadbb7c-b4f6-4b9a-8dbe-dce510ecb32f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:44.876351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 667/1352] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 17:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:44.881109 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82efa8a-6b51-4eeb-b5de-94d130c7b550 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:44.881529 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82efa8a-6b51-4eeb-b5de-94d130c7b550 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:44.881787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82efa8a-6b51-4eeb-b5de-94d130c7b550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:44.900806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f82efa8a-6b51-4eeb-b5de-94d130c7b550 None None] MFA Rules not processed for user `7730d6cad2ba40c19cb671268cf04d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:44.902208 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f82efa8a-6b51-4eeb-b5de-94d130c7b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:44.911015 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 686/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 17:02:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:46.699665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35b922-c197-4fe2-a7ee-9515fe7678d2 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:46.700316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35b922-c197-4fe2-a7ee-9515fe7678d2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:46.700316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35b922-c197-4fe2-a7ee-9515fe7678d2 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:46.701780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 668/1354] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 17:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:46.706817 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4b249-ef37-4f3a-ac01-10e60f3446da None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:46.707241 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4b249-ef37-4f3a-ac01-10e60f3446da None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:46.707365 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4b249-ef37-4f3a-ac01-10e60f3446da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:46.725623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-99f4b249-ef37-4f3a-ac01-10e60f3446da None None] MFA Rules not processed for user `7730d6cad2ba40c19cb671268cf04d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:46.726796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-99f4b249-ef37-4f3a-ac01-10e60f3446da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:46.735243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 687/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 17:02:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:02:50.568132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a546555-f209-420a-97b0-c7ca9957e7ef None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:50.569000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a546555-f209-420a-97b0-c7ca9957e7ef None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:50.569272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a546555-f209-420a-97b0-c7ca9957e7ef None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:50.570775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 669/1356] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:50.576603 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5288dd1-74da-4d10-87ea-e34581905322 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:50.577064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5288dd1-74da-4d10-87ea-e34581905322 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:50.577157 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5288dd1-74da-4d10-87ea-e34581905322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:50.594852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f5288dd1-74da-4d10-87ea-e34581905322 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:50.596054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f5288dd1-74da-4d10-87ea-e34581905322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:50.603726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 688/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:50.652957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27379906-73b0-45a0-8598-4923e78973ea None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:50.653309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27379906-73b0-45a0-8598-4923e78973ea None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:50.653577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27379906-73b0-45a0-8598-4923e78973ea None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:50.655162 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 670/1358] 10.222.0.48 () {54 vars in 961 bytes} [Tue May 17 17:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:50.660752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e239e82-db80-423a-980f-514a286d0cb8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:50.661053 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e239e82-db80-423a-980f-514a286d0cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:50.661335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e239e82-db80-423a-980f-514a286d0cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:50.707939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5e239e82-db80-423a-980f-514a286d0cb8 None None] MFA Rules not processed for user `5becb135afbd43e9bc0b1347ba04e2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:50.709102 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5e239e82-db80-423a-980f-514a286d0cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:50.790229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 689/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Tue May 17 17:02:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:50.798612 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27379906-73b0-45a0-8598-4923e78973ea None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:50.813272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27379906-73b0-45a0-8598-4923e78973ea None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:50.818914 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90d2ae-1654-4d9b-919d-9db06cd33b64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:50.819646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90d2ae-1654-4d9b-919d-9db06cd33b64 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:50.820045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90d2ae-1654-4d9b-919d-9db06cd33b64 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:50.820422 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90d2ae-1654-4d9b-919d-9db06cd33b64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:50.829222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90d2ae-1654-4d9b-919d-9db06cd33b64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:50.830924 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90d2ae-1654-4d9b-919d-9db06cd33b64 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:50.841085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 671/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:02:53.315053 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dddff5-9d08-43c9-8b71-a4b5323f6776 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:53.315616 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dddff5-9d08-43c9-8b71-a4b5323f6776 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:53.315705 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dddff5-9d08-43c9-8b71-a4b5323f6776 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:53.317061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 690/1361] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:53.322396 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570f452-b7d4-4063-97fd-71f2cda98116 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:53.323232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570f452-b7d4-4063-97fd-71f2cda98116 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:53.323511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570f452-b7d4-4063-97fd-71f2cda98116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:53.341068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1570f452-b7d4-4063-97fd-71f2cda98116 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:53.342243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1570f452-b7d4-4063-97fd-71f2cda98116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:53.350901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 672/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:53.396687 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dddff5-9d08-43c9-8b71-a4b5323f6776 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:53.410753 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dddff5-9d08-43c9-8b71-a4b5323f6776 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:53.416582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608b897-8572-4873-bba5-24fe828a06ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:53.417838 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608b897-8572-4873-bba5-24fe828a06ed service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:53.418303 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608b897-8572-4873-bba5-24fe828a06ed service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:53.418689 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608b897-8572-4873-bba5-24fe828a06ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:53.428337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608b897-8572-4873-bba5-24fe828a06ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:53.430834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608b897-8572-4873-bba5-24fe828a06ed service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:53.441642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 691/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:02:55.963909 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b1763-4dbb-488f-9b31-69f132abada9 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:55.964372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b1763-4dbb-488f-9b31-69f132abada9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:55.964558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b1763-4dbb-488f-9b31-69f132abada9 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:55.966235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 673/1364] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:55.971431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf65b6a-f7fc-42b8-8d18-ca2e635f37a5 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:55.972229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf65b6a-f7fc-42b8-8d18-ca2e635f37a5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:55.972515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf65b6a-f7fc-42b8-8d18-ca2e635f37a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:55.993410 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6cf65b6a-f7fc-42b8-8d18-ca2e635f37a5 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:55.994579 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6cf65b6a-f7fc-42b8-8d18-ca2e635f37a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:56.007741 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 692/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:56.055565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee617f-9725-48e9-904c-e8e6d2ad0821 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:56.056315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee617f-9725-48e9-904c-e8e6d2ad0821 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:56.056817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee617f-9725-48e9-904c-e8e6d2ad0821 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:56.059207 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 674/1366] 10.222.0.48 () {54 vars in 961 bytes} [Tue May 17 17:02:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:56.064263 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c0a70-bd4f-4046-9b22-acf0fd3072ec None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:56.064620 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c0a70-bd4f-4046-9b22-acf0fd3072ec None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:56.064904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c0a70-bd4f-4046-9b22-acf0fd3072ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:56.083837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d68c0a70-bd4f-4046-9b22-acf0fd3072ec None None] MFA Rules not processed for user `5becb135afbd43e9bc0b1347ba04e2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:56.084957 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d68c0a70-bd4f-4046-9b22-acf0fd3072ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:56.099320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 693/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Tue May 17 17:02:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:56.107136 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee617f-9725-48e9-904c-e8e6d2ad0821 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:56.121753 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee617f-9725-48e9-904c-e8e6d2ad0821 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:56.127041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42dc2c-991b-424e-83bf-dce8e136070c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:56.127702 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42dc2c-991b-424e-83bf-dce8e136070c service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:56.127986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42dc2c-991b-424e-83bf-dce8e136070c service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:56.128258 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42dc2c-991b-424e-83bf-dce8e136070c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:56.140170 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42dc2c-991b-424e-83bf-dce8e136070c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:56.141768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42dc2c-991b-424e-83bf-dce8e136070c service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:56.151452 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 675/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:02:58.429409 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc4e32-a12b-4b01-b34b-8d50c25240cc None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:58.429934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc4e32-a12b-4b01-b34b-8d50c25240cc None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:58.429934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc4e32-a12b-4b01-b34b-8d50c25240cc None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:58.431231 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 694/1369] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:02:58.437187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5a318-2148-4ee3-95f0-3728a4fe8181 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:58.437637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5a318-2148-4ee3-95f0-3728a4fe8181 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:58.437763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5a318-2148-4ee3-95f0-3728a4fe8181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:58.456556 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e5c5a318-2148-4ee3-95f0-3728a4fe8181 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:58.457875 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e5c5a318-2148-4ee3-95f0-3728a4fe8181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:58.466456 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 676/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:02:58.510871 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc4e32-a12b-4b01-b34b-8d50c25240cc None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:58.524996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc4e32-a12b-4b01-b34b-8d50c25240cc None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:58.530407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf27eff-093f-4c9a-8528-01c7da4f0503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:58.531029 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf27eff-093f-4c9a-8528-01c7da4f0503 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:58.531308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf27eff-093f-4c9a-8528-01c7da4f0503 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:58.531581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf27eff-093f-4c9a-8528-01c7da4f0503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:58.539727 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf27eff-093f-4c9a-8528-01c7da4f0503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:58.541335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf27eff-093f-4c9a-8528-01c7da4f0503 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:58.551992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 695/1371] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:02:58.752700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fd69a-4795-445e-9292-79ebcc752895 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:58.752910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fd69a-4795-445e-9292-79ebcc752895 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:58.753152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fd69a-4795-445e-9292-79ebcc752895 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:58.754750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 677/1372] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:58.761154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9cdb7-c615-4307-afdd-73be395b0342 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:58.761575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9cdb7-c615-4307-afdd-73be395b0342 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:58.761708 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9cdb7-c615-4307-afdd-73be395b0342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:58.781865 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d2f9cdb7-c615-4307-afdd-73be395b0342 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:58.783160 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d2f9cdb7-c615-4307-afdd-73be395b0342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:58.792645 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 696/1373] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:59.114908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab868abe-ff0a-484a-8de1-4ec76792c69f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:59.116075 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab868abe-ff0a-484a-8de1-4ec76792c69f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:59.116636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab868abe-ff0a-484a-8de1-4ec76792c69f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:59.118195 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 678/1374] 10.222.0.48 () {54 vars in 963 bytes} [Tue May 17 17:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:02:59.127378 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20b384-53bf-40e7-b25f-e2b836e87072 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:59.127754 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20b384-53bf-40e7-b25f-e2b836e87072 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:59.129028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20b384-53bf-40e7-b25f-e2b836e87072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:59.185314 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6f20b384-53bf-40e7-b25f-e2b836e87072 None None] MFA Rules not processed for user `97e0aa0cdd8544ca9e16d1af3bff411f`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:02:59.186508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6f20b384-53bf-40e7-b25f-e2b836e87072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:02:59.249068 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 697/1375] 10.222.0.48 () {58 vars in 1060 bytes} [Tue May 17 17:02:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:02:59.256968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab868abe-ff0a-484a-8de1-4ec76792c69f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:02:59.267823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab868abe-ff0a-484a-8de1-4ec76792c69f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:02:59.272858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c762ad-d373-4e10-bcde-5ae5a0a92e92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:02:59.273534 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c762ad-d373-4e10-bcde-5ae5a0a92e92 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:02:59.274106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c762ad-d373-4e10-bcde-5ae5a0a92e92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:02:59.274803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c762ad-d373-4e10-bcde-5ae5a0a92e92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:02:59.284297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c762ad-d373-4e10-bcde-5ae5a0a92e92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:02:59.285715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c762ad-d373-4e10-bcde-5ae5a0a92e92 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:02:59.295417 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 679/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:00.840301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe85b4e-7e4c-4fa6-8954-856f4e929011 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:00.840914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe85b4e-7e4c-4fa6-8954-856f4e929011 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:00.840914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe85b4e-7e4c-4fa6-8954-856f4e929011 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:00.842332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 698/1377] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:00.848489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f1959-0adf-41a0-8d8c-219eabe9a4a8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:00.849040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f1959-0adf-41a0-8d8c-219eabe9a4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:00.849190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f1959-0adf-41a0-8d8c-219eabe9a4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:00.867342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-261f1959-0adf-41a0-8d8c-219eabe9a4a8 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:00.868601 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-261f1959-0adf-41a0-8d8c-219eabe9a4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:00.876814 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 680/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:00.922893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe85b4e-7e4c-4fa6-8954-856f4e929011 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:00.937928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe85b4e-7e4c-4fa6-8954-856f4e929011 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:00.943438 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0b221-dc1f-48f6-a839-a9f211d2eda3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:00.944121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b221-dc1f-48f6-a839-a9f211d2eda3 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:00.944407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b221-dc1f-48f6-a839-a9f211d2eda3 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:00.944687 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b221-dc1f-48f6-a839-a9f211d2eda3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:00.954119 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0b221-dc1f-48f6-a839-a9f211d2eda3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:00.955778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0b221-dc1f-48f6-a839-a9f211d2eda3 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:00.966823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 699/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:03.261323 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe887e9c-ae6c-4bf4-bd08-1d280b8f6d56 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:03.261859 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe887e9c-ae6c-4bf4-bd08-1d280b8f6d56 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:03.262169 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe887e9c-ae6c-4bf4-bd08-1d280b8f6d56 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:03.263648 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 681/1380] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:03.269237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df538bc-742a-4cf6-a658-9cff1da94122 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:03.269658 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df538bc-742a-4cf6-a658-9cff1da94122 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:03.269780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df538bc-742a-4cf6-a658-9cff1da94122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:03.288176 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0df538bc-742a-4cf6-a658-9cff1da94122 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:03.289337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0df538bc-742a-4cf6-a658-9cff1da94122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:03.297989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 700/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:03.341663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe887e9c-ae6c-4bf4-bd08-1d280b8f6d56 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:03.358719 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe887e9c-ae6c-4bf4-bd08-1d280b8f6d56 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:03.364844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4f12f-b2b4-4766-8364-a5660c52bd08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:03.365492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4f12f-b2b4-4766-8364-a5660c52bd08 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:03.365769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4f12f-b2b4-4766-8364-a5660c52bd08 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:03.366334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4f12f-b2b4-4766-8364-a5660c52bd08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:03.375762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4f12f-b2b4-4766-8364-a5660c52bd08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:03.377339 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4f12f-b2b4-4766-8364-a5660c52bd08 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:03.386868 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 682/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:05.693084 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11699e6d-9662-4041-af96-8d2d1b5d8dd8 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:05.693624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11699e6d-9662-4041-af96-8d2d1b5d8dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:05.693624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11699e6d-9662-4041-af96-8d2d1b5d8dd8 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:05.694893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 701/1383] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:05.700481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd423d-605f-4c73-811c-b5e72a8e7abb None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:05.701262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd423d-605f-4c73-811c-b5e72a8e7abb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:05.701545 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd423d-605f-4c73-811c-b5e72a8e7abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:05.719868 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-19dd423d-605f-4c73-811c-b5e72a8e7abb None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:05.721189 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-19dd423d-605f-4c73-811c-b5e72a8e7abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:05.729796 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 683/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:05.774214 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11699e6d-9662-4041-af96-8d2d1b5d8dd8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:05.790167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11699e6d-9662-4041-af96-8d2d1b5d8dd8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:05.796438 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211a5ed-427c-41d8-8b31-679c4343b0cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:05.797083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211a5ed-427c-41d8-8b31-679c4343b0cf service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:05.797548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211a5ed-427c-41d8-8b31-679c4343b0cf service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:05.797827 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211a5ed-427c-41d8-8b31-679c4343b0cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:05.806737 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211a5ed-427c-41d8-8b31-679c4343b0cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:05.808646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211a5ed-427c-41d8-8b31-679c4343b0cf service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:05.817989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 702/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:08.037547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ad78-5d24-4145-b014-ba2362402f8d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:08.038113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ad78-5d24-4145-b014-ba2362402f8d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:08.038113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ad78-5d24-4145-b014-ba2362402f8d None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:08.039577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 684/1386] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:08.045010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989f207-5962-42c3-b004-31710b1bc540 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:08.045512 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989f207-5962-42c3-b004-31710b1bc540 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:08.045615 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989f207-5962-42c3-b004-31710b1bc540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:08.064016 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-9989f207-5962-42c3-b004-31710b1bc540 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:08.065193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9989f207-5962-42c3-b004-31710b1bc540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:08.076531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 703/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:08.120374 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422ad78-5d24-4145-b014-ba2362402f8d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:08.136242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422ad78-5d24-4145-b014-ba2362402f8d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:08.142191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6267d-458c-43a7-ab4b-fc1198b01192 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:08.142849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6267d-458c-43a7-ab4b-fc1198b01192 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:08.143151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6267d-458c-43a7-ab4b-fc1198b01192 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:08.143446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6267d-458c-43a7-ab4b-fc1198b01192 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:08.152298 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6267d-458c-43a7-ab4b-fc1198b01192 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:08.153971 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6267d-458c-43a7-ab4b-fc1198b01192 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:08.163746 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 685/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:11.010741 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758eb07c-4783-4474-8f0e-c994101b1a38 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:11.011332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758eb07c-4783-4474-8f0e-c994101b1a38 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:11.011332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758eb07c-4783-4474-8f0e-c994101b1a38 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:11.012843 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 704/1389] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:11.019145 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58d20-5f2f-4c1a-9f8e-5ef72a9887b1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:11.019663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58d20-5f2f-4c1a-9f8e-5ef72a9887b1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:11.019910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58d20-5f2f-4c1a-9f8e-5ef72a9887b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:11.042921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f4f58d20-5f2f-4c1a-9f8e-5ef72a9887b1 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:11.044526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f4f58d20-5f2f-4c1a-9f8e-5ef72a9887b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:11.055091 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 686/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:11.111959 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758eb07c-4783-4474-8f0e-c994101b1a38 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:11.126302 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758eb07c-4783-4474-8f0e-c994101b1a38 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:11.133255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5fd95-1fc8-47da-8486-9e51ec8de7cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:11.134263 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5fd95-1fc8-47da-8486-9e51ec8de7cb service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:11.134664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5fd95-1fc8-47da-8486-9e51ec8de7cb service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:11.135259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5fd95-1fc8-47da-8486-9e51ec8de7cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:11.146216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5fd95-1fc8-47da-8486-9e51ec8de7cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:11.147857 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5fd95-1fc8-47da-8486-9e51ec8de7cb service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:11.158086 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 705/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:13.575323 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52496d9-d44c-46aa-9f76-11b18017f71d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:13.575964 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52496d9-d44c-46aa-9f76-11b18017f71d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:13.575964 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52496d9-d44c-46aa-9f76-11b18017f71d None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:13.577293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 687/1392] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:13.582594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6a88-3964-4303-a723-05869fa52826 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:13.583052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6a88-3964-4303-a723-05869fa52826 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:13.583278 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6a88-3964-4303-a723-05869fa52826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:13.600863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c28d6a88-3964-4303-a723-05869fa52826 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:13.602041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c28d6a88-3964-4303-a723-05869fa52826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:13.610712 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 706/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:13.653534 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52496d9-d44c-46aa-9f76-11b18017f71d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:13.669529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52496d9-d44c-46aa-9f76-11b18017f71d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:13.674897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d609e5-b798-4423-a285-75f8122c0ec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:13.675528 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d609e5-b798-4423-a285-75f8122c0ec8 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:13.675842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d609e5-b798-4423-a285-75f8122c0ec8 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:13.676143 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d609e5-b798-4423-a285-75f8122c0ec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:13.684861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d609e5-b798-4423-a285-75f8122c0ec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:13.686423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d609e5-b798-4423-a285-75f8122c0ec8 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:13.695414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 688/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:15.054145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d97bb-c2c0-4261-b325-17ff41728e2c None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:15.054729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d97bb-c2c0-4261-b325-17ff41728e2c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:15.054729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d97bb-c2c0-4261-b325-17ff41728e2c None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:15.056076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 707/1395] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:03:15.061231 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086159e0-d0aa-4ad9-b8d9-c9e4f57593a7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:15.061684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086159e0-d0aa-4ad9-b8d9-c9e4f57593a7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:15.061786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086159e0-d0aa-4ad9-b8d9-c9e4f57593a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:15.079450 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-086159e0-d0aa-4ad9-b8d9-c9e4f57593a7 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:15.080652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-086159e0-d0aa-4ad9-b8d9-c9e4f57593a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:15.091320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 689/1396] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:15.144208 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06116f4-41ed-4447-abe0-57ea00f195ea None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:15.144494 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06116f4-41ed-4447-abe0-57ea00f195ea None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:15.144770 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06116f4-41ed-4447-abe0-57ea00f195ea None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:15.146121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 708/1397] 10.222.0.48 () {54 vars in 962 bytes} [Tue May 17 17:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:15.151745 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53741a83-11a1-4b13-b252-6bd112884c58 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:15.152110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53741a83-11a1-4b13-b252-6bd112884c58 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:15.152464 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53741a83-11a1-4b13-b252-6bd112884c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:15.199388 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-53741a83-11a1-4b13-b252-6bd112884c58 None None] MFA Rules not processed for user `b25519cdc25244a0b039ce3097c328d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:15.200600 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-53741a83-11a1-4b13-b252-6bd112884c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:15.258302 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 690/1398] 10.222.0.48 () {58 vars in 1059 bytes} [Tue May 17 17:03:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:15.266169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06116f4-41ed-4447-abe0-57ea00f195ea None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:15.278065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06116f4-41ed-4447-abe0-57ea00f195ea None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:15.281526 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd3472-6528-4a2b-81b1-ac38b1bb67ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25519cdc25244a0b039ce3097c328d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:15.282164 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd3472-6528-4a2b-81b1-ac38b1bb67ef service glance] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:15.282447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd3472-6528-4a2b-81b1-ac38b1bb67ef service glance] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:15.282723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd3472-6528-4a2b-81b1-ac38b1bb67ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:15.291424 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd3472-6528-4a2b-81b1-ac38b1bb67ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:15.292918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd3472-6528-4a2b-81b1-ac38b1bb67ef service glance] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:15.301986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 709/1399] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:03:15.720231 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4886a8-bbfd-4009-b4aa-0622ecb7ee43 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:15.720509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4886a8-bbfd-4009-b4aa-0622ecb7ee43 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:15.720887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4886a8-bbfd-4009-b4aa-0622ecb7ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:15.769020 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-db4886a8-bbfd-4009-b4aa-0622ecb7ee43 None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:15.770209 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-db4886a8-bbfd-4009-b4aa-0622ecb7ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:15.843074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 691/1400] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 17:03:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:15.890507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b788a-5515-4e92-ad75-68e84736c376 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:15.890930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b788a-5515-4e92-ad75-68e84736c376 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:15.891420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b788a-5515-4e92-ad75-68e84736c376 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:15.892896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 710/1401] 10.222.0.48 () {54 vars in 942 bytes} [Tue May 17 17:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:15.899312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae13457-eaa6-4f8b-a68b-4b817b3610e4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:15.899712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae13457-eaa6-4f8b-a68b-4b817b3610e4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:15.900040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae13457-eaa6-4f8b-a68b-4b817b3610e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:15.947868 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bae13457-eaa6-4f8b-a68b-4b817b3610e4 None None] MFA Rules not processed for user `bc87aba3662244bea0428475bb0c9e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:15.949062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bae13457-eaa6-4f8b-a68b-4b817b3610e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:16.018098 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 692/1402] 10.222.0.48 () {58 vars in 1039 bytes} [Tue May 17 17:03:15 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:16.027735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b788a-5515-4e92-ad75-68e84736c376 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:16.041314 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b788a-5515-4e92-ad75-68e84736c376 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:16.044777 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cefd0-fe8b-411c-8f57-e390046ad04d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:16.045191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cefd0-fe8b-411c-8f57-e390046ad04d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:16.045478 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cefd0-fe8b-411c-8f57-e390046ad04d None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:16.046580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54f144-f153-4b69-a87d-eb22177be5ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:16.046869 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 693/1403] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:03:16.047209 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54f144-f153-4b69-a87d-eb22177be5ed service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:16.047486 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54f144-f153-4b69-a87d-eb22177be5ed service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:16.047790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54f144-f153-4b69-a87d-eb22177be5ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:16.051844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f731ac-ade1-4182-a354-761c3d8655e2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:16.052127 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f731ac-ade1-4182-a354-761c3d8655e2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:16.052400 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f731ac-ade1-4182-a354-761c3d8655e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:16.056889 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54f144-f153-4b69-a87d-eb22177be5ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:16.058561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54f144-f153-4b69-a87d-eb22177be5ed service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:16.066735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 711/1404] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:03:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:03:16.070820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d6f731ac-ade1-4182-a354-761c3d8655e2 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:16.071948 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d6f731ac-ade1-4182-a354-761c3d8655e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:16.080666 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 694/1405] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:03:16.125329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54f144-f153-4b69-a87d-eb22177be5ed service swift] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:16.137288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54f144-f153-4b69-a87d-eb22177be5ed service swift] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:16.143221 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ee923-9204-4a7a-82f9-6596e4c894f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:16.143925 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ee923-9204-4a7a-82f9-6596e4c894f1 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:16.144208 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ee923-9204-4a7a-82f9-6596e4c894f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:16.144485 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ee923-9204-4a7a-82f9-6596e4c894f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:16.154093 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ee923-9204-4a7a-82f9-6596e4c894f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:16.155646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ee923-9204-4a7a-82f9-6596e4c894f1 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:16.165574 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 712/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:18.501477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cec7a-fad9-4cc2-87c9-34df80537b12 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:18.502011 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cec7a-fad9-4cc2-87c9-34df80537b12 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:18.502011 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cec7a-fad9-4cc2-87c9-34df80537b12 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:18.503328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 695/1407] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:18.508797 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25de5-a82f-4d5c-82be-aab631018604 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:18.510257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25de5-a82f-4d5c-82be-aab631018604 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:18.510257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25de5-a82f-4d5c-82be-aab631018604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:18.532454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ffd25de5-a82f-4d5c-82be-aab631018604 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:18.534120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ffd25de5-a82f-4d5c-82be-aab631018604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:18.542946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 713/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:18.588186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cec7a-fad9-4cc2-87c9-34df80537b12 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:18.603846 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cec7a-fad9-4cc2-87c9-34df80537b12 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:18.609422 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d0258-1c80-4df7-a0dd-c4bdf5f15a3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:18.610141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d0258-1c80-4df7-a0dd-c4bdf5f15a3a service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:18.610430 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d0258-1c80-4df7-a0dd-c4bdf5f15a3a service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:18.610704 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d0258-1c80-4df7-a0dd-c4bdf5f15a3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:18.620652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d0258-1c80-4df7-a0dd-c4bdf5f15a3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:18.621892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d0258-1c80-4df7-a0dd-c4bdf5f15a3a service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:18.632134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 696/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:39.685605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78c354-9dd5-4463-b7df-c625042dff45 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:39.686285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78c354-9dd5-4463-b7df-c625042dff45 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:39.686285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78c354-9dd5-4463-b7df-c625042dff45 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:39.687540 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 714/1410] 10.222.0.48 () {54 vars in 918 bytes} [Tue May 17 17:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:39.692628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266279a-f78d-46fa-b66b-d170bd0aad05 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:39.693095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266279a-f78d-46fa-b66b-d170bd0aad05 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:39.693203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266279a-f78d-46fa-b66b-d170bd0aad05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:39.711141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7266279a-f78d-46fa-b66b-d170bd0aad05 None None] MFA Rules not processed for user `7730d6cad2ba40c19cb671268cf04d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:39.712340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7266279a-f78d-46fa-b66b-d170bd0aad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:39.720753 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 697/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Tue May 17 17:03:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:03:39.735144 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ba9c6-c997-4fe4-9705-b1b9039f368a None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:39.735431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ba9c6-c997-4fe4-9705-b1b9039f368a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:39.735887 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ba9c6-c997-4fe4-9705-b1b9039f368a None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:39.737095 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 715/1412] 10.222.0.48 () {54 vars in 918 bytes} [Tue May 17 17:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:39.741856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151137e5-7acc-4ea0-a3b9-0c590fd736f7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:39.742152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151137e5-7acc-4ea0-a3b9-0c590fd736f7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:39.742980 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151137e5-7acc-4ea0-a3b9-0c590fd736f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:39.760270 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-151137e5-7acc-4ea0-a3b9-0c590fd736f7 None None] MFA Rules not processed for user `5becb135afbd43e9bc0b1347ba04e2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:39.761423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-151137e5-7acc-4ea0-a3b9-0c590fd736f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:39.770866 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 698/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Tue May 17 17:03:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:03:42.490062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844674fe-a868-4dff-bbe8-2a632d7ed623 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:42.490581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844674fe-a868-4dff-bbe8-2a632d7ed623 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:42.490581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844674fe-a868-4dff-bbe8-2a632d7ed623 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:42.492624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 17:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:42.497978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55a8e0-8abb-4599-96b8-7ed9db0e45d4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:42.498383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55a8e0-8abb-4599-96b8-7ed9db0e45d4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:42.498541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55a8e0-8abb-4599-96b8-7ed9db0e45d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:42.516965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-da55a8e0-8abb-4599-96b8-7ed9db0e45d4 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:42.518144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-da55a8e0-8abb-4599-96b8-7ed9db0e45d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:42.525988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 17:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:42.567149 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844674fe-a868-4dff-bbe8-2a632d7ed623 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:42.581914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844674fe-a868-4dff-bbe8-2a632d7ed623 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:42.587353 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfde0d-bbb6-4c01-9e31-d9bc0cb8d901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:42.588008 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfde0d-bbb6-4c01-9e31-d9bc0cb8d901 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:42.588294 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfde0d-bbb6-4c01-9e31-d9bc0cb8d901 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:42.588567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfde0d-bbb6-4c01-9e31-d9bc0cb8d901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:42.596408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfde0d-bbb6-4c01-9e31-d9bc0cb8d901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:42.597970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfde0d-bbb6-4c01-9e31-d9bc0cb8d901 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:42.607017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 717/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:43.597940 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d640b6-d9c0-4888-870b-31096c44c64d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:43.598473 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d640b6-d9c0-4888-870b-31096c44c64d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:43.598600 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d640b6-d9c0-4888-870b-31096c44c64d None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:43.599934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 17:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:43.604885 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e1373-6aad-464a-960b-ae38fe5c8cac None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:43.605337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e1373-6aad-464a-960b-ae38fe5c8cac None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:43.605449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e1373-6aad-464a-960b-ae38fe5c8cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:43.623627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-997e1373-6aad-464a-960b-ae38fe5c8cac None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:43.624808 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-997e1373-6aad-464a-960b-ae38fe5c8cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:43.632341 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 17:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:43.789963 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d640b6-d9c0-4888-870b-31096c44c64d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:43.804119 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d640b6-d9c0-4888-870b-31096c44c64d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:43.810079 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9959ed-3ae2-42a9-8587-c27d2b60f8a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:43.810708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9959ed-3ae2-42a9-8587-c27d2b60f8a5 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:43.810990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9959ed-3ae2-42a9-8587-c27d2b60f8a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:43.811263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9959ed-3ae2-42a9-8587-c27d2b60f8a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:43.819121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9959ed-3ae2-42a9-8587-c27d2b60f8a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:43.820967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9959ed-3ae2-42a9-8587-c27d2b60f8a5 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:43.830311 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 701/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:44.794347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656d17f-66aa-4044-b83e-ae19ffcd99ad None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:44.794901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656d17f-66aa-4044-b83e-ae19ffcd99ad None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:44.794901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656d17f-66aa-4044-b83e-ae19ffcd99ad None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:44.796306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 17:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:44.801389 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fc704-d9b5-4fd3-a9c7-27ce2234f800 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:44.801833 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fc704-d9b5-4fd3-a9c7-27ce2234f800 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:44.801976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fc704-d9b5-4fd3-a9c7-27ce2234f800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:44.821962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-dc8fc704-d9b5-4fd3-a9c7-27ce2234f800 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:44.823190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-dc8fc704-d9b5-4fd3-a9c7-27ce2234f800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:44.832433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 17:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:45.029783 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656d17f-66aa-4044-b83e-ae19ffcd99ad None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:45.044457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656d17f-66aa-4044-b83e-ae19ffcd99ad None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:45.050508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f6224-94e3-4d30-a54b-4012bf0cd764 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:45.051132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f6224-94e3-4d30-a54b-4012bf0cd764 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:45.051415 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f6224-94e3-4d30-a54b-4012bf0cd764 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:45.051730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f6224-94e3-4d30-a54b-4012bf0cd764 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:45.062246 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f6224-94e3-4d30-a54b-4012bf0cd764 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:45.063926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f6224-94e3-4d30-a54b-4012bf0cd764 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:45.073926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 720/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:46.055287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001711f-c0ad-428d-8998-42d73d40a6e4 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:46.055910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001711f-c0ad-428d-8998-42d73d40a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:46.055910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001711f-c0ad-428d-8998-42d73d40a6e4 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:46.057246 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 17:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:46.062042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691dda2-4525-4c5f-9738-42104eb4cf52 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:46.062431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691dda2-4525-4c5f-9738-42104eb4cf52 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:46.062586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691dda2-4525-4c5f-9738-42104eb4cf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:46.080635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a691dda2-4525-4c5f-9738-42104eb4cf52 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:46.081815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a691dda2-4525-4c5f-9738-42104eb4cf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:46.090401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 17:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:46.238752 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001711f-c0ad-428d-8998-42d73d40a6e4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:46.253093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001711f-c0ad-428d-8998-42d73d40a6e4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:46.258989 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b534272-4c4a-4ed8-94a6-0f59a4063fbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:46.259621 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b534272-4c4a-4ed8-94a6-0f59a4063fbf service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:46.259911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b534272-4c4a-4ed8-94a6-0f59a4063fbf service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:46.260183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b534272-4c4a-4ed8-94a6-0f59a4063fbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:46.268323 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b534272-4c4a-4ed8-94a6-0f59a4063fbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:46.269900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b534272-4c4a-4ed8-94a6-0f59a4063fbf service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:46.279043 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 704/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:47.214144 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0e8c5-3dbd-4b4b-a3f3-c30c8091c028 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:47.214719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0e8c5-3dbd-4b4b-a3f3-c30c8091c028 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:47.214719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0e8c5-3dbd-4b4b-a3f3-c30c8091c028 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:47.216421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 17:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:47.221997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a63b2-70d1-4fce-a473-271f26b6658c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:47.222435 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a63b2-70d1-4fce-a473-271f26b6658c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:47.222711 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a63b2-70d1-4fce-a473-271f26b6658c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:47.243048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-674a63b2-70d1-4fce-a473-271f26b6658c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:47.244256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-674a63b2-70d1-4fce-a473-271f26b6658c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:47.252061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 17:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:47.419298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0e8c5-3dbd-4b4b-a3f3-c30c8091c028 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:47.434285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0e8c5-3dbd-4b4b-a3f3-c30c8091c028 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:47.440200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39500a6-8d2e-4181-ba3d-10002e4ebd31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:47.440676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39500a6-8d2e-4181-ba3d-10002e4ebd31 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:47.440957 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39500a6-8d2e-4181-ba3d-10002e4ebd31 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:47.441232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39500a6-8d2e-4181-ba3d-10002e4ebd31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:47.451459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39500a6-8d2e-4181-ba3d-10002e4ebd31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:47.453229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39500a6-8d2e-4181-ba3d-10002e4ebd31 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:47.468025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 723/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:48.344799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c55d0-a68b-486c-85b4-207deacbe6bb None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:48.345331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c55d0-a68b-486c-85b4-207deacbe6bb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:48.345331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c55d0-a68b-486c-85b4-207deacbe6bb None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:48.346656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 17:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:48.351670 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07995c-febe-4ef2-ab40-2d55ad8c2579 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:48.352065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07995c-febe-4ef2-ab40-2d55ad8c2579 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:48.352231 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07995c-febe-4ef2-ab40-2d55ad8c2579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:48.370169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4f07995c-febe-4ef2-ab40-2d55ad8c2579 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:48.371342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4f07995c-febe-4ef2-ab40-2d55ad8c2579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:48.379005 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 17:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:48.537000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c55d0-a68b-486c-85b4-207deacbe6bb None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:48.550925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c55d0-a68b-486c-85b4-207deacbe6bb None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:48.557045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd70d46-4469-4e0f-ba42-186f87ece728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:48.557673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd70d46-4469-4e0f-ba42-186f87ece728 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:48.557954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd70d46-4469-4e0f-ba42-186f87ece728 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:48.558229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd70d46-4469-4e0f-ba42-186f87ece728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:48.566021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd70d46-4469-4e0f-ba42-186f87ece728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:48.567589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd70d46-4469-4e0f-ba42-186f87ece728 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:48.577163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 707/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:49.441088 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a05f70-eda5-41d3-9c9c-209ead7cfbac None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:49.441657 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a05f70-eda5-41d3-9c9c-209ead7cfbac None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:49.441657 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a05f70-eda5-41d3-9c9c-209ead7cfbac None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:49.442915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 17:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:49.447874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba1ae9-7607-4527-a243-07aca76c5486 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:49.448282 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba1ae9-7607-4527-a243-07aca76c5486 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:49.448441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba1ae9-7607-4527-a243-07aca76c5486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:49.466630 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-71ba1ae9-7607-4527-a243-07aca76c5486 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:49.467846 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-71ba1ae9-7607-4527-a243-07aca76c5486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:49.475430 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 17:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:49.627790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a05f70-eda5-41d3-9c9c-209ead7cfbac None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:49.642373 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a05f70-eda5-41d3-9c9c-209ead7cfbac None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:49.647830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c992af8-5c0b-4042-b488-a30289088ce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:49.649151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c992af8-5c0b-4042-b488-a30289088ce7 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:49.649434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c992af8-5c0b-4042-b488-a30289088ce7 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:49.649705 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c992af8-5c0b-4042-b488-a30289088ce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:49.657902 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c992af8-5c0b-4042-b488-a30289088ce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:49.659474 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c992af8-5c0b-4042-b488-a30289088ce7 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:49.668732 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 726/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:50.537416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173eb3-ae39-4aa6-a85d-7015b3b9581c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:50.537931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173eb3-ae39-4aa6-a85d-7015b3b9581c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:50.537931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173eb3-ae39-4aa6-a85d-7015b3b9581c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:50.539808 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 17:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:03:50.544783 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f7500-931f-4c81-9da7-967b14e3a560 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:50.545205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f7500-931f-4c81-9da7-967b14e3a560 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:50.545381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f7500-931f-4c81-9da7-967b14e3a560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:50.563507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-653f7500-931f-4c81-9da7-967b14e3a560 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:50.564703 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-653f7500-931f-4c81-9da7-967b14e3a560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:50.572423 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 17:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:50.720237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15173eb3-ae39-4aa6-a85d-7015b3b9581c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:50.734736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15173eb3-ae39-4aa6-a85d-7015b3b9581c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:50.739991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031dccf-ab00-404b-8cf3-0a57db73e4df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:50.740615 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031dccf-ab00-404b-8cf3-0a57db73e4df service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:50.740893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031dccf-ab00-404b-8cf3-0a57db73e4df service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:50.741166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031dccf-ab00-404b-8cf3-0a57db73e4df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:50.749031 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031dccf-ab00-404b-8cf3-0a57db73e4df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:50.750603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031dccf-ab00-404b-8cf3-0a57db73e4df service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:50.759557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 710/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:51.663707 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd640bee-d9f2-45b8-8354-5abb85b3f4f7 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:51.664324 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd640bee-d9f2-45b8-8354-5abb85b3f4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:51.664324 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd640bee-d9f2-45b8-8354-5abb85b3f4f7 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:51.667628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 17:03:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:51.673308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825f874-4598-42ad-8b32-611077ea979b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:51.673736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825f874-4598-42ad-8b32-611077ea979b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:51.673868 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825f874-4598-42ad-8b32-611077ea979b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:51.692229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e825f874-4598-42ad-8b32-611077ea979b None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:51.693402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e825f874-4598-42ad-8b32-611077ea979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:51.701898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 17:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:03:51.917928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd640bee-d9f2-45b8-8354-5abb85b3f4f7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:51.933609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd640bee-d9f2-45b8-8354-5abb85b3f4f7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:51.938985 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd7c60-eb38-4b64-9023-afb7e07d8498 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:51.939659 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd7c60-eb38-4b64-9023-afb7e07d8498 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:51.939948 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd7c60-eb38-4b64-9023-afb7e07d8498 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:51.940226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd7c60-eb38-4b64-9023-afb7e07d8498 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:51.949359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd7c60-eb38-4b64-9023-afb7e07d8498 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:51.950982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd7c60-eb38-4b64-9023-afb7e07d8498 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:51.962111 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 729/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:03:54.128995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a12e3-7741-49c4-a010-673ff1fcf65c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:54.129561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a12e3-7741-49c4-a010-673ff1fcf65c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:54.129561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a12e3-7741-49c4-a010-673ff1fcf65c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:54.130953 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 17:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:54.137192 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357ef8f-85f2-4ee0-a215-06eebccb056a None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:54.137657 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357ef8f-85f2-4ee0-a215-06eebccb056a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:54.137775 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357ef8f-85f2-4ee0-a215-06eebccb056a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:54.155634 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e357ef8f-85f2-4ee0-a215-06eebccb056a None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:54.156900 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e357ef8f-85f2-4ee0-a215-06eebccb056a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:54.165601 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 17:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:03:54.205304 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a12e3-7741-49c4-a010-673ff1fcf65c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:54.216567 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a12e3-7741-49c4-a010-673ff1fcf65c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:54.220100 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d63eb-c3d6-4191-997e-2f4b389a8406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:54.220729 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d63eb-c3d6-4191-997e-2f4b389a8406 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:54.221009 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d63eb-c3d6-4191-997e-2f4b389a8406 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:54.221283 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d63eb-c3d6-4191-997e-2f4b389a8406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:54.230123 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d63eb-c3d6-4191-997e-2f4b389a8406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:54.231552 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d63eb-c3d6-4191-997e-2f4b389a8406 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:54.240631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 713/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:03:57.006639 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ce83d-ba16-4e52-b0e8-17c12b6c6ed1 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:57.007754 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ce83d-ba16-4e52-b0e8-17c12b6c6ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:57.007754 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ce83d-ba16-4e52-b0e8-17c12b6c6ed1 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:57.009077 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 17:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:03:57.015679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283b137-d5b8-4bed-aef8-dc5c7242e2dd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:57.016135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283b137-d5b8-4bed-aef8-dc5c7242e2dd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:57.016468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283b137-d5b8-4bed-aef8-dc5c7242e2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:57.036288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5283b137-d5b8-4bed-aef8-dc5c7242e2dd None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:03:57.037499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5283b137-d5b8-4bed-aef8-dc5c7242e2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:03:57.045900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 17:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:03:57.089144 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ce83d-ba16-4e52-b0e8-17c12b6c6ed1 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:03:57.099826 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ce83d-ba16-4e52-b0e8-17c12b6c6ed1 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:03:57.104037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52416f46-b51a-4207-aea3-f89de6c2a47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:03:57.104793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52416f46-b51a-4207-aea3-f89de6c2a47d service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:03:57.105131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52416f46-b51a-4207-aea3-f89de6c2a47d service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:03:57.105409 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52416f46-b51a-4207-aea3-f89de6c2a47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:03:57.114937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52416f46-b51a-4207-aea3-f89de6c2a47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:03:57.116736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52416f46-b51a-4207-aea3-f89de6c2a47d service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:03:57.126555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 732/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:04:00.313696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e5b94-a854-4645-85d5-b7f632aa3f1b None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:00.314291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e5b94-a854-4645-85d5-b7f632aa3f1b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:00.314291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e5b94-a854-4645-85d5-b7f632aa3f1b None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:00.315596 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 17:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:04:00.321451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f5b43-480c-450a-b8f2-68434add6c3f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:00.321922 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f5b43-480c-450a-b8f2-68434add6c3f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:00.322028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f5b43-480c-450a-b8f2-68434add6c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:00.340279 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b73f5b43-480c-450a-b8f2-68434add6c3f None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:04:00.341448 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b73f5b43-480c-450a-b8f2-68434add6c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:04:00.349140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 17:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:04:00.387111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e5b94-a854-4645-85d5-b7f632aa3f1b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:04:00.397569 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e5b94-a854-4645-85d5-b7f632aa3f1b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:04:00.401038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4ffe1-4c9e-49ce-9aeb-8ecccb278aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:04:00.401664 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4ffe1-4c9e-49ce-9aeb-8ecccb278aff service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:00.401943 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4ffe1-4c9e-49ce-9aeb-8ecccb278aff service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:00.402215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4ffe1-4c9e-49ce-9aeb-8ecccb278aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:00.410708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4ffe1-4c9e-49ce-9aeb-8ecccb278aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:04:00.412173 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4ffe1-4c9e-49ce-9aeb-8ecccb278aff service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:04:00.421305 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 716/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:04:02.805399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152dfa2-9bcf-4080-a69d-3993cadc6bd0 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:02.806072 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152dfa2-9bcf-4080-a69d-3993cadc6bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:02.806072 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152dfa2-9bcf-4080-a69d-3993cadc6bd0 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:02.807395 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 17:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:04:02.814719 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396bcad-7ef2-4a51-89ce-56d55d3c5a45 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:02.815347 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396bcad-7ef2-4a51-89ce-56d55d3c5a45 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:02.815347 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396bcad-7ef2-4a51-89ce-56d55d3c5a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:02.841804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0396bcad-7ef2-4a51-89ce-56d55d3c5a45 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:04:02.843025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0396bcad-7ef2-4a51-89ce-56d55d3c5a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:04:02.851088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 17:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:04:02.891213 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152dfa2-9bcf-4080-a69d-3993cadc6bd0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:04:02.892891 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e152dfa2-9bcf-4080-a69d-3993cadc6bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:04:02.905736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152dfa2-9bcf-4080-a69d-3993cadc6bd0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:04:02.909547 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e5418-8e5e-4431-be58-2e751fe1c6db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:04:02.910183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e5418-8e5e-4431-be58-2e751fe1c6db service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:02.910460 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e5418-8e5e-4431-be58-2e751fe1c6db service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:02.910729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e5418-8e5e-4431-be58-2e751fe1c6db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:02.919857 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e5418-8e5e-4431-be58-2e751fe1c6db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:04:02.921273 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e5418-8e5e-4431-be58-2e751fe1c6db service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:04:02.931356 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 735/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:04:05.450108 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fa45c-10c2-4276-9b3b-3b9865633972 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:05.450639 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fa45c-10c2-4276-9b3b-3b9865633972 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:05.450639 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fa45c-10c2-4276-9b3b-3b9865633972 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:05.452023 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 17:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:04:05.457687 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5246c-6b39-4cbb-bf8d-6c842308815f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:05.458240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5246c-6b39-4cbb-bf8d-6c842308815f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:05.458354 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5246c-6b39-4cbb-bf8d-6c842308815f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:05.478303 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f6b5246c-6b39-4cbb-bf8d-6c842308815f None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:04:05.479503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f6b5246c-6b39-4cbb-bf8d-6c842308815f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:04:05.489539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 17:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:04:05.531995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fa45c-10c2-4276-9b3b-3b9865633972 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:04:05.545068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fa45c-10c2-4276-9b3b-3b9865633972 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:04:05.550382 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae1c23-3428-43d8-bc1b-93658881cdd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:04:05.551081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae1c23-3428-43d8-bc1b-93658881cdd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:05.551441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae1c23-3428-43d8-bc1b-93658881cdd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:05.551762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae1c23-3428-43d8-bc1b-93658881cdd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:05.562907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae1c23-3428-43d8-bc1b-93658881cdd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:04:05.564377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae1c23-3428-43d8-bc1b-93658881cdd2 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:04:05.583878 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 719/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:04:08.027706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af7665-ee93-4314-b967-bc69b4edbd00 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:08.028241 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af7665-ee93-4314-b967-bc69b4edbd00 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:08.028241 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af7665-ee93-4314-b967-bc69b4edbd00 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:08.029574 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 17:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:04:08.034850 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54760d80-ea3e-4f4c-8d2c-d0da169b2930 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:08.035306 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54760d80-ea3e-4f4c-8d2c-d0da169b2930 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:08.035423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54760d80-ea3e-4f4c-8d2c-d0da169b2930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:08.053725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-54760d80-ea3e-4f4c-8d2c-d0da169b2930 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:04:08.054898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-54760d80-ea3e-4f4c-8d2c-d0da169b2930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:04:08.062691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 17:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:04:08.104292 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af7665-ee93-4314-b967-bc69b4edbd00 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:04:08.114881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af7665-ee93-4314-b967-bc69b4edbd00 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:04:08.118218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfe90a-0ece-4500-8610-e4984a0800a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:04:08.118841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfe90a-0ece-4500-8610-e4984a0800a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:08.119119 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfe90a-0ece-4500-8610-e4984a0800a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:08.119391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfe90a-0ece-4500-8610-e4984a0800a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:08.134128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfe90a-0ece-4500-8610-e4984a0800a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:04:08.136955 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfe90a-0ece-4500-8610-e4984a0800a0 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:04:08.149044 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 738/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:04:10.489120 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820980b-5167-4253-84a4-1bce488509d5 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:10.489680 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820980b-5167-4253-84a4-1bce488509d5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:10.489680 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820980b-5167-4253-84a4-1bce488509d5 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:10.491527 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 17:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:04:10.496964 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84806a11-e6f0-4a5f-b5e6-6ad5b131436b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:10.497442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84806a11-e6f0-4a5f-b5e6-6ad5b131436b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:10.497542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84806a11-e6f0-4a5f-b5e6-6ad5b131436b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:10.516703 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-84806a11-e6f0-4a5f-b5e6-6ad5b131436b None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:04:10.517889 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-84806a11-e6f0-4a5f-b5e6-6ad5b131436b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:04:10.525619 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 17:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:04:10.563482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820980b-5167-4253-84a4-1bce488509d5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:04:10.573807 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820980b-5167-4253-84a4-1bce488509d5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:04:10.577274 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d74f9-c776-472d-9b2d-93690ddb833c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:04:10.577899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d74f9-c776-472d-9b2d-93690ddb833c service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:10.578180 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d74f9-c776-472d-9b2d-93690ddb833c service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:10.578453 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d74f9-c776-472d-9b2d-93690ddb833c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:10.586963 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d74f9-c776-472d-9b2d-93690ddb833c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:04:10.588421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d74f9-c776-472d-9b2d-93690ddb833c service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:04:10.597406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 722/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:04:12.917250 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a706d-db5f-48db-bebc-3de756c9c507 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:12.917870 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a706d-db5f-48db-bebc-3de756c9c507 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:12.917870 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a706d-db5f-48db-bebc-3de756c9c507 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:12.919161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 17:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:04:12.924690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6cb30-fd18-4d93-b933-df99ce1cbe80 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:12.925162 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6cb30-fd18-4d93-b933-df99ce1cbe80 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:12.925269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6cb30-fd18-4d93-b933-df99ce1cbe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:12.945912 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-26a6cb30-fd18-4d93-b933-df99ce1cbe80 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:04:12.947093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-26a6cb30-fd18-4d93-b933-df99ce1cbe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:04:12.954755 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 17:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:04:12.992013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a706d-db5f-48db-bebc-3de756c9c507 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:04:13.002575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a706d-db5f-48db-bebc-3de756c9c507 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:04:13.006431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdb133-68cf-4610-a432-c1f4da1b45fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:04:13.007065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdb133-68cf-4610-a432-c1f4da1b45fa service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:13.007372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdb133-68cf-4610-a432-c1f4da1b45fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:13.007681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdb133-68cf-4610-a432-c1f4da1b45fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:13.016568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdb133-68cf-4610-a432-c1f4da1b45fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:04:13.018000 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdb133-68cf-4610-a432-c1f4da1b45fa service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:04:13.027246 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 741/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:04:15.402965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063377bb-69b1-4f11-bafa-264812ab7729 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:15.403479 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063377bb-69b1-4f11-bafa-264812ab7729 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:15.403479 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063377bb-69b1-4f11-bafa-264812ab7729 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:15.404866 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 17:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:04:15.410296 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d7f8e-eb1a-4d85-8aa5-3308d644e143 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:15.410731 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d7f8e-eb1a-4d85-8aa5-3308d644e143 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:15.410838 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d7f8e-eb1a-4d85-8aa5-3308d644e143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:15.428921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-9a6d7f8e-eb1a-4d85-8aa5-3308d644e143 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:04:15.430102 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9a6d7f8e-eb1a-4d85-8aa5-3308d644e143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:04:15.438636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 17:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:04:15.475849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063377bb-69b1-4f11-bafa-264812ab7729 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:04:15.486269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063377bb-69b1-4f11-bafa-264812ab7729 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:04:15.489692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd493d-421f-4fb2-98a1-e8dbb48c5bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:04:15.490467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd493d-421f-4fb2-98a1-e8dbb48c5bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:15.490737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd493d-421f-4fb2-98a1-e8dbb48c5bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:15.491000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd493d-421f-4fb2-98a1-e8dbb48c5bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:15.499792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd493d-421f-4fb2-98a1-e8dbb48c5bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:04:15.501209 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd493d-421f-4fb2-98a1-e8dbb48c5bb0 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:04:15.510327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 725/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:04:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:04:17.850653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95ee78-b343-4a5a-8c28-9973e312389b None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:17.851205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95ee78-b343-4a5a-8c28-9973e312389b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:17.851205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95ee78-b343-4a5a-8c28-9973e312389b None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:17.852737 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 17:04:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:04:17.858040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31800764-02a1-4c9f-abcc-571593455720 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:17.858475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31800764-02a1-4c9f-abcc-571593455720 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:17.858580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31800764-02a1-4c9f-abcc-571593455720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:17.876429 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-31800764-02a1-4c9f-abcc-571593455720 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:04:17.877606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-31800764-02a1-4c9f-abcc-571593455720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:04:17.885871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 17:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:04:17.923584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95ee78-b343-4a5a-8c28-9973e312389b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:04:17.935459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95ee78-b343-4a5a-8c28-9973e312389b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:04:17.939206 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299aaca-406c-42d5-9c7c-1438c8307fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:04:17.939882 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299aaca-406c-42d5-9c7c-1438c8307fab service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:17.940168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299aaca-406c-42d5-9c7c-1438c8307fab service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:17.940444 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299aaca-406c-42d5-9c7c-1438c8307fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:17.950416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299aaca-406c-42d5-9c7c-1438c8307fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:04:17.951880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299aaca-406c-42d5-9c7c-1438c8307fab service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:04:17.961585 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 744/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:04:51.537914 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bfbdc-c905-4761-b7d9-40141cb0918c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:51.538504 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bfbdc-c905-4761-b7d9-40141cb0918c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:51.538504 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bfbdc-c905-4761-b7d9-40141cb0918c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:51.539766 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 727/1471] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:04:51.544796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845796a-a818-4df9-8fcc-025698015daa None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:51.545235 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845796a-a818-4df9-8fcc-025698015daa None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:51.545349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845796a-a818-4df9-8fcc-025698015daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:51.563418 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1845796a-a818-4df9-8fcc-025698015daa None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:04:51.564644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1845796a-a818-4df9-8fcc-025698015daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:04:51.573122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 745/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:04:51.619119 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec369fc-0312-438e-b3ef-25332f753c85 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:51.619409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec369fc-0312-438e-b3ef-25332f753c85 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:51.619725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec369fc-0312-438e-b3ef-25332f753c85 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:51.621117 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 728/1473] 10.222.0.48 () {54 vars in 962 bytes} [Tue May 17 17:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:04:51.626030 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e9c48-a804-44f7-ae89-cad5ea25de6e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:51.626320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e9c48-a804-44f7-ae89-cad5ea25de6e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:51.626603 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e9c48-a804-44f7-ae89-cad5ea25de6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:51.645183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ee1e9c48-a804-44f7-ae89-cad5ea25de6e None None] MFA Rules not processed for user `b25519cdc25244a0b039ce3097c328d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:04:51.646359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ee1e9c48-a804-44f7-ae89-cad5ea25de6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:04:51.652750 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 746/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Tue May 17 17:04:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:04:51.659794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec369fc-0312-438e-b3ef-25332f753c85 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:04:51.670029 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec369fc-0312-438e-b3ef-25332f753c85 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:04:51.673520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c786c34-1fd5-4e22-bef5-06c0b9cbc814 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25519cdc25244a0b039ce3097c328d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:04:51.674135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c786c34-1fd5-4e22-bef5-06c0b9cbc814 service glance] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:51.674416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c786c34-1fd5-4e22-bef5-06c0b9cbc814 service glance] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:51.674690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c786c34-1fd5-4e22-bef5-06c0b9cbc814 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:51.684134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c786c34-1fd5-4e22-bef5-06c0b9cbc814 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:04:51.685553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c786c34-1fd5-4e22-bef5-06c0b9cbc814 service glance] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:04:51.695428 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 729/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:04:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:04:54.010284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655c06d-ea6c-4e30-952a-ef13e22f2f6f None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:54.010864 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655c06d-ea6c-4e30-952a-ef13e22f2f6f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:54.010864 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655c06d-ea6c-4e30-952a-ef13e22f2f6f None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:54.012243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 747/1476] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:04:54.017969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b444c9-1637-4c0e-ac93-82ac182a011b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:54.018447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b444c9-1637-4c0e-ac93-82ac182a011b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:54.018554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b444c9-1637-4c0e-ac93-82ac182a011b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:54.037488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-90b444c9-1637-4c0e-ac93-82ac182a011b None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:04:54.038732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-90b444c9-1637-4c0e-ac93-82ac182a011b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:04:54.047054 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 730/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:04:54.071464 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655c06d-ea6c-4e30-952a-ef13e22f2f6f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:04:54.084255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655c06d-ea6c-4e30-952a-ef13e22f2f6f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:04:54.089191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edda54-a2d2-4745-8b72-9ab828a75d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:04:54.089872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edda54-a2d2-4745-8b72-9ab828a75d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:54.090174 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edda54-a2d2-4745-8b72-9ab828a75d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:54.090458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edda54-a2d2-4745-8b72-9ab828a75d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:54.091190 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edda54-a2d2-4745-8b72-9ab828a75d96 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:04:54.093078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: WARNING py.warnings [None req-b5edda54-a2d2-4745-8b72-9ab828a75d96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 17:04:54.093078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: warnings.warn(msg) May 17 17:04:54.093078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: May 17 17:04:54.094281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edda54-a2d2-4745-8b72-9ab828a75d96 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:04:54.115119 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 748/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 17:04:54 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:04:56.363247 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158563-29b5-41cb-9ffd-25e8f58261ed None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:56.363832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158563-29b5-41cb-9ffd-25e8f58261ed None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:56.363832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158563-29b5-41cb-9ffd-25e8f58261ed None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:56.365100 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 731/1479] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:04:56.370232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d2f09-c7de-4eff-920d-e3f39fcd386d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:56.370671 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d2f09-c7de-4eff-920d-e3f39fcd386d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:56.370782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d2f09-c7de-4eff-920d-e3f39fcd386d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:56.388852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-461d2f09-c7de-4eff-920d-e3f39fcd386d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:04:56.390072 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-461d2f09-c7de-4eff-920d-e3f39fcd386d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:04:56.398455 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 749/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:04:56.440213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158563-29b5-41cb-9ffd-25e8f58261ed None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:04:56.454567 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158563-29b5-41cb-9ffd-25e8f58261ed None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:04:56.460517 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24252fd0-55d2-4bb4-92a7-a98a5ce05d29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:04:56.461141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24252fd0-55d2-4bb4-92a7-a98a5ce05d29 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:56.461419 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24252fd0-55d2-4bb4-92a7-a98a5ce05d29 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:56.461692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24252fd0-55d2-4bb4-92a7-a98a5ce05d29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:56.469431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24252fd0-55d2-4bb4-92a7-a98a5ce05d29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:04:56.471012 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24252fd0-55d2-4bb4-92a7-a98a5ce05d29 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:04:56.480621 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 732/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:04:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:04:58.864639 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f3d68-f843-449a-8bf6-af000929b2da None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:58.865223 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f3d68-f843-449a-8bf6-af000929b2da None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:58.865223 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f3d68-f843-449a-8bf6-af000929b2da None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:58.866558 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 750/1482] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:04:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:04:58.871850 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375fade-c91b-4bb3-9985-2ddc19787d2c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:58.872298 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375fade-c91b-4bb3-9985-2ddc19787d2c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:58.872441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375fade-c91b-4bb3-9985-2ddc19787d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:58.890491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b375fade-c91b-4bb3-9985-2ddc19787d2c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:04:58.891702 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b375fade-c91b-4bb3-9985-2ddc19787d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:04:58.899941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 733/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:04:58.935720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f3d68-f843-449a-8bf6-af000929b2da None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:04:58.946169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f3d68-f843-449a-8bf6-af000929b2da None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:04:58.949671 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1a19c-c5fe-4772-857e-cb783aab0810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:04:58.950324 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1a19c-c5fe-4772-857e-cb783aab0810 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:04:58.950608 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1a19c-c5fe-4772-857e-cb783aab0810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:04:58.950884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1a19c-c5fe-4772-857e-cb783aab0810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:04:58.960057 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1a19c-c5fe-4772-857e-cb783aab0810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:04:58.961477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1a19c-c5fe-4772-857e-cb783aab0810 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:04:58.970705 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 751/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:05:01.223994 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c9020-91a0-4bbc-890d-37f78efbdfd5 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:05:01.224659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c9020-91a0-4bbc-890d-37f78efbdfd5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:05:01.224659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c9020-91a0-4bbc-890d-37f78efbdfd5 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:05:01.225905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 734/1485] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:05:01.231273 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01639b6-0f56-4e0b-bf10-217fe7ceb5d2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:05:01.231742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01639b6-0f56-4e0b-bf10-217fe7ceb5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:05:01.231848 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01639b6-0f56-4e0b-bf10-217fe7ceb5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:05:01.250432 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f01639b6-0f56-4e0b-bf10-217fe7ceb5d2 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:05:01.251631 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f01639b6-0f56-4e0b-bf10-217fe7ceb5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:05:01.259946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 752/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:05:01.297011 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c9020-91a0-4bbc-890d-37f78efbdfd5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:05:01.308203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c9020-91a0-4bbc-890d-37f78efbdfd5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:05:01.311684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f05c4a-af93-42e3-beef-04969240e2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:05:01.312315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f05c4a-af93-42e3-beef-04969240e2bc service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:05:01.312591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f05c4a-af93-42e3-beef-04969240e2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:05:01.312858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f05c4a-af93-42e3-beef-04969240e2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:05:01.322253 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f05c4a-af93-42e3-beef-04969240e2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:05:01.323701 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f05c4a-af93-42e3-beef-04969240e2bc service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:05:01.332786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 735/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:05:03.680522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f70e9-788d-40f2-9195-be30ef2652c0 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:05:03.681165 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f70e9-788d-40f2-9195-be30ef2652c0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:05:03.681165 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f70e9-788d-40f2-9195-be30ef2652c0 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:05:03.682472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 753/1488] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:05:03.687785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe34434-5e03-47d5-99e2-e237f56e0ab4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:05:03.688186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe34434-5e03-47d5-99e2-e237f56e0ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:05:03.688342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe34434-5e03-47d5-99e2-e237f56e0ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:05:03.705606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3fe34434-5e03-47d5-99e2-e237f56e0ab4 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:05:03.707354 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3fe34434-5e03-47d5-99e2-e237f56e0ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:05:03.715155 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 736/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:05:03.754907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f70e9-788d-40f2-9195-be30ef2652c0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:05:03.765256 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f70e9-788d-40f2-9195-be30ef2652c0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:05:03.769555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fface773-1b5a-4abf-9e61-4418db4dd200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:05:03.770158 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fface773-1b5a-4abf-9e61-4418db4dd200 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:05:03.770441 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fface773-1b5a-4abf-9e61-4418db4dd200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:05:03.770718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fface773-1b5a-4abf-9e61-4418db4dd200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:05:03.779360 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fface773-1b5a-4abf-9e61-4418db4dd200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:05:03.780822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fface773-1b5a-4abf-9e61-4418db4dd200 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:05:03.790039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 754/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:05:06.169340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f432cc4-0788-4897-bdd4-646f10b1ef35 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:05:06.169809 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f432cc4-0788-4897-bdd4-646f10b1ef35 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:05:06.169912 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f432cc4-0788-4897-bdd4-646f10b1ef35 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:05:06.171255 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 737/1491] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 17:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:05:06.176735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabe4b6-13f9-4bbe-8307-9ec005cceb5c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:05:06.177138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabe4b6-13f9-4bbe-8307-9ec005cceb5c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:05:06.177291 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabe4b6-13f9-4bbe-8307-9ec005cceb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:05:06.195503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ecabe4b6-13f9-4bbe-8307-9ec005cceb5c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:05:06.196724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ecabe4b6-13f9-4bbe-8307-9ec005cceb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:05:06.204287 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 755/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 17:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:05:06.242476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f432cc4-0788-4897-bdd4-646f10b1ef35 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:05:06.253287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f432cc4-0788-4897-bdd4-646f10b1ef35 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:05:06.256737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a347dd7-ce2f-4933-8260-0a9056ee62d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:05:06.257356 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a347dd7-ce2f-4933-8260-0a9056ee62d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:05:06.257637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a347dd7-ce2f-4933-8260-0a9056ee62d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:05:06.257909 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a347dd7-ce2f-4933-8260-0a9056ee62d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:05:06.266511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a347dd7-ce2f-4933-8260-0a9056ee62d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:05:06.267970 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a347dd7-ce2f-4933-8260-0a9056ee62d0 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:05:06.277677 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 738/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:06:33.549680 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407d4e5-b820-4368-8c6b-92ae9c273ed9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:33.550331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407d4e5-b820-4368-8c6b-92ae9c273ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:33.550331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407d4e5-b820-4368-8c6b-92ae9c273ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:33.567728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-9407d4e5-b820-4368-8c6b-92ae9c273ed9 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:06:33.568890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9407d4e5-b820-4368-8c6b-92ae9c273ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:06:33.577003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 756/1494] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:06:33.586049 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac4c9b-8ce6-4909-9333-dca40c69d750 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:33.586651 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac4c9b-8ce6-4909-9333-dca40c69d750 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:33.586651 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac4c9b-8ce6-4909-9333-dca40c69d750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:33.604577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a8ac4c9b-8ce6-4909-9333-dca40c69d750 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:06:33.605734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a8ac4c9b-8ce6-4909-9333-dca40c69d750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:06:33.613446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 739/1495] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:06:33.617788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407d4e5-b820-4368-8c6b-92ae9c273ed9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:06:33.626991 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407d4e5-b820-4368-8c6b-92ae9c273ed9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:06:33.631392 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff5546-ce1f-4ce3-a6c1-c116772092d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:06:33.632054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff5546-ce1f-4ce3-a6c1-c116772092d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:33.632335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff5546-ce1f-4ce3-a6c1-c116772092d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:33.632603 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff5546-ce1f-4ce3-a6c1-c116772092d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:33.633309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff5546-ce1f-4ce3-a6c1-c116772092d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:06:33.633607 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff5546-ce1f-4ce3-a6c1-c116772092d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:06:33.634604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: WARNING py.warnings [None req-55ff5546-ce1f-4ce3-a6c1-c116772092d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:06:33.634604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: warnings.warn(msg) May 17 17:06:33.634604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: May 17 17:06:33.635473 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff5546-ce1f-4ce3-a6c1-c116772092d0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:06:33.647116 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 757/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:06:33.655740 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac4c9b-8ce6-4909-9333-dca40c69d750 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:06:33.664776 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac4c9b-8ce6-4909-9333-dca40c69d750 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:06:33.669432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5803eb-d5d6-4997-b38c-4f49d7431841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:06:33.670071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5803eb-d5d6-4997-b38c-4f49d7431841 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:33.670351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5803eb-d5d6-4997-b38c-4f49d7431841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:33.670652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5803eb-d5d6-4997-b38c-4f49d7431841 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:33.671348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5803eb-d5d6-4997-b38c-4f49d7431841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:06:33.673445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-1e5803eb-d5d6-4997-b38c-4f49d7431841 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 17:06:33.673445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: warnings.warn(msg) May 17 17:06:33.673445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: May 17 17:06:33.674628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5803eb-d5d6-4997-b38c-4f49d7431841 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:06:33.710183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 740/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:06:33 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:06:33.714233 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff5546-ce1f-4ce3-a6c1-c116772092d0 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:06:33.724415 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff5546-ce1f-4ce3-a6c1-c116772092d0 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:06:33.777243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9c3cc-2703-4838-b2c9-19ec40201083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:06:33.777896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9c3cc-2703-4838-b2c9-19ec40201083 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:33.778180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9c3cc-2703-4838-b2c9-19ec40201083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:33.778521 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9c3cc-2703-4838-b2c9-19ec40201083 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:33.779338 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9c3cc-2703-4838-b2c9-19ec40201083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:06:33.780380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: WARNING py.warnings [None req-fea9c3cc-2703-4838-b2c9-19ec40201083 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 17:06:33.780380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: warnings.warn(msg) May 17 17:06:33.780380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: May 17 17:06:33.781567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9c3cc-2703-4838-b2c9-19ec40201083 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:06:33.801540 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 758/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:06:33 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:06:33.805594 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5803eb-d5d6-4997-b38c-4f49d7431841 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:06:33.816888 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5803eb-d5d6-4997-b38c-4f49d7431841 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:06:33.821429 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47eedda-8ec3-4bac-87c5-0416e52b04e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:06:33.822072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eedda-8ec3-4bac-87c5-0416e52b04e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:33.822348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eedda-8ec3-4bac-87c5-0416e52b04e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:33.822619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eedda-8ec3-4bac-87c5-0416e52b04e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:33.823327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47eedda-8ec3-4bac-87c5-0416e52b04e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:06:33.824397 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-b47eedda-8ec3-4bac-87c5-0416e52b04e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:06:33.824397 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: warnings.warn(msg) May 17 17:06:33.824397 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: May 17 17:06:33.825924 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47eedda-8ec3-4bac-87c5-0416e52b04e0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:06:33.838589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 741/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:06:33.842859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9c3cc-2703-4838-b2c9-19ec40201083 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:06:33.852552 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9c3cc-2703-4838-b2c9-19ec40201083 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:06:33.857242 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718e833-2d0c-4f26-b875-ba0804da2d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:06:33.857887 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718e833-2d0c-4f26-b875-ba0804da2d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:33.858170 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718e833-2d0c-4f26-b875-ba0804da2d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:33.858445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718e833-2d0c-4f26-b875-ba0804da2d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:33.859159 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718e833-2d0c-4f26-b875-ba0804da2d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:06:33.860188 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: WARNING py.warnings [None req-d718e833-2d0c-4f26-b875-ba0804da2d7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:06:33.860188 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: warnings.warn(msg) May 17 17:06:33.860188 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: May 17 17:06:33.861076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718e833-2d0c-4f26-b875-ba0804da2d7c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:06:33.875379 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 759/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:06:33.879630 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47eedda-8ec3-4bac-87c5-0416e52b04e0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:06:33.889786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47eedda-8ec3-4bac-87c5-0416e52b04e0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:06:33.894215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd3cca-1af2-4315-9f85-a0c322f5456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:06:33.895081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd3cca-1af2-4315-9f85-a0c322f5456f admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:33.895356 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd3cca-1af2-4315-9f85-a0c322f5456f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:33.895653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd3cca-1af2-4315-9f85-a0c322f5456f admin admin] PATH_INFO: `/v3/projects/af43abbaa8114200a93c65f809f3b6e5/users/52ab4e5aa2e94c67a9015f3ed7048885/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:33.909906 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd3cca-1af2-4315-9f85-a0c322f5456f admin admin] RBAC: Authorizing `identity:create_grant(project_id=af43abbaa8114200a93c65f809f3b6e5, user_id=52ab4e5aa2e94c67a9015f3ed7048885, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:06:33.910938 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-cdfd3cca-1af2-4315-9f85-a0c322f5456f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 17:06:33.910938 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: warnings.warn(msg) May 17 17:06:33.910938 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: May 17 17:06:33.912936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd3cca-1af2-4315-9f85-a0c322f5456f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:06:33.926008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 742/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:06:33 2022] PUT /identity/v3/projects/af43abbaa8114200a93c65f809f3b6e5/users/52ab4e5aa2e94c67a9015f3ed7048885/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:06:33.937484 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c9d2a-d947-4f9e-a409-dcf07ff04f2f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:33.937800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c9d2a-d947-4f9e-a409-dcf07ff04f2f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:33.938078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c9d2a-d947-4f9e-a409-dcf07ff04f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:33.963497 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-775c9d2a-d947-4f9e-a409-dcf07ff04f2f None None] MFA Rules not processed for user `52ab4e5aa2e94c67a9015f3ed7048885`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:06:33.964733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-775c9d2a-d947-4f9e-a409-dcf07ff04f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:06:34.026568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 760/1502] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:06:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:06:34.039806 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e79ea-aa9d-4df9-9cec-512b3b5cc231 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:34.040116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e79ea-aa9d-4df9-9cec-512b3b5cc231 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:34.040394 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e79ea-aa9d-4df9-9cec-512b3b5cc231 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:34.041797 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 743/1503] 10.222.0.48 () {54 vars in 963 bytes} [Tue May 17 17:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:06:34.046619 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f1d7c-18b4-4192-922e-72e5513d073f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:34.046908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f1d7c-18b4-4192-922e-72e5513d073f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:34.047183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f1d7c-18b4-4192-922e-72e5513d073f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:34.065175 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a29f1d7c-18b4-4192-922e-72e5513d073f None None] MFA Rules not processed for user `97e0aa0cdd8544ca9e16d1af3bff411f`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:06:34.066270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a29f1d7c-18b4-4192-922e-72e5513d073f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:06:34.115487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 761/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Tue May 17 17:06:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:06:34.123788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e79ea-aa9d-4df9-9cec-512b3b5cc231 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:06:34.134158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e79ea-aa9d-4df9-9cec-512b3b5cc231 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:06:34.137629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a21eb-5b44-4f3e-be08-80266c146b7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:06:34.138394 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a21eb-5b44-4f3e-be08-80266c146b7b service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:34.138678 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a21eb-5b44-4f3e-be08-80266c146b7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:34.138951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a21eb-5b44-4f3e-be08-80266c146b7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:34.147091 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a21eb-5b44-4f3e-be08-80266c146b7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:06:34.148540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a21eb-5b44-4f3e-be08-80266c146b7b service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:06:34.157160 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 744/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:06:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:06:34.199311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6e931-b34c-4ef0-a580-395fe6be7a3c None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:34.199614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6e931-b34c-4ef0-a580-395fe6be7a3c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:34.199934 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6e931-b34c-4ef0-a580-395fe6be7a3c None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:34.201734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 762/1506] 10.222.0.48 () {52 vars in 829 bytes} [Tue May 17 17:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:06:34.205398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a21eb-5b44-4f3e-be08-80266c146b7b service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:06:34.264424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a21eb-5b44-4f3e-be08-80266c146b7b service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:06:34.268881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075243e-1269-421e-aca0-71a4b62aa2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:06:34.269735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075243e-1269-421e-aca0-71a4b62aa2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:34.270011 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075243e-1269-421e-aca0-71a4b62aa2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:34.270278 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075243e-1269-421e-aca0-71a4b62aa2bb admin admin] PATH_INFO: `/v3/users/52ab4e5aa2e94c67a9015f3ed7048885` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:34.271432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075243e-1269-421e-aca0-71a4b62aa2bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ab4e5aa2e94c67a9015f3ed7048885)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:06:34.272471 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-8075243e-1269-421e-aca0-71a4b62aa2bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 17:06:34.272471 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: warnings.warn(msg) May 17 17:06:34.272471 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: May 17 17:06:34.273683 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075243e-1269-421e-aca0-71a4b62aa2bb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:06:34.339978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8075243e-1269-421e-aca0-71a4b62aa2bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ab4e5aa2e94c67a9015f3ed7048885'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:06:34.358168 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8075243e-1269-421e-aca0-71a4b62aa2bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ab4e5aa2e94c67a9015f3ed7048885'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:06:34.369896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8075243e-1269-421e-aca0-71a4b62aa2bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ab4e5aa2e94c67a9015f3ed7048885'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:06:34.370587 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8075243e-1269-421e-aca0-71a4b62aa2bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ab4e5aa2e94c67a9015f3ed7048885'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:06:34.371319 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8075243e-1269-421e-aca0-71a4b62aa2bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ab4e5aa2e94c67a9015f3ed7048885'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:06:34.386319 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 745/1507] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:06:34 2022] DELETE /identity/v3/users/52ab4e5aa2e94c67a9015f3ed7048885 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:06:34.390906 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705a66d-d53d-4584-b7f2-a42d6fad2df2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:34.391204 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705a66d-d53d-4584-b7f2-a42d6fad2df2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:34.391471 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705a66d-d53d-4584-b7f2-a42d6fad2df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:34.408749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1705a66d-d53d-4584-b7f2-a42d6fad2df2 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:06:34.409932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1705a66d-d53d-4584-b7f2-a42d6fad2df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:06:34.465629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 763/1508] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:06:34.475788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075243e-1269-421e-aca0-71a4b62aa2bb admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:06:34.477181 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8075243e-1269-421e-aca0-71a4b62aa2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:06:34.532527 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075243e-1269-421e-aca0-71a4b62aa2bb admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:06:34.536147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede27535-334f-4bab-a0dd-483badc5f020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:06:34.536819 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede27535-334f-4bab-a0dd-483badc5f020 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:34.537104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede27535-334f-4bab-a0dd-483badc5f020 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:34.537382 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede27535-334f-4bab-a0dd-483badc5f020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:34.546723 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede27535-334f-4bab-a0dd-483badc5f020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:06:34.548460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede27535-334f-4bab-a0dd-483badc5f020 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:06:34.557559 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 746/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:06:34.916700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705a66d-d53d-4584-b7f2-a42d6fad2df2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:06:34.918206 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1705a66d-d53d-4584-b7f2-a42d6fad2df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:06:34.931356 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705a66d-d53d-4584-b7f2-a42d6fad2df2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:06:34.935931 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32862d6-882e-45ad-bacf-54dca1579adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:06:34.936813 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32862d6-882e-45ad-bacf-54dca1579adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:06:34.937083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32862d6-882e-45ad-bacf-54dca1579adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:06:34.937489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32862d6-882e-45ad-bacf-54dca1579adf admin admin] PATH_INFO: `/v3/projects/af43abbaa8114200a93c65f809f3b6e5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:06:34.938828 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32862d6-882e-45ad-bacf-54dca1579adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=af43abbaa8114200a93c65f809f3b6e5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:06:34.939867 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: WARNING py.warnings [None req-e32862d6-882e-45ad-bacf-54dca1579adf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 17:06:34.939867 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: warnings.warn(msg) May 17 17:06:34.939867 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: May 17 17:06:34.941047 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32862d6-882e-45ad-bacf-54dca1579adf admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:06:34.998196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e32862d6-882e-45ad-bacf-54dca1579adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af43abbaa8114200a93c65f809f3b6e5', 'request_id': 'req-e32862d6-882e-45ad-bacf-54dca1579adf'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:06:35.003817 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e32862d6-882e-45ad-bacf-54dca1579adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af43abbaa8114200a93c65f809f3b6e5', 'request_id': 'req-e32862d6-882e-45ad-bacf-54dca1579adf'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:06:35.013210 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e32862d6-882e-45ad-bacf-54dca1579adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af43abbaa8114200a93c65f809f3b6e5', 'request_id': 'req-e32862d6-882e-45ad-bacf-54dca1579adf'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:06:35.032481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e32862d6-882e-45ad-bacf-54dca1579adf admin admin] The token cache is being invalidate because project af43abbaa8114200a93c65f809f3b6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:06:35.032766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e32862d6-882e-45ad-bacf-54dca1579adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:06:35.033498 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e32862d6-882e-45ad-bacf-54dca1579adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:06:35.035018 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 764/1510] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:06:34 2022] DELETE /identity/v3/projects/af43abbaa8114200a93c65f809f3b6e5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:08:15.185253 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a290ef-4a2a-4b9c-9b84-ae4a406cf078 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:15.185857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a290ef-4a2a-4b9c-9b84-ae4a406cf078 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:15.185857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a290ef-4a2a-4b9c-9b84-ae4a406cf078 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:15.187154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 17:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:08:15.192000 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f93512-46ee-4131-9eb1-283fda92d523 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:15.192421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f93512-46ee-4131-9eb1-283fda92d523 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:15.192565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f93512-46ee-4131-9eb1-283fda92d523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:15.210135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-10f93512-46ee-4131-9eb1-283fda92d523 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:08:15.211338 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-10f93512-46ee-4131-9eb1-283fda92d523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:08:15.270380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 17:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:08:15.438241 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a290ef-4a2a-4b9c-9b84-ae4a406cf078 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:08:15.439877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-44a290ef-4a2a-4b9c-9b84-ae4a406cf078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:08:15.512029 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a290ef-4a2a-4b9c-9b84-ae4a406cf078 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:08:15.517637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3f119-0b6c-4de0-8537-2eb5ce0289a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:08:15.518283 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3f119-0b6c-4de0-8537-2eb5ce0289a2 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:15.518565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3f119-0b6c-4de0-8537-2eb5ce0289a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:15.518840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3f119-0b6c-4de0-8537-2eb5ce0289a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:15.527396 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3f119-0b6c-4de0-8537-2eb5ce0289a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:08:15.529213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3f119-0b6c-4de0-8537-2eb5ce0289a2 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:08:15.538261 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 748/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:08:16.058951 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59229cb-a31c-4da7-bc08-15189788a51d None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:16.059255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59229cb-a31c-4da7-bc08-15189788a51d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:16.059563 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59229cb-a31c-4da7-bc08-15189788a51d None None] PATH_INFO: `/v3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:16.060917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 766/1514] 10.222.0.23 () {54 vars in 925 bytes} [Tue May 17 17:08:16 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:08:16.066708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d618bf-1389-44a6-b304-08e0d9ec2ef7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:16.067131 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d618bf-1389-44a6-b304-08e0d9ec2ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:16.067474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d618bf-1389-44a6-b304-08e0d9ec2ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:16.085465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-89d618bf-1389-44a6-b304-08e0d9ec2ef7 None None] MFA Rules not processed for user `7730d6cad2ba40c19cb671268cf04d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:08:16.086647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-89d618bf-1389-44a6-b304-08e0d9ec2ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:08:16.152682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 749/1515] 10.222.0.23 () {58 vars in 1015 bytes} [Tue May 17 17:08:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:08:16.444647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3630f7-9ca2-4fb2-90c1-a68396cd6fc8 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:16.445182 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3630f7-9ca2-4fb2-90c1-a68396cd6fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:16.445182 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3630f7-9ca2-4fb2-90c1-a68396cd6fc8 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:16.446507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 767/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 17:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:08:16.451957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813eebaa-4ada-4ea1-be99-8442a8940560 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:16.452381 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813eebaa-4ada-4ea1-be99-8442a8940560 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:16.452490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813eebaa-4ada-4ea1-be99-8442a8940560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:16.469846 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-813eebaa-4ada-4ea1-be99-8442a8940560 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:08:16.471007 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-813eebaa-4ada-4ea1-be99-8442a8940560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:08:16.478655 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 750/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 17:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:08:16.630142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3630f7-9ca2-4fb2-90c1-a68396cd6fc8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:08:16.645019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3630f7-9ca2-4fb2-90c1-a68396cd6fc8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:08:16.650376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebf420-d850-49d0-bdf1-f4cace1c0cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:08:16.651001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebf420-d850-49d0-bdf1-f4cace1c0cd2 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:16.651285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebf420-d850-49d0-bdf1-f4cace1c0cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:16.651564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebf420-d850-49d0-bdf1-f4cace1c0cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:16.659531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebf420-d850-49d0-bdf1-f4cace1c0cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:08:16.661153 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebf420-d850-49d0-bdf1-f4cace1c0cd2 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:08:16.670546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 768/1518] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:08:19.957137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07792f7a-e552-471a-88ea-c685aa90347c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:19.957694 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07792f7a-e552-471a-88ea-c685aa90347c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:19.957694 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07792f7a-e552-471a-88ea-c685aa90347c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:19.959005 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 751/1519] 10.222.0.48 () {54 vars in 960 bytes} [Tue May 17 17:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:08:19.963803 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7147dab-9bf4-4b8b-83e7-26341b19ba15 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:19.964239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7147dab-9bf4-4b8b-83e7-26341b19ba15 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:19.964339 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7147dab-9bf4-4b8b-83e7-26341b19ba15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:19.984100 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a7147dab-9bf4-4b8b-83e7-26341b19ba15 None None] MFA Rules not processed for user `7730d6cad2ba40c19cb671268cf04d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:08:19.985285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a7147dab-9bf4-4b8b-83e7-26341b19ba15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:08:19.994707 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 769/1520] 10.222.0.48 () {58 vars in 1057 bytes} [Tue May 17 17:08:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:08:20.004705 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07792f7a-e552-471a-88ea-c685aa90347c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:08:20.018677 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07792f7a-e552-471a-88ea-c685aa90347c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:08:20.023735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6beeb-d7a9-4341-999a-e158765a617b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7730d6cad2ba40c19cb671268cf04d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:08:20.024381 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6beeb-d7a9-4341-999a-e158765a617b service placement] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:20.024655 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6beeb-d7a9-4341-999a-e158765a617b service placement] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:20.024921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6beeb-d7a9-4341-999a-e158765a617b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:20.034896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6beeb-d7a9-4341-999a-e158765a617b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:08:20.036549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6beeb-d7a9-4341-999a-e158765a617b service placement] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:08:20.046635 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 752/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:08:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:08:27.972477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb3406-4dea-44cc-bbbc-b8008f358cdf None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:27.973054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb3406-4dea-44cc-bbbc-b8008f358cdf None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:27.973054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb3406-4dea-44cc-bbbc-b8008f358cdf None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:27.974389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 17:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:08:27.979234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e5244-1651-4aaa-8177-024ce3a0f7ad None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:27.979693 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e5244-1651-4aaa-8177-024ce3a0f7ad None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:27.979824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e5244-1651-4aaa-8177-024ce3a0f7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:27.997258 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-594e5244-1651-4aaa-8177-024ce3a0f7ad None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:08:27.998418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-594e5244-1651-4aaa-8177-024ce3a0f7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:08:28.006283 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 17:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:08:28.154948 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb3406-4dea-44cc-bbbc-b8008f358cdf None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:08:28.169856 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb3406-4dea-44cc-bbbc-b8008f358cdf None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:08:28.175152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aa123-ad20-4036-b944-70bf16b2fe5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:08:28.175795 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aa123-ad20-4036-b944-70bf16b2fe5e service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:28.176073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aa123-ad20-4036-b944-70bf16b2fe5e service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:28.176345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aa123-ad20-4036-b944-70bf16b2fe5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:28.184134 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aa123-ad20-4036-b944-70bf16b2fe5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:08:28.185706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aa123-ad20-4036-b944-70bf16b2fe5e service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:08:28.194620 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 771/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:08:29.090574 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975c4c0-afe4-485e-9d16-d7a5377bff11 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:29.091140 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975c4c0-afe4-485e-9d16-d7a5377bff11 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:29.091140 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975c4c0-afe4-485e-9d16-d7a5377bff11 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:29.092658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 17:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:08:29.097428 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878504a0-03c8-4ae5-8f77-2d0ca29c9f65 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:29.097839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878504a0-03c8-4ae5-8f77-2d0ca29c9f65 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:29.097991 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878504a0-03c8-4ae5-8f77-2d0ca29c9f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:29.115629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-878504a0-03c8-4ae5-8f77-2d0ca29c9f65 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:08:29.116803 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-878504a0-03c8-4ae5-8f77-2d0ca29c9f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:08:29.125105 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 17:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:08:29.275177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975c4c0-afe4-485e-9d16-d7a5377bff11 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:08:29.289984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975c4c0-afe4-485e-9d16-d7a5377bff11 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:08:29.296364 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54acdc-03bb-42e7-89d6-45d8a4cebda4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:08:29.297018 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54acdc-03bb-42e7-89d6-45d8a4cebda4 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:29.297301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54acdc-03bb-42e7-89d6-45d8a4cebda4 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:29.297577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54acdc-03bb-42e7-89d6-45d8a4cebda4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:29.305474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54acdc-03bb-42e7-89d6-45d8a4cebda4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:08:29.307040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54acdc-03bb-42e7-89d6-45d8a4cebda4 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:08:29.316514 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 755/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:08:33.494477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9eb87-b042-4cf2-aa33-878ce397da77 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:33.495016 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9eb87-b042-4cf2-aa33-878ce397da77 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:33.495016 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9eb87-b042-4cf2-aa33-878ce397da77 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:33.496937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 17:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:08:33.502112 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e621a-b613-4c95-808a-062006a9c204 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:33.502528 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e621a-b613-4c95-808a-062006a9c204 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:33.502672 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e621a-b613-4c95-808a-062006a9c204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:33.520020 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7c0e621a-b613-4c95-808a-062006a9c204 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:08:33.521193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7c0e621a-b613-4c95-808a-062006a9c204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:08:33.528950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 17:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:08:33.565778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9eb87-b042-4cf2-aa33-878ce397da77 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:08:33.567424 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5ab9eb87-b042-4cf2-aa33-878ce397da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:08:33.622067 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9eb87-b042-4cf2-aa33-878ce397da77 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:08:33.625646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbe09b-8c25-4ad2-826d-886b478a925e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:08:33.626277 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbe09b-8c25-4ad2-826d-886b478a925e service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:33.626555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbe09b-8c25-4ad2-826d-886b478a925e service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:33.626825 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbe09b-8c25-4ad2-826d-886b478a925e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:33.635337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbe09b-8c25-4ad2-826d-886b478a925e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:08:33.636898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbe09b-8c25-4ad2-826d-886b478a925e service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:08:33.645935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 774/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:08:35.852255 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338057e3-b5ce-44f1-80ee-46f5012cdb82 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:35.852805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338057e3-b5ce-44f1-80ee-46f5012cdb82 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:35.852805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338057e3-b5ce-44f1-80ee-46f5012cdb82 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:35.854262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 17:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:08:35.860138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ac684-1ea7-48d3-a54c-7c7f12c56a1d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:35.860616 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ac684-1ea7-48d3-a54c-7c7f12c56a1d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:35.860749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ac684-1ea7-48d3-a54c-7c7f12c56a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:35.878576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-120ac684-1ea7-48d3-a54c-7c7f12c56a1d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:08:35.879773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-120ac684-1ea7-48d3-a54c-7c7f12c56a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:08:35.887570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 17:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:08:35.922664 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338057e3-b5ce-44f1-80ee-46f5012cdb82 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:08:35.933071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338057e3-b5ce-44f1-80ee-46f5012cdb82 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:08:35.937368 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847bec1-f6b7-4e40-984f-044b38a7d9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:08:35.937993 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847bec1-f6b7-4e40-984f-044b38a7d9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:35.938272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847bec1-f6b7-4e40-984f-044b38a7d9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:35.938547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847bec1-f6b7-4e40-984f-044b38a7d9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:35.947445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847bec1-f6b7-4e40-984f-044b38a7d9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:08:35.948957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847bec1-f6b7-4e40-984f-044b38a7d9e3 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:08:35.958317 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 758/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:08:40.050035 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e710a-65b1-4bc4-98b4-a8e6258a3386 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:40.050620 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e710a-65b1-4bc4-98b4-a8e6258a3386 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:40.050620 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e710a-65b1-4bc4-98b4-a8e6258a3386 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:40.052028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 17:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:08:40.057157 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d525c-c0e1-44a5-9877-82e8614dbfab None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:40.057568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d525c-c0e1-44a5-9877-82e8614dbfab None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:40.057708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d525c-c0e1-44a5-9877-82e8614dbfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:40.078058 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a17d525c-c0e1-44a5-9877-82e8614dbfab None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:08:40.079496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a17d525c-c0e1-44a5-9877-82e8614dbfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:08:40.087395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 17:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:08:40.370055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e710a-65b1-4bc4-98b4-a8e6258a3386 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:08:40.371746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-460e710a-65b1-4bc4-98b4-a8e6258a3386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:08:40.427138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e710a-65b1-4bc4-98b4-a8e6258a3386 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:08:40.430985 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1f987-f43d-4068-b0d3-1451b66e4452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:08:40.431654 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1f987-f43d-4068-b0d3-1451b66e4452 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:40.431940 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1f987-f43d-4068-b0d3-1451b66e4452 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:40.432255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1f987-f43d-4068-b0d3-1451b66e4452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:40.442191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1f987-f43d-4068-b0d3-1451b66e4452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:08:40.443765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1f987-f43d-4068-b0d3-1451b66e4452 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:08:40.454645 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 777/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:08:42.754198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79833a2-bca0-49f3-a3f3-b3b0f247fcb7 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:42.754781 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79833a2-bca0-49f3-a3f3-b3b0f247fcb7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:42.754781 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79833a2-bca0-49f3-a3f3-b3b0f247fcb7 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:42.756147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 17:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:08:42.762144 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41971f0-3aef-40b4-9eca-b0d356453d6c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:42.762648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41971f0-3aef-40b4-9eca-b0d356453d6c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:42.762907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41971f0-3aef-40b4-9eca-b0d356453d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:42.782571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d41971f0-3aef-40b4-9eca-b0d356453d6c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:08:42.783794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d41971f0-3aef-40b4-9eca-b0d356453d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:08:42.791484 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 17:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:08:43.076892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79833a2-bca0-49f3-a3f3-b3b0f247fcb7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:08:43.078636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d79833a2-bca0-49f3-a3f3-b3b0f247fcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:08:43.093292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79833a2-bca0-49f3-a3f3-b3b0f247fcb7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:08:43.096900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b270edb-ac2c-4f1b-9262-7df3a6245da8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:08:43.097553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b270edb-ac2c-4f1b-9262-7df3a6245da8 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:08:43.097830 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b270edb-ac2c-4f1b-9262-7df3a6245da8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:08:43.098097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b270edb-ac2c-4f1b-9262-7df3a6245da8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:08:43.107797 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b270edb-ac2c-4f1b-9262-7df3a6245da8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:08:43.109240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b270edb-ac2c-4f1b-9262-7df3a6245da8 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:08:43.118579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 761/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:15.747786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb0af4-2369-4208-8718-6cd0ce3a3dde None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:15.748465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb0af4-2369-4208-8718-6cd0ce3a3dde None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:15.748465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb0af4-2369-4208-8718-6cd0ce3a3dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:15.784770 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4abb0af4-2369-4208-8718-6cd0ce3a3dde None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:15.785754 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ee0b-e1c1-4c7a-9814-9b3c7c23f4f6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:15.786254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4abb0af4-2369-4208-8718-6cd0ce3a3dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:15.786776 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ee0b-e1c1-4c7a-9814-9b3c7c23f4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:15.787297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ee0b-e1c1-4c7a-9814-9b3c7c23f4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:15.802945 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 779/1540] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:10:15.841540 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288c110-1498-4a21-ba30-89acc72ddfcb None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:15.842243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288c110-1498-4a21-ba30-89acc72ddfcb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:15.842770 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288c110-1498-4a21-ba30-89acc72ddfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:15.892889 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b288c110-1498-4a21-ba30-89acc72ddfcb None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:15.894547 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b288c110-1498-4a21-ba30-89acc72ddfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:15.918147 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 780/1541] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 17 17:10:15.943400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288c110-1498-4a21-ba30-89acc72ddfcb None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:15.966569 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288c110-1498-4a21-ba30-89acc72ddfcb None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:15.981488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2e04-bb94-49ba-b0de-fa9c8c8bedf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:15.982163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2e04-bb94-49ba-b0de-fa9c8c8bedf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:15.982443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2e04-bb94-49ba-b0de-fa9c8c8bedf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:15.982769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2e04-bb94-49ba-b0de-fa9c8c8bedf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:15.983507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e2e04-bb94-49ba-b0de-fa9c8c8bedf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:10:15.983976 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e2e04-bb94-49ba-b0de-fa9c8c8bedf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:15.985726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e2e04-bb94-49ba-b0de-fa9c8c8bedf2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:15.987899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-57f2ee0b-e1c1-4c7a-9814-9b3c7c23f4f6 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:15.989133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-57f2ee0b-e1c1-4c7a-9814-9b3c7c23f4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:16.009010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 781/1542] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:10:16.009211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 762/1543] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:16.017883 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2e04-bb94-49ba-b0de-fa9c8c8bedf2 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.021586 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e253a8d-b4cd-438b-962c-d854df215581 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.021867 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e253a8d-b4cd-438b-962c-d854df215581 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.022138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e253a8d-b4cd-438b-962c-d854df215581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.051565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2e04-bb94-49ba-b0de-fa9c8c8bedf2 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.061929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab7ce6-91a3-4091-bc37-8c4c875fb7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.062613 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab7ce6-91a3-4091-bc37-8c4c875fb7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.062896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab7ce6-91a3-4091-bc37-8c4c875fb7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.063176 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab7ce6-91a3-4091-bc37-8c4c875fb7f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.063927 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab7ce6-91a3-4091-bc37-8c4c875fb7f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.064950 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: WARNING py.warnings [None req-54ab7ce6-91a3-4091-bc37-8c4c875fb7f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 17:10:16.064950 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: warnings.warn(msg) May 17 17:10:16.064950 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: May 17 17:10:16.066472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4e253a8d-b4cd-438b-962c-d854df215581 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:16.067706 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4e253a8d-b4cd-438b-962c-d854df215581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:16.070503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab7ce6-91a3-4091-bc37-8c4c875fb7f8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.088167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 763/1544] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:10:16.089537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7e8db-6f9b-4de6-a74d-f51ed75d2910 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.089823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7e8db-6f9b-4de6-a74d-f51ed75d2910 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.090102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7e8db-6f9b-4de6-a74d-f51ed75d2910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.112619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a9d7e8db-6f9b-4de6-a74d-f51ed75d2910 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:16.113933 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a9d7e8db-6f9b-4de6-a74d-f51ed75d2910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:16.129094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 764/1545] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:16.131640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f61f5-e5b2-4ee0-a33f-01d2656736a3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.131640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f61f5-e5b2-4ee0-a33f-01d2656736a3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.131640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f61f5-e5b2-4ee0-a33f-01d2656736a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.134386 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 782/1546] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/projects => generated 407 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:10:16.136096 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab7ce6-91a3-4091-bc37-8c4c875fb7f8 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.165523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4b4f61f5-e5b2-4ee0-a33f-01d2656736a3 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:16.167122 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4b4f61f5-e5b2-4ee0-a33f-01d2656736a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:16.224111 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab7ce6-91a3-4091-bc37-8c4c875fb7f8 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.232628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7ba5c-75cc-4cbf-aeb5-d103f76cb393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.233317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7ba5c-75cc-4cbf-aeb5-d103f76cb393 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.233597 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7ba5c-75cc-4cbf-aeb5-d103f76cb393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.233870 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7ba5c-75cc-4cbf-aeb5-d103f76cb393 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.234596 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7ba5c-75cc-4cbf-aeb5-d103f76cb393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:10:16.234904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7ba5c-75cc-4cbf-aeb5-d103f76cb393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.236576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7ba5c-75cc-4cbf-aeb5-d103f76cb393 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.249764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 783/1547] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:10:16.250741 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7ba5c-75cc-4cbf-aeb5-d103f76cb393 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.263774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7ba5c-75cc-4cbf-aeb5-d103f76cb393 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.271693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c982a6-9cf5-43c0-8a27-cdfb504ff924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.273401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c982a6-9cf5-43c0-8a27-cdfb504ff924 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.273401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c982a6-9cf5-43c0-8a27-cdfb504ff924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.273401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c982a6-9cf5-43c0-8a27-cdfb504ff924 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.273401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c982a6-9cf5-43c0-8a27-cdfb504ff924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.277424 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c982a6-9cf5-43c0-8a27-cdfb504ff924 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.296383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 765/1548] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:16.296383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1667e4-d23a-4fbe-902e-27edf308461e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.296383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1667e4-d23a-4fbe-902e-27edf308461e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.296383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1667e4-d23a-4fbe-902e-27edf308461e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.322384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 784/1549] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/users => generated 304 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:16.324991 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18537-be47-49fe-b27d-4278fd3a8819 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.325469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18537-be47-49fe-b27d-4278fd3a8819 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.325639 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18537-be47-49fe-b27d-4278fd3a8819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.333767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cf1667e4-d23a-4fbe-902e-27edf308461e None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:16.334965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cf1667e4-d23a-4fbe-902e-27edf308461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:16.348754 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 766/1550] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:16.348754 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f4f7-4a99-4cfa-a097-339c2f7ffb97 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.348754 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f4f7-4a99-4cfa-a097-339c2f7ffb97 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.348754 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f4f7-4a99-4cfa-a097-339c2f7ffb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.350440 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-18e18537-be47-49fe-b27d-4278fd3a8819 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:16.351719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-18e18537-be47-49fe-b27d-4278fd3a8819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:16.367808 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 785/1551] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:16.370631 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18b47c-252c-4d44-860d-c2e9debb8580 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.371411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18b47c-252c-4d44-860d-c2e9debb8580 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.371962 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18b47c-252c-4d44-860d-c2e9debb8580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.380134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9664f4f7-4a99-4cfa-a097-339c2f7ffb97 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:16.382268 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9664f4f7-4a99-4cfa-a097-339c2f7ffb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:16.393174 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-eb18b47c-252c-4d44-860d-c2e9debb8580 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:16.395049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-eb18b47c-252c-4d44-860d-c2e9debb8580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:16.398110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 767/1552] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:16.399081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664f4f7-4a99-4cfa-a097-339c2f7ffb97 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.407877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 786/1553] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:16.409043 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664f4f7-4a99-4cfa-a097-339c2f7ffb97 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.409495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad669dc5-aba3-4d0c-943e-7f93d40eea2d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.409901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad669dc5-aba3-4d0c-943e-7f93d40eea2d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.410186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad669dc5-aba3-4d0c-943e-7f93d40eea2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.414116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47204cd-47af-49f5-a142-d77528d6ffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.414791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47204cd-47af-49f5-a142-d77528d6ffdc admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.415075 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47204cd-47af-49f5-a142-d77528d6ffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.415627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47204cd-47af-49f5-a142-d77528d6ffdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.416362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47204cd-47af-49f5-a142-d77528d6ffdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.419186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47204cd-47af-49f5-a142-d77528d6ffdc admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.432132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ad669dc5-aba3-4d0c-943e-7f93d40eea2d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:16.433581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ad669dc5-aba3-4d0c-943e-7f93d40eea2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:16.442551 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 787/1554] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:16.443359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad669dc5-aba3-4d0c-943e-7f93d40eea2d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.448996 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 768/1555] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:16.450568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47204cd-47af-49f5-a142-d77528d6ffdc admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.457316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad669dc5-aba3-4d0c-943e-7f93d40eea2d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.512387 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47204cd-47af-49f5-a142-d77528d6ffdc admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.517010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061d040-a7b1-41c5-8d9d-17059b15e609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.517639 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061d040-a7b1-41c5-8d9d-17059b15e609 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.517910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061d040-a7b1-41c5-8d9d-17059b15e609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.518178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061d040-a7b1-41c5-8d9d-17059b15e609 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.518525 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5495afd-ee36-43be-83c9-66df287d4e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.518897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061d040-a7b1-41c5-8d9d-17059b15e609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:10:16.519197 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061d040-a7b1-41c5-8d9d-17059b15e609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.519324 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5495afd-ee36-43be-83c9-66df287d4e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.519477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5495afd-ee36-43be-83c9-66df287d4e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.519797 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5495afd-ee36-43be-83c9-66df287d4e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.520251 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-2061d040-a7b1-41c5-8d9d-17059b15e609 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 17:10:16.520251 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: warnings.warn(msg) May 17 17:10:16.520251 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: May 17 17:10:16.520526 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5495afd-ee36-43be-83c9-66df287d4e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.521134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061d040-a7b1-41c5-8d9d-17059b15e609 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.522112 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5495afd-ee36-43be-83c9-66df287d4e93 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.536365 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 788/1556] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:16.536588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 769/1557] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:10:16.536684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed1f78-ec44-4a53-964a-c2ea386f2808 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.536684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed1f78-ec44-4a53-964a-c2ea386f2808 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.536684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed1f78-ec44-4a53-964a-c2ea386f2808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.536940 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7c208-c3ff-4936-985e-a0cb82f71bc3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.536940 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7c208-c3ff-4936-985e-a0cb82f71bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.536940 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7c208-c3ff-4936-985e-a0cb82f71bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.561086 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-98ed1f78-ec44-4a53-964a-c2ea386f2808 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:16.561414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b4c7c208-c3ff-4936-985e-a0cb82f71bc3 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:16.562285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-98ed1f78-ec44-4a53-964a-c2ea386f2808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:16.562464 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b4c7c208-c3ff-4936-985e-a0cb82f71bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:16.570145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 789/1558] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:16.571372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d4cd5-551c-4fd6-b407-2c1945781029 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.571682 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d4cd5-551c-4fd6-b407-2c1945781029 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.571873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 770/1559] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:16.573645 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13ae00-8b9c-4854-a7c3-a9c70d7d8db5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.573996 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13ae00-8b9c-4854-a7c3-a9c70d7d8db5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.574280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13ae00-8b9c-4854-a7c3-a9c70d7d8db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.576024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d4cd5-551c-4fd6-b407-2c1945781029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.593497 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cd13ae00-8b9c-4854-a7c3-a9c70d7d8db5 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:16.594312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cd13ae00-8b9c-4854-a7c3-a9c70d7d8db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:16.594997 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e69d4cd5-551c-4fd6-b407-2c1945781029 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:16.596175 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e69d4cd5-551c-4fd6-b407-2c1945781029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:16.602260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 771/1560] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:16.603118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13ae00-8b9c-4854-a7c3-a9c70d7d8db5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.608090 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 790/1561] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:16.608090 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d4cd5-551c-4fd6-b407-2c1945781029 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.613637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13ae00-8b9c-4854-a7c3-a9c70d7d8db5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.618043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d4cd5-551c-4fd6-b407-2c1945781029 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.618467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252914cc-1690-414b-997d-e17e1b71b31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.619133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252914cc-1690-414b-997d-e17e1b71b31e admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.620625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252914cc-1690-414b-997d-e17e1b71b31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.620625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252914cc-1690-414b-997d-e17e1b71b31e admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.620625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252914cc-1690-414b-997d-e17e1b71b31e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:10:16.620902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252914cc-1690-414b-997d-e17e1b71b31e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.622499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252914cc-1690-414b-997d-e17e1b71b31e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.631278 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdba63b-2a3d-4e5f-ba7d-d3e5e6538158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.632768 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdba63b-2a3d-4e5f-ba7d-d3e5e6538158 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.633059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdba63b-2a3d-4e5f-ba7d-d3e5e6538158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.633604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdba63b-2a3d-4e5f-ba7d-d3e5e6538158 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.634352 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdba63b-2a3d-4e5f-ba7d-d3e5e6538158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.642901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 772/1562] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:10:16.642901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252914cc-1690-414b-997d-e17e1b71b31e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.643217 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdba63b-2a3d-4e5f-ba7d-d3e5e6538158 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.654104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252914cc-1690-414b-997d-e17e1b71b31e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.659017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e5eb9-c590-4f64-977d-95f321dd1235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.660052 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e5eb9-c590-4f64-977d-95f321dd1235 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.660331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e5eb9-c590-4f64-977d-95f321dd1235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.660606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e5eb9-c590-4f64-977d-95f321dd1235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.661335 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e5eb9-c590-4f64-977d-95f321dd1235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.662974 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e5eb9-c590-4f64-977d-95f321dd1235 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.663835 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 791/1563] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/users => generated 297 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:16.665848 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdba63b-2a3d-4e5f-ba7d-d3e5e6538158 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.675733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdba63b-2a3d-4e5f-ba7d-d3e5e6538158 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.677568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 773/1564] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:16.678481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e5eb9-c590-4f64-977d-95f321dd1235 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.681968 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3419e9-1c58-440a-982c-3662d49bf0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.683019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3419e9-1c58-440a-982c-3662d49bf0de admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.683416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3419e9-1c58-440a-982c-3662d49bf0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.683749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3419e9-1c58-440a-982c-3662d49bf0de admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.684601 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3419e9-1c58-440a-982c-3662d49bf0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.687682 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3419e9-1c58-440a-982c-3662d49bf0de admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.688677 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e5eb9-c590-4f64-977d-95f321dd1235 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.693814 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7fd28-eba4-42f1-aead-1eda1dd54c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.694484 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7fd28-eba4-42f1-aead-1eda1dd54c31 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.694767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7fd28-eba4-42f1-aead-1eda1dd54c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.695034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7fd28-eba4-42f1-aead-1eda1dd54c31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.695801 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7fd28-eba4-42f1-aead-1eda1dd54c31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:10:16.696101 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7fd28-eba4-42f1-aead-1eda1dd54c31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.697736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7fd28-eba4-42f1-aead-1eda1dd54c31 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.710579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 774/1565] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:10:16.711897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41bce-176c-4b15-b83f-9c350943215a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.712182 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41bce-176c-4b15-b83f-9c350943215a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.712453 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41bce-176c-4b15-b83f-9c350943215a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.723290 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 792/1566] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:16.724697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3419e9-1c58-440a-982c-3662d49bf0de admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.732767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b9b41bce-176c-4b15-b83f-9c350943215a None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:16.733997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b9b41bce-176c-4b15-b83f-9c350943215a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:16.791448 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3419e9-1c58-440a-982c-3662d49bf0de admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.796048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 775/1567] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:16.800201 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b41bce-176c-4b15-b83f-9c350943215a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.801698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046acfb-b255-4739-b76a-602bd35bc386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.802378 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046acfb-b255-4739-b76a-602bd35bc386 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.802661 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046acfb-b255-4739-b76a-602bd35bc386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.802973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046acfb-b255-4739-b76a-602bd35bc386 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.803731 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046acfb-b255-4739-b76a-602bd35bc386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:10:16.804042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046acfb-b255-4739-b76a-602bd35bc386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.805655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046acfb-b255-4739-b76a-602bd35bc386 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.806398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b41bce-176c-4b15-b83f-9c350943215a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.810897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdfdbd-6736-4934-bdfe-d2559508eff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.811558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdfdbd-6736-4934-bdfe-d2559508eff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.811874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdfdbd-6736-4934-bdfe-d2559508eff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.812146 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdfdbd-6736-4934-bdfe-d2559508eff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.812866 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdfdbd-6736-4934-bdfe-d2559508eff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:10:16.813163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdfdbd-6736-4934-bdfe-d2559508eff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.814762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdfdbd-6736-4934-bdfe-d2559508eff1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.817886 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 793/1568] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:10:16.817886 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046acfb-b255-4739-b76a-602bd35bc386 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.828911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 776/1569] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:10:16.829813 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdfdbd-6736-4934-bdfe-d2559508eff1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.831144 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046acfb-b255-4739-b76a-602bd35bc386 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.835919 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eddc8-1ef7-4353-9400-18ba9c1500b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.836649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eddc8-1ef7-4353-9400-18ba9c1500b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.836936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eddc8-1ef7-4353-9400-18ba9c1500b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.837212 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eddc8-1ef7-4353-9400-18ba9c1500b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.837936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6eddc8-1ef7-4353-9400-18ba9c1500b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.840555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6eddc8-1ef7-4353-9400-18ba9c1500b7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.840977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdfdbd-6736-4934-bdfe-d2559508eff1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.845184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09616aaf-beba-4516-b755-b2d7881ade80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.845843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09616aaf-beba-4516-b755-b2d7881ade80 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.846121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09616aaf-beba-4516-b755-b2d7881ade80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.846392 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09616aaf-beba-4516-b755-b2d7881ade80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.847115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09616aaf-beba-4516-b755-b2d7881ade80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.848750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09616aaf-beba-4516-b755-b2d7881ade80 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.860898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 777/1570] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:16.861847 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09616aaf-beba-4516-b755-b2d7881ade80 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.869127 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 794/1571] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:16.869941 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eddc8-1ef7-4353-9400-18ba9c1500b7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.874659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09616aaf-beba-4516-b755-b2d7881ade80 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.934971 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eddc8-1ef7-4353-9400-18ba9c1500b7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:16.938966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922a00-401b-41b1-8647-d301e7da096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.940270 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922a00-401b-41b1-8647-d301e7da096e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.940721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922a00-401b-41b1-8647-d301e7da096e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.941003 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922a00-401b-41b1-8647-d301e7da096e admin admin] PATH_INFO: `/v3/projects/d95e2dc551c24d2aaed985cacbb3b03e/users/3ec0c45e973343259ecf037e00c12248/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.941102 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114f51b-f98a-45fa-b00b-a2f6dfd7416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:16.942881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114f51b-f98a-45fa-b00b-a2f6dfd7416b admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:16.942881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114f51b-f98a-45fa-b00b-a2f6dfd7416b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:16.942881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114f51b-f98a-45fa-b00b-a2f6dfd7416b admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:16.942881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114f51b-f98a-45fa-b00b-a2f6dfd7416b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.945169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114f51b-f98a-45fa-b00b-a2f6dfd7416b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.959674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb922a00-401b-41b1-8647-d301e7da096e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95e2dc551c24d2aaed985cacbb3b03e, user_id=3ec0c45e973343259ecf037e00c12248, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:16.962558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb922a00-401b-41b1-8647-d301e7da096e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:16.976885 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 795/1572] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:16.976885 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114f51b-f98a-45fa-b00b-a2f6dfd7416b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:16.979735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 778/1573] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:16 2022] PUT /identity/v3/projects/d95e2dc551c24d2aaed985cacbb3b03e/users/3ec0c45e973343259ecf037e00c12248/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:16.980658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922a00-401b-41b1-8647-d301e7da096e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.044470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114f51b-f98a-45fa-b00b-a2f6dfd7416b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.049629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff0d9a-0995-43e1-b1e7-73dd56e41ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.050301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff0d9a-0995-43e1-b1e7-73dd56e41ecf admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.050578 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff0d9a-0995-43e1-b1e7-73dd56e41ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.050852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff0d9a-0995-43e1-b1e7-73dd56e41ecf admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.051054 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922a00-401b-41b1-8647-d301e7da096e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.051531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff0d9a-0995-43e1-b1e7-73dd56e41ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.053498 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff0d9a-0995-43e1-b1e7-73dd56e41ecf admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.055765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3a9c8-8969-475b-b19a-3018364e41ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.056416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3a9c8-8969-475b-b19a-3018364e41ed admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.056691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3a9c8-8969-475b-b19a-3018364e41ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.056959 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3a9c8-8969-475b-b19a-3018364e41ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.058373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3a9c8-8969-475b-b19a-3018364e41ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:10:17.058678 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3a9c8-8969-475b-b19a-3018364e41ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.060310 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3a9c8-8969-475b-b19a-3018364e41ed admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.074715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 779/1574] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:10:17.074935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 796/1575] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:16 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:17.075722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff0d9a-0995-43e1-b1e7-73dd56e41ecf admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.082230 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3a9c8-8969-475b-b19a-3018364e41ed admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.088622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff0d9a-0995-43e1-b1e7-73dd56e41ecf admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.091894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3a9c8-8969-475b-b19a-3018364e41ed admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.095904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef3aac-8651-4397-9d07-60dbb6c0b299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.096571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef3aac-8651-4397-9d07-60dbb6c0b299 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.096849 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef3aac-8651-4397-9d07-60dbb6c0b299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.097122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef3aac-8651-4397-9d07-60dbb6c0b299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.097806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef3aac-8651-4397-9d07-60dbb6c0b299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.099727 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef3aac-8651-4397-9d07-60dbb6c0b299 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.100986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e818a-454f-4792-9a4d-6cc672d8088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.101689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e818a-454f-4792-9a4d-6cc672d8088b admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.101968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e818a-454f-4792-9a4d-6cc672d8088b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.102237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e818a-454f-4792-9a4d-6cc672d8088b admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.102926 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e818a-454f-4792-9a4d-6cc672d8088b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.105155 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e818a-454f-4792-9a4d-6cc672d8088b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.129802 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 797/1576] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:17 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:17.130005 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef3aac-8651-4397-9d07-60dbb6c0b299 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.139276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 780/1577] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:17 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:17.143186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e818a-454f-4792-9a4d-6cc672d8088b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.199009 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef3aac-8651-4397-9d07-60dbb6c0b299 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.208463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e818a-454f-4792-9a4d-6cc672d8088b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.213026 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eb5c8-45f8-4e4c-9bdb-eb18b0dd8917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.213747 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eb5c8-45f8-4e4c-9bdb-eb18b0dd8917 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.214021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eb5c8-45f8-4e4c-9bdb-eb18b0dd8917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.214291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eb5c8-45f8-4e4c-9bdb-eb18b0dd8917 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.214983 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eb5c8-45f8-4e4c-9bdb-eb18b0dd8917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.216035 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-337eb5c8-45f8-4e4c-9bdb-eb18b0dd8917 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 17:10:17.216035 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: warnings.warn(msg) May 17 17:10:17.216035 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: May 17 17:10:17.217238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eb5c8-45f8-4e4c-9bdb-eb18b0dd8917 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.237936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 781/1578] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:17 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:17.238752 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eb5c8-45f8-4e4c-9bdb-eb18b0dd8917 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.249622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eb5c8-45f8-4e4c-9bdb-eb18b0dd8917 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.254414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442a871-4fcf-4fec-b425-d55398def03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.255062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442a871-4fcf-4fec-b425-d55398def03e admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.255344 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442a871-4fcf-4fec-b425-d55398def03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.255626 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442a871-4fcf-4fec-b425-d55398def03e admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.256335 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442a871-4fcf-4fec-b425-d55398def03e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.258226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442a871-4fcf-4fec-b425-d55398def03e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.261688 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414424b-cfd1-40eb-af8a-30537bb06be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.262395 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414424b-cfd1-40eb-af8a-30537bb06be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.262680 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414424b-cfd1-40eb-af8a-30537bb06be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.262958 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414424b-cfd1-40eb-af8a-30537bb06be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.263719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414424b-cfd1-40eb-af8a-30537bb06be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.265344 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414424b-cfd1-40eb-af8a-30537bb06be4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.280318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 798/1579] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:17.280318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d264f-8000-43c6-89f1-b1b1f10d63b1 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.280318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d264f-8000-43c6-89f1-b1b1f10d63b1 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.280318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d264f-8000-43c6-89f1-b1b1f10d63b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.280802 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 782/1580] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:17 2022] POST /identity/v3/users => generated 283 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:17.281798 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442a871-4fcf-4fec-b425-d55398def03e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.292629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442a871-4fcf-4fec-b425-d55398def03e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.297515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d9c6f-f3f3-4c80-86f8-f122c0b72b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.298149 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9c6f-f3f3-4c80-86f8-f122c0b72b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.298425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9c6f-f3f3-4c80-86f8-f122c0b72b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.298698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9c6f-f3f3-4c80-86f8-f122c0b72b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.299415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d9c6f-f3f3-4c80-86f8-f122c0b72b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.301255 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d9c6f-f3f3-4c80-86f8-f122c0b72b6d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.311588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1f8d264f-8000-43c6-89f1-b1b1f10d63b1 None None] MFA Rules not processed for user `3ec0c45e973343259ecf037e00c12248`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:17.312890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1f8d264f-8000-43c6-89f1-b1b1f10d63b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:17.313957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 783/1581] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:17.316526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d9c6f-f3f3-4c80-86f8-f122c0b72b6d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.328331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d9c6f-f3f3-4c80-86f8-f122c0b72b6d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.334053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fdd7b-a009-42e0-af38-9688021531ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.334715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fdd7b-a009-42e0-af38-9688021531ee admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.334996 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fdd7b-a009-42e0-af38-9688021531ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.335271 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fdd7b-a009-42e0-af38-9688021531ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.336076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fdd7b-a009-42e0-af38-9688021531ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.338004 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fdd7b-a009-42e0-af38-9688021531ee admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.368385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 784/1582] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:17 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:17.369227 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fdd7b-a009-42e0-af38-9688021531ee admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.390381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 799/1583] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:17.391496 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d264f-8000-43c6-89f1-b1b1f10d63b1 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.401876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d264f-8000-43c6-89f1-b1b1f10d63b1 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.437625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fdd7b-a009-42e0-af38-9688021531ee admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.442699 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedd625-e8a4-4062-bdcd-9f712f23d046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.443344 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedd625-e8a4-4062-bdcd-9f712f23d046 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.443699 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedd625-e8a4-4062-bdcd-9f712f23d046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.444003 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedd625-e8a4-4062-bdcd-9f712f23d046 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.444699 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eedd625-e8a4-4062-bdcd-9f712f23d046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.446860 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eedd625-e8a4-4062-bdcd-9f712f23d046 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.465040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d0c7e-05ba-45e1-8913-91ede9ff07aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.465722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d0c7e-05ba-45e1-8913-91ede9ff07aa admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.465997 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d0c7e-05ba-45e1-8913-91ede9ff07aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.466268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d0c7e-05ba-45e1-8913-91ede9ff07aa admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.466975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d0c7e-05ba-45e1-8913-91ede9ff07aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.469047 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d0c7e-05ba-45e1-8913-91ede9ff07aa admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.470373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 785/1584] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:17 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:17.471366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedd625-e8a4-4062-bdcd-9f712f23d046 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.483642 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedd625-e8a4-4062-bdcd-9f712f23d046 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.488506 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bdc4d-8aca-43fa-8ced-a396bfc9856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.489177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bdc4d-8aca-43fa-8ced-a396bfc9856f admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.489455 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bdc4d-8aca-43fa-8ced-a396bfc9856f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.489737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bdc4d-8aca-43fa-8ced-a396bfc9856f admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.490564 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bdc4d-8aca-43fa-8ced-a396bfc9856f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.491144 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 800/1585] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:17 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:17.492469 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bdc4d-8aca-43fa-8ced-a396bfc9856f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.495502 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d0c7e-05ba-45e1-8913-91ede9ff07aa admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.505047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 786/1586] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:17.505746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d0c7e-05ba-45e1-8913-91ede9ff07aa admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.506499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bdc4d-8aca-43fa-8ced-a396bfc9856f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.512424 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0c47f-01b1-4299-8431-2433d0f8a5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.513334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0c47f-01b1-4299-8431-2433d0f8a5df admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.513614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0c47f-01b1-4299-8431-2433d0f8a5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.513891 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0c47f-01b1-4299-8431-2433d0f8a5df admin admin] PATH_INFO: `/v3/projects/ea3305a913c541e4a45267497213df1c/users/824915e26a724d938e5dd0a3c1f57932/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.518168 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bdc4d-8aca-43fa-8ced-a396bfc9856f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.523398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab33076-111e-4280-b4eb-fa0c4a9825ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.524113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab33076-111e-4280-b4eb-fa0c4a9825ac admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.524395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab33076-111e-4280-b4eb-fa0c4a9825ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.524671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab33076-111e-4280-b4eb-fa0c4a9825ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.525399 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab33076-111e-4280-b4eb-fa0c4a9825ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.527111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab33076-111e-4280-b4eb-fa0c4a9825ac admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.530618 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0c47f-01b1-4299-8431-2433d0f8a5df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3305a913c541e4a45267497213df1c, user_id=824915e26a724d938e5dd0a3c1f57932, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.532158 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: WARNING py.warnings [None req-37b0c47f-01b1-4299-8431-2433d0f8a5df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 17:10:17.532158 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: warnings.warn(msg) May 17 17:10:17.532158 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: May 17 17:10:17.534169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0c47f-01b1-4299-8431-2433d0f8a5df admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.537849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 787/1587] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:17.538856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab33076-111e-4280-b4eb-fa0c4a9825ac admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.554120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 801/1588] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:17 2022] PUT /identity/v3/projects/ea3305a913c541e4a45267497213df1c/users/824915e26a724d938e5dd0a3c1f57932/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:17.554329 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab33076-111e-4280-b4eb-fa0c4a9825ac admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.554443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0c47f-01b1-4299-8431-2433d0f8a5df admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.608452 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee088bc1-2c63-44b2-b71c-9acd2d771f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.609121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee088bc1-2c63-44b2-b71c-9acd2d771f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.609392 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee088bc1-2c63-44b2-b71c-9acd2d771f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.609676 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee088bc1-2c63-44b2-b71c-9acd2d771f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.610379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee088bc1-2c63-44b2-b71c-9acd2d771f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.612003 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee088bc1-2c63-44b2-b71c-9acd2d771f94 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.613505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0c47f-01b1-4299-8431-2433d0f8a5df admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.619283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3b65a-4579-4c2a-acc1-c0801cc140ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.620539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3b65a-4579-4c2a-acc1-c0801cc140ea admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.620815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3b65a-4579-4c2a-acc1-c0801cc140ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.621092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3b65a-4579-4c2a-acc1-c0801cc140ea admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.621783 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3b65a-4579-4c2a-acc1-c0801cc140ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.622410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 788/1589] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:17.623213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee088bc1-2c63-44b2-b71c-9acd2d771f94 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.623758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3b65a-4579-4c2a-acc1-c0801cc140ea admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.633105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee088bc1-2c63-44b2-b71c-9acd2d771f94 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.639399 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17554ca1-4e5d-49f9-ba36-e12f1b580227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.640105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17554ca1-4e5d-49f9-ba36-e12f1b580227 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.640385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17554ca1-4e5d-49f9-ba36-e12f1b580227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.640660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17554ca1-4e5d-49f9-ba36-e12f1b580227 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.641365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17554ca1-4e5d-49f9-ba36-e12f1b580227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.643325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17554ca1-4e5d-49f9-ba36-e12f1b580227 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.647996 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 802/1590] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:17 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:17.648909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3b65a-4579-4c2a-acc1-c0801cc140ea admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.659079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3b65a-4579-4c2a-acc1-c0801cc140ea admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.664216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f7c9c-74d0-4620-8fb9-bc87b4919053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.665073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f7c9c-74d0-4620-8fb9-bc87b4919053 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.665617 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f7c9c-74d0-4620-8fb9-bc87b4919053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.665892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f7c9c-74d0-4620-8fb9-bc87b4919053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.667155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f7c9c-74d0-4620-8fb9-bc87b4919053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.670423 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f7c9c-74d0-4620-8fb9-bc87b4919053 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.673460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 789/1591] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:17 2022] POST /identity/v3/projects => generated 407 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:17.674316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17554ca1-4e5d-49f9-ba36-e12f1b580227 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.679292 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 803/1592] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:17.680496 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f7c9c-74d0-4620-8fb9-bc87b4919053 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.691533 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f7c9c-74d0-4620-8fb9-bc87b4919053 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.739729 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17554ca1-4e5d-49f9-ba36-e12f1b580227 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.745776 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67832795-da00-452b-a24a-65de122a86d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.746456 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67832795-da00-452b-a24a-65de122a86d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.746724 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67832795-da00-452b-a24a-65de122a86d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.746989 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67832795-da00-452b-a24a-65de122a86d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.747741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67832795-da00-452b-a24a-65de122a86d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.749347 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67832795-da00-452b-a24a-65de122a86d7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.754808 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d015f7-8e74-4b91-af80-273092fe9b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.755471 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d015f7-8e74-4b91-af80-273092fe9b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.755789 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d015f7-8e74-4b91-af80-273092fe9b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.756060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d015f7-8e74-4b91-af80-273092fe9b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.756778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d015f7-8e74-4b91-af80-273092fe9b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.758374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d015f7-8e74-4b91-af80-273092fe9b4f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.761625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 790/1593] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:17.761625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67832795-da00-452b-a24a-65de122a86d7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.770040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 804/1594] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:17.771337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b068eb5-11d8-44bb-9664-879b67a15643 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.771642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b068eb5-11d8-44bb-9664-879b67a15643 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.772527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b068eb5-11d8-44bb-9664-879b67a15643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.773414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67832795-da00-452b-a24a-65de122a86d7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.778809 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c870806-45a0-4946-97b2-1978dd0f79a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.779479 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c870806-45a0-4946-97b2-1978dd0f79a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.779792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c870806-45a0-4946-97b2-1978dd0f79a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.780071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c870806-45a0-4946-97b2-1978dd0f79a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.780800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c870806-45a0-4946-97b2-1978dd0f79a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.782453 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c870806-45a0-4946-97b2-1978dd0f79a3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.792831 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6b068eb5-11d8-44bb-9664-879b67a15643 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:17.795511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 791/1595] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:17.795683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6b068eb5-11d8-44bb-9664-879b67a15643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:17.795788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c870806-45a0-4946-97b2-1978dd0f79a3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.801908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 805/1596] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:17.802719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b068eb5-11d8-44bb-9664-879b67a15643 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.806673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c870806-45a0-4946-97b2-1978dd0f79a3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.812238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef220ca-93b3-42bd-b1b8-39e5d8080695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.812421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b068eb5-11d8-44bb-9664-879b67a15643 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.813137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef220ca-93b3-42bd-b1b8-39e5d8080695 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.813416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef220ca-93b3-42bd-b1b8-39e5d8080695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.813691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef220ca-93b3-42bd-b1b8-39e5d8080695 admin admin] PATH_INFO: `/v3/projects/b4111fd040fc4a4d823b5e38204286f7/users/58e161159bbc4339b6ac52213cc7b7d1/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.816962 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec3d2-0c8f-4c1c-8dbe-3ccceca099ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.817622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec3d2-0c8f-4c1c-8dbe-3ccceca099ba admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.817899 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec3d2-0c8f-4c1c-8dbe-3ccceca099ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.818173 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec3d2-0c8f-4c1c-8dbe-3ccceca099ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.818897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ec3d2-0c8f-4c1c-8dbe-3ccceca099ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.821116 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ec3d2-0c8f-4c1c-8dbe-3ccceca099ba admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.830820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef220ca-93b3-42bd-b1b8-39e5d8080695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4111fd040fc4a4d823b5e38204286f7, user_id=58e161159bbc4339b6ac52213cc7b7d1, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.831034 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 806/1597] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:17.831543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec3d2-0c8f-4c1c-8dbe-3ccceca099ba admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.832851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef220ca-93b3-42bd-b1b8-39e5d8080695 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.843646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec3d2-0c8f-4c1c-8dbe-3ccceca099ba admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.849396 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 792/1598] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:17 2022] PUT /identity/v3/projects/b4111fd040fc4a4d823b5e38204286f7/users/58e161159bbc4339b6ac52213cc7b7d1/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:17.850360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef220ca-93b3-42bd-b1b8-39e5d8080695 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.906925 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27531f-5866-4c1b-9bac-1e5a16eab0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.907628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27531f-5866-4c1b-9bac-1e5a16eab0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.907912 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27531f-5866-4c1b-9bac-1e5a16eab0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.908207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27531f-5866-4c1b-9bac-1e5a16eab0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.909651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27531f-5866-4c1b-9bac-1e5a16eab0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.910810 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27531f-5866-4c1b-9bac-1e5a16eab0e0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.929205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef220ca-93b3-42bd-b1b8-39e5d8080695 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.933838 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6f71-0c91-4391-891e-f5026a5faad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.934513 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6f71-0c91-4391-891e-f5026a5faad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.934795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6f71-0c91-4391-891e-f5026a5faad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.935072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6f71-0c91-4391-891e-f5026a5faad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.935823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6f71-0c91-4391-891e-f5026a5faad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.937431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6f71-0c91-4391-891e-f5026a5faad2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.940965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 807/1599] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:17 2022] POST /identity/v3/users => generated 310 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:17.940965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27531f-5866-4c1b-9bac-1e5a16eab0e0 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.948356 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27531f-5866-4c1b-9bac-1e5a16eab0e0 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.951649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 793/1600] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:17.951799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6f71-0c91-4391-891e-f5026a5faad2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.956413 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7659f59-8964-49a6-b447-dffbb575b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.957091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7659f59-8964-49a6-b447-dffbb575b1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.957399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7659f59-8964-49a6-b447-dffbb575b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.957674 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7659f59-8964-49a6-b447-dffbb575b1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.958405 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7659f59-8964-49a6-b447-dffbb575b1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.960050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7659f59-8964-49a6-b447-dffbb575b1c7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.961633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6f71-0c91-4391-891e-f5026a5faad2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.966868 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6648ed7-c7be-4279-ad5c-5f62c16078ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.967795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6648ed7-c7be-4279-ad5c-5f62c16078ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.968091 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6648ed7-c7be-4279-ad5c-5f62c16078ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.968346 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6648ed7-c7be-4279-ad5c-5f62c16078ea admin admin] PATH_INFO: `/v3/projects/9d587d1ef11b4055b77055e6fbcc1899/users/86a0b6c88fe84ba0907d515fd9f38e72/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:17.974891 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 808/1601] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:17.975821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7659f59-8964-49a6-b447-dffbb575b1c7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:17.985230 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6648ed7-c7be-4279-ad5c-5f62c16078ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d587d1ef11b4055b77055e6fbcc1899, user_id=86a0b6c88fe84ba0907d515fd9f38e72, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:17.986851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7659f59-8964-49a6-b447-dffbb575b1c7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:17.987953 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6648ed7-c7be-4279-ad5c-5f62c16078ea admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:17.992246 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef885703-7bf7-4305-85bd-7b34196b33de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:17.993214 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef885703-7bf7-4305-85bd-7b34196b33de admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:17.993499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef885703-7bf7-4305-85bd-7b34196b33de admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:17.993805 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef885703-7bf7-4305-85bd-7b34196b33de admin admin] PATH_INFO: `/v3/projects/e8cb5cc818724793a5634e8f8dad0753/users/d8ea8199d8204ad5be806d3000f36efc/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.004561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 794/1602] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:17 2022] PUT /identity/v3/projects/9d587d1ef11b4055b77055e6fbcc1899/users/86a0b6c88fe84ba0907d515fd9f38e72/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:18.008820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6648ed7-c7be-4279-ad5c-5f62c16078ea admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:18.011013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef885703-7bf7-4305-85bd-7b34196b33de admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cb5cc818724793a5634e8f8dad0753, user_id=d8ea8199d8204ad5be806d3000f36efc, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.013813 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef885703-7bf7-4305-85bd-7b34196b33de admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:18.029215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 809/1603] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:17 2022] PUT /identity/v3/projects/e8cb5cc818724793a5634e8f8dad0753/users/d8ea8199d8204ad5be806d3000f36efc/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:18.030045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef885703-7bf7-4305-85bd-7b34196b33de admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:18.065463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6648ed7-c7be-4279-ad5c-5f62c16078ea admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:18.103157 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef885703-7bf7-4305-85bd-7b34196b33de admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:18.108839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd777a-61ff-467f-bc02-1f5445287858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:18.109503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd777a-61ff-467f-bc02-1f5445287858 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.109784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd777a-61ff-467f-bc02-1f5445287858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.110054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd777a-61ff-467f-bc02-1f5445287858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.110768 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd777a-61ff-467f-bc02-1f5445287858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.112395 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd777a-61ff-467f-bc02-1f5445287858 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:18.117236 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d868334-a65b-45c4-a0f1-266355ceb761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:18.117903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d868334-a65b-45c4-a0f1-266355ceb761 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.118179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d868334-a65b-45c4-a0f1-266355ceb761 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.118448 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d868334-a65b-45c4-a0f1-266355ceb761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.122095 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 810/1604] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:18.124179 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577abec-54c1-4e07-bd51-de19f44bb30b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.124672 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577abec-54c1-4e07-bd51-de19f44bb30b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.125109 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577abec-54c1-4e07-bd51-de19f44bb30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.127957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d868334-a65b-45c4-a0f1-266355ceb761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.129396 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d868334-a65b-45c4-a0f1-266355ceb761 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:18.143887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 795/1605] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:18.144267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2577abec-54c1-4e07-bd51-de19f44bb30b None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:18.145047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d868334-a65b-45c4-a0f1-266355ceb761 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:18.145497 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2577abec-54c1-4e07-bd51-de19f44bb30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:18.154099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 811/1606] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:18.154756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577abec-54c1-4e07-bd51-de19f44bb30b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:18.157487 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d868334-a65b-45c4-a0f1-266355ceb761 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:18.162973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c3a76-cb4e-4226-931f-b70d522c0f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:18.163790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c3a76-cb4e-4226-931f-b70d522c0f40 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.164152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c3a76-cb4e-4226-931f-b70d522c0f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.164331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577abec-54c1-4e07-bd51-de19f44bb30b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:18.164582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c3a76-cb4e-4226-931f-b70d522c0f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.165980 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c3a76-cb4e-4226-931f-b70d522c0f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.168795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c3a76-cb4e-4226-931f-b70d522c0f40 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:18.171587 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae7178-2c52-4934-bdb9-7d505bd0a7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:18.172434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae7178-2c52-4934-bdb9-7d505bd0a7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.172751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae7178-2c52-4934-bdb9-7d505bd0a7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.173049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae7178-2c52-4934-bdb9-7d505bd0a7b2 admin admin] PATH_INFO: `/v3/projects/87f2aabc0cda49538fa0fd9d5db6bf51/users/74cc0ddf89664a6f92c84ebb9e1ab3a2/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.186038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 796/1607] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:18.186038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c3a76-cb4e-4226-931f-b70d522c0f40 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:18.194983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae7178-2c52-4934-bdb9-7d505bd0a7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f2aabc0cda49538fa0fd9d5db6bf51, user_id=74cc0ddf89664a6f92c84ebb9e1ab3a2, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.197805 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae7178-2c52-4934-bdb9-7d505bd0a7b2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:18.197980 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c3a76-cb4e-4226-931f-b70d522c0f40 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:18.203540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774be05b-0879-4b3b-86f0-a06f2ced3f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:18.204542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774be05b-0879-4b3b-86f0-a06f2ced3f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.204861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774be05b-0879-4b3b-86f0-a06f2ced3f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.205176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774be05b-0879-4b3b-86f0-a06f2ced3f9e admin admin] PATH_INFO: `/v3/projects/db7972884e6b4df686b005676e6d1b7c/users/611d81db704b4f0ebc1fa0414d061925/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.213908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 812/1608] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:18 2022] PUT /identity/v3/projects/87f2aabc0cda49538fa0fd9d5db6bf51/users/74cc0ddf89664a6f92c84ebb9e1ab3a2/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:18.216307 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232a8ab-190e-40dd-bdb5-b458e9d015fe None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.216793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232a8ab-190e-40dd-bdb5-b458e9d015fe None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.217253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232a8ab-190e-40dd-bdb5-b458e9d015fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.226370 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774be05b-0879-4b3b-86f0-a06f2ced3f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7972884e6b4df686b005676e6d1b7c, user_id=611d81db704b4f0ebc1fa0414d061925, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.230409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774be05b-0879-4b3b-86f0-a06f2ced3f9e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:18.238089 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a232a8ab-190e-40dd-bdb5-b458e9d015fe None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:18.239343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a232a8ab-190e-40dd-bdb5-b458e9d015fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:18.245898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 797/1609] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:18 2022] PUT /identity/v3/projects/db7972884e6b4df686b005676e6d1b7c/users/611d81db704b4f0ebc1fa0414d061925/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:18.247993 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665ad6d-91f2-4acc-995f-9d69001c07c5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.248457 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665ad6d-91f2-4acc-995f-9d69001c07c5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.248735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665ad6d-91f2-4acc-995f-9d69001c07c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.281368 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3665ad6d-91f2-4acc-995f-9d69001c07c5 None None] MFA Rules not processed for user `d8ea8199d8204ad5be806d3000f36efc`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:18.282755 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3665ad6d-91f2-4acc-995f-9d69001c07c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:18.331154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 813/1610] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:18.332122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232a8ab-190e-40dd-bdb5-b458e9d015fe None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:18.343341 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232a8ab-190e-40dd-bdb5-b458e9d015fe None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:18.353166 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d64bc7-47ff-4c15-b9f4-c3a87ea976d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:18.354103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d64bc7-47ff-4c15-b9f4-c3a87ea976d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.354588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d64bc7-47ff-4c15-b9f4-c3a87ea976d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.355275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d64bc7-47ff-4c15-b9f4-c3a87ea976d4 admin admin] PATH_INFO: `/v3/projects/f45b7384a3f142bd9295c38565e6372d/users/73b78355cbcb43cfabd8759cba0816bc/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.371350 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d64bc7-47ff-4c15-b9f4-c3a87ea976d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45b7384a3f142bd9295c38565e6372d, user_id=73b78355cbcb43cfabd8759cba0816bc, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.374258 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d64bc7-47ff-4c15-b9f4-c3a87ea976d4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:18.377035 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 798/1611] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:18.377683 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665ad6d-91f2-4acc-995f-9d69001c07c5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:18.379042 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3665ad6d-91f2-4acc-995f-9d69001c07c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:18.393349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 814/1612] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:18 2022] PUT /identity/v3/projects/f45b7384a3f142bd9295c38565e6372d/users/73b78355cbcb43cfabd8759cba0816bc/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:18.404013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d64bc7-47ff-4c15-b9f4-c3a87ea976d4 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:18.449998 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665ad6d-91f2-4acc-995f-9d69001c07c5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:18.473857 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d64bc7-47ff-4c15-b9f4-c3a87ea976d4 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:18.479716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72f71c-38ec-488c-a2e9-e5ca7f05975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:18.480758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72f71c-38ec-488c-a2e9-e5ca7f05975e admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.481142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72f71c-38ec-488c-a2e9-e5ca7f05975e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.481515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72f71c-38ec-488c-a2e9-e5ca7f05975e admin admin] PATH_INFO: `/v3/projects/1cdbe86a9b19464daf091f9e5001bc1b/users/6423fc767fdf40b5878b1ce70688fd0e/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.497929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72f71c-38ec-488c-a2e9-e5ca7f05975e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cdbe86a9b19464daf091f9e5001bc1b, user_id=6423fc767fdf40b5878b1ce70688fd0e, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.501107 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72f71c-38ec-488c-a2e9-e5ca7f05975e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:18.517972 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 815/1613] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:18 2022] PUT /identity/v3/projects/1cdbe86a9b19464daf091f9e5001bc1b/users/6423fc767fdf40b5878b1ce70688fd0e/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:18.519461 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbf7e0-3d7a-49c2-9104-31134d22557c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.519955 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbf7e0-3d7a-49c2-9104-31134d22557c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.520330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbf7e0-3d7a-49c2-9104-31134d22557c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.546238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a433643-c9be-47be-8739-17b5ea27acb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:18.546649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5bcbf7e0-3d7a-49c2-9104-31134d22557c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:18.547189 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a433643-c9be-47be-8739-17b5ea27acb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.547567 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a433643-c9be-47be-8739-17b5ea27acb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.547916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5bcbf7e0-3d7a-49c2-9104-31134d22557c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:18.548048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a433643-c9be-47be-8739-17b5ea27acb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.559816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a433643-c9be-47be-8739-17b5ea27acb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.562235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a433643-c9be-47be-8739-17b5ea27acb3 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:18.579839 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 799/1614] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:18.581488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e8170-c8a3-4bee-9271-dad6049e7de7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.582284 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e8170-c8a3-4bee-9271-dad6049e7de7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.582754 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e8170-c8a3-4bee-9271-dad6049e7de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.621949 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-120e8170-c8a3-4bee-9271-dad6049e7de7 None None] MFA Rules not processed for user `611d81db704b4f0ebc1fa0414d061925`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:18.623384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-120e8170-c8a3-4bee-9271-dad6049e7de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:18.630657 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 816/1615] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:18.630657 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbf7e0-3d7a-49c2-9104-31134d22557c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:18.713359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbf7e0-3d7a-49c2-9104-31134d22557c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:18.717897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32149858-d37a-41fd-a1ed-48df97a28097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:18.718605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32149858-d37a-41fd-a1ed-48df97a28097 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.718893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32149858-d37a-41fd-a1ed-48df97a28097 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.719168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32149858-d37a-41fd-a1ed-48df97a28097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.728332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 800/1616] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:18.728332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e8170-c8a3-4bee-9271-dad6049e7de7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:18.737120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32149858-d37a-41fd-a1ed-48df97a28097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.739034 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32149858-d37a-41fd-a1ed-48df97a28097 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:18.750484 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e8170-c8a3-4bee-9271-dad6049e7de7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:18.752406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 817/1617] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:18.753652 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241bd14-6510-4f58-8a02-7e06994777b5 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.754005 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241bd14-6510-4f58-8a02-7e06994777b5 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.754463 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241bd14-6510-4f58-8a02-7e06994777b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.756617 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6b3f7-3098-4056-b935-f6c953bbeeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:18.757971 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6b3f7-3098-4056-b935-f6c953bbeeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.758452 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6b3f7-3098-4056-b935-f6c953bbeeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.758871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6b3f7-3098-4056-b935-f6c953bbeeb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.759918 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6b3f7-3098-4056-b935-f6c953bbeeb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.762631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6b3f7-3098-4056-b935-f6c953bbeeb8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:18.783917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b241bd14-6510-4f58-8a02-7e06994777b5 None None] MFA Rules not processed for user `73b78355cbcb43cfabd8759cba0816bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:18.785117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b241bd14-6510-4f58-8a02-7e06994777b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:18.801354 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 801/1618] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:18 2022] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:18.802659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6b3f7-3098-4056-b935-f6c953bbeeb8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:18.863632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 818/1619] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:18.864623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241bd14-6510-4f58-8a02-7e06994777b5 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:18.877073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241bd14-6510-4f58-8a02-7e06994777b5 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:18.877294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6b3f7-3098-4056-b935-f6c953bbeeb8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:18.883071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd0b77-2600-4dd2-a62a-bc9e29feea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:18.883803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd0b77-2600-4dd2-a62a-bc9e29feea41 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.884085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd0b77-2600-4dd2-a62a-bc9e29feea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.884360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd0b77-2600-4dd2-a62a-bc9e29feea41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.885100 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd0b77-2600-4dd2-a62a-bc9e29feea41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.887260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd0b77-2600-4dd2-a62a-bc9e29feea41 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:18.899768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 802/1620] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:18.899768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d55e-b990-497e-8c6d-0800f8d0d1c6 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.899768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d55e-b990-497e-8c6d-0800f8d0d1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.900092 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d55e-b990-497e-8c6d-0800f8d0d1c6 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.906315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 803/1621] 10.222.0.48 () {54 vars in 961 bytes} [Tue May 17 17:10:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:10:18.907256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0d55e-b990-497e-8c6d-0800f8d0d1c6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:18.921401 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0d55e-b990-497e-8c6d-0800f8d0d1c6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:18.927382 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cfe34-c52d-461c-bee7-660b98e2d2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:18.928125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cfe34-c52d-461c-bee7-660b98e2d2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.928620 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cfe34-c52d-461c-bee7-660b98e2d2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.928732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cfe34-c52d-461c-bee7-660b98e2d2b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.929501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cfe34-c52d-461c-bee7-660b98e2d2b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.931449 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cfe34-c52d-461c-bee7-660b98e2d2b7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:18.932062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd528a1e-348c-4b00-828a-96501c5e2217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:18.932932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd528a1e-348c-4b00-828a-96501c5e2217 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.933268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd528a1e-348c-4b00-828a-96501c5e2217 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.933802 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd528a1e-348c-4b00-828a-96501c5e2217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.944337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd528a1e-348c-4b00-828a-96501c5e2217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.945909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd528a1e-348c-4b00-828a-96501c5e2217 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:18.958498 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 819/1622] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:18.958975 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 804/1623] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:18 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:18.960294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cfe34-c52d-461c-bee7-660b98e2d2b7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:18.965572 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd528a1e-348c-4b00-828a-96501c5e2217 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:18.972489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cfe34-c52d-461c-bee7-660b98e2d2b7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:18.978232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16ac36-b878-4236-9190-873ab949fd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:18.978617 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd528a1e-348c-4b00-828a-96501c5e2217 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:18.980002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16ac36-b878-4236-9190-873ab949fd83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.980561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16ac36-b878-4236-9190-873ab949fd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.980928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16ac36-b878-4236-9190-873ab949fd83 admin admin] PATH_INFO: `/v3/projects/1cdbe86a9b19464daf091f9e5001bc1b/users/6423fc767fdf40b5878b1ce70688fd0e/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.983908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16ac36-b878-4236-9190-873ab949fd83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cdbe86a9b19464daf091f9e5001bc1b, user_id=6423fc767fdf40b5878b1ce70688fd0e, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.988298 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16ac36-b878-4236-9190-873ab949fd83 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:18.988523 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8fc23-145e-487e-a7ff-b842a9561c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:18.989620 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8fc23-145e-487e-a7ff-b842a9561c0b admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:18.989950 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8fc23-145e-487e-a7ff-b842a9561c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:18.990287 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8fc23-145e-487e-a7ff-b842a9561c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:18.991784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8fc23-145e-487e-a7ff-b842a9561c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:18.996201 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8fc23-145e-487e-a7ff-b842a9561c0b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:19.004067 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 805/1624] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:18 2022] PUT /identity/v3/projects/1cdbe86a9b19464daf091f9e5001bc1b/users/6423fc767fdf40b5878b1ce70688fd0e/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:19.014462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b8a83-6967-4a7e-a2f1-e049ea013924 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:19.014462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b8a83-6967-4a7e-a2f1-e049ea013924 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:19.014462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b8a83-6967-4a7e-a2f1-e049ea013924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:19.035433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c13b8a83-6967-4a7e-a2f1-e049ea013924 None None] MFA Rules not processed for user `5becb135afbd43e9bc0b1347ba04e2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:19.035689 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 820/1625] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:18 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:19.035689 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8fc23-145e-487e-a7ff-b842a9561c0b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:19.035892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c13b8a83-6967-4a7e-a2f1-e049ea013924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:19.126810 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8fc23-145e-487e-a7ff-b842a9561c0b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:19.142945 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff42293-ceb6-4f98-bb5f-85322faff663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:19.143910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff42293-ceb6-4f98-bb5f-85322faff663 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:19.144404 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff42293-ceb6-4f98-bb5f-85322faff663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:19.144924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff42293-ceb6-4f98-bb5f-85322faff663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:19.145330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 806/1626] 10.222.0.48 () {58 vars in 1058 bytes} [Tue May 17 17:10:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:19.146060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff42293-ceb6-4f98-bb5f-85322faff663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:19.147425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d665d6-1a76-4a33-b731-110c73c7b7c2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:19.147759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d665d6-1a76-4a33-b731-110c73c7b7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:19.148113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d665d6-1a76-4a33-b731-110c73c7b7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:19.149080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff42293-ceb6-4f98-bb5f-85322faff663 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:19.169688 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 821/1627] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:19.169688 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff42293-ceb6-4f98-bb5f-85322faff663 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:19.183115 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff42293-ceb6-4f98-bb5f-85322faff663 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:19.192028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3140065-d337-46ef-9e61-629744cd5038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:19.193316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3140065-d337-46ef-9e61-629744cd5038 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:19.193830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3140065-d337-46ef-9e61-629744cd5038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:19.194335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3140065-d337-46ef-9e61-629744cd5038 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:19.195347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3140065-d337-46ef-9e61-629744cd5038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:19.198557 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3140065-d337-46ef-9e61-629744cd5038 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:19.202756 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c9d665d6-1a76-4a33-b731-110c73c7b7c2 None None] MFA Rules not processed for user `6423fc767fdf40b5878b1ce70688fd0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:19.204511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c9d665d6-1a76-4a33-b731-110c73c7b7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:19.239152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 822/1628] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:19 2022] POST /identity/v3/users => generated 293 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:19.241388 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3140065-d337-46ef-9e61-629744cd5038 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:19.276182 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3140065-d337-46ef-9e61-629744cd5038 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:19.290902 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6d708-ae2d-43a8-92fa-57d8f6fd6de5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:19.293633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6d708-ae2d-43a8-92fa-57d8f6fd6de5 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:19.293633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6d708-ae2d-43a8-92fa-57d8f6fd6de5 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:19.293633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6d708-ae2d-43a8-92fa-57d8f6fd6de5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:19.360783 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 807/1629] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:19 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:19.361805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d665d6-1a76-4a33-b731-110c73c7b7c2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:19.389047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d665d6-1a76-4a33-b731-110c73c7b7c2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:19.397954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09264be-a3bd-49b5-82df-68d67d034868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:19.399483 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09264be-a3bd-49b5-82df-68d67d034868 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:19.399682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09264be-a3bd-49b5-82df-68d67d034868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:19.400063 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09264be-a3bd-49b5-82df-68d67d034868 admin admin] PATH_INFO: `/v3/projects/6e98dfc1ed2a47a988d3fc5b1db0728d/users/a9c62b7e0faa46ecaf78356c20676a4b/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:19.423737 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6d708-ae2d-43a8-92fa-57d8f6fd6de5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:19.432669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6d708-ae2d-43a8-92fa-57d8f6fd6de5 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:19.462705 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 823/1630] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:19.464435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6d708-ae2d-43a8-92fa-57d8f6fd6de5 service nova] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:19.492600 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09264be-a3bd-49b5-82df-68d67d034868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e98dfc1ed2a47a988d3fc5b1db0728d, user_id=a9c62b7e0faa46ecaf78356c20676a4b, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:19.496945 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6d708-ae2d-43a8-92fa-57d8f6fd6de5 service nova] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:19.508873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09264be-a3bd-49b5-82df-68d67d034868 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:19.510370 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323c27a-75d9-4813-b943-900d5a52189e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:19.513629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c27a-75d9-4813-b943-900d5a52189e admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:19.513921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c27a-75d9-4813-b943-900d5a52189e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:19.514589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c27a-75d9-4813-b943-900d5a52189e admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:19.517915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323c27a-75d9-4813-b943-900d5a52189e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:19.523392 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323c27a-75d9-4813-b943-900d5a52189e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:19.551668 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 808/1631] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:19 2022] PUT /identity/v3/projects/6e98dfc1ed2a47a988d3fc5b1db0728d/users/a9c62b7e0faa46ecaf78356c20676a4b/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:19.553483 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09264be-a3bd-49b5-82df-68d67d034868 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:19.565180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 824/1632] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:19.568226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323c27a-75d9-4813-b943-900d5a52189e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:19.596162 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323c27a-75d9-4813-b943-900d5a52189e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:19.747462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09264be-a3bd-49b5-82df-68d67d034868 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:19.752291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248e6fa-6a1f-4593-abb4-826792cd030d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:19.753112 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248e6fa-6a1f-4593-abb4-826792cd030d service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:19.753434 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248e6fa-6a1f-4593-abb4-826792cd030d service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:19.753790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248e6fa-6a1f-4593-abb4-826792cd030d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:19.777560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c465d-b2f7-4969-97b6-acc038ae978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:19.778448 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c465d-b2f7-4969-97b6-acc038ae978b admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:19.778736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c465d-b2f7-4969-97b6-acc038ae978b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:19.779457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c465d-b2f7-4969-97b6-acc038ae978b admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:19.786406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c465d-b2f7-4969-97b6-acc038ae978b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:19.790063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c465d-b2f7-4969-97b6-acc038ae978b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:19.820487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 825/1633] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:19.825353 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c465d-b2f7-4969-97b6-acc038ae978b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:19.852178 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c465d-b2f7-4969-97b6-acc038ae978b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:19.870661 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e990f69-47f4-4514-8b15-ec43e7bc2720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:19.871583 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e990f69-47f4-4514-8b15-ec43e7bc2720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:19.872054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e990f69-47f4-4514-8b15-ec43e7bc2720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:19.872369 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e990f69-47f4-4514-8b15-ec43e7bc2720 admin admin] PATH_INFO: `/v3/projects/7425b81a3c6f4634a5246e84d8b57004/users/a22350b11bcb4bce81c91adb0c2532fe/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:19.906833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e990f69-47f4-4514-8b15-ec43e7bc2720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7425b81a3c6f4634a5246e84d8b57004, user_id=a22350b11bcb4bce81c91adb0c2532fe, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:19.911479 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e990f69-47f4-4514-8b15-ec43e7bc2720 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:19.941044 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 826/1634] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:19 2022] PUT /identity/v3/projects/7425b81a3c6f4634a5246e84d8b57004/users/a22350b11bcb4bce81c91adb0c2532fe/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:19.942619 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e990f69-47f4-4514-8b15-ec43e7bc2720 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:19.959962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248e6fa-6a1f-4593-abb4-826792cd030d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:19.961443 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248e6fa-6a1f-4593-abb4-826792cd030d service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:19.994555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 809/1635] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:19 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:19.999247 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248e6fa-6a1f-4593-abb4-826792cd030d service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:20.027754 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248e6fa-6a1f-4593-abb4-826792cd030d service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:20.144503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e990f69-47f4-4514-8b15-ec43e7bc2720 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:20.151617 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b80042-e73e-4402-89d1-f3c8edcbfb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:20.151617 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b80042-e73e-4402-89d1-f3c8edcbfb06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:20.151617 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b80042-e73e-4402-89d1-f3c8edcbfb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:20.154085 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b80042-e73e-4402-89d1-f3c8edcbfb06 admin admin] PATH_INFO: `/v3/projects/6e98dfc1ed2a47a988d3fc5b1db0728d/users/a9c62b7e0faa46ecaf78356c20676a4b/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:20.156230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b80042-e73e-4402-89d1-f3c8edcbfb06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e98dfc1ed2a47a988d3fc5b1db0728d, user_id=a9c62b7e0faa46ecaf78356c20676a4b, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:20.157639 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf52636-1b36-44db-9fae-a1cd30f69552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:20.160034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf52636-1b36-44db-9fae-a1cd30f69552 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:20.162313 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b80042-e73e-4402-89d1-f3c8edcbfb06 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:20.162547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf52636-1b36-44db-9fae-a1cd30f69552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:20.162547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf52636-1b36-44db-9fae-a1cd30f69552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:20.162547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf52636-1b36-44db-9fae-a1cd30f69552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:20.164768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf52636-1b36-44db-9fae-a1cd30f69552 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:20.192621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 827/1636] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:19 2022] PUT /identity/v3/projects/6e98dfc1ed2a47a988d3fc5b1db0728d/users/a9c62b7e0faa46ecaf78356c20676a4b/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:20.193741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 810/1637] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:20.196033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd6da2-3c61-4a98-b23e-d0fca951ce26 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:20.196342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd6da2-3c61-4a98-b23e-d0fca951ce26 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:20.196591 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd6da2-3c61-4a98-b23e-d0fca951ce26 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:20.198900 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 828/1638] 10.222.0.48 () {54 vars in 912 bytes} [Tue May 17 17:10:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:10:20.200883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf52636-1b36-44db-9fae-a1cd30f69552 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:20.207519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb9bbb-cf5c-4fe7-af8e-ab7e135b0216 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:20.207827 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb9bbb-cf5c-4fe7-af8e-ab7e135b0216 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:20.208106 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb9bbb-cf5c-4fe7-af8e-ab7e135b0216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:20.231214 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf52636-1b36-44db-9fae-a1cd30f69552 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:20.292738 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f7cb9bbb-cf5c-4fe7-af8e-ab7e135b0216 None None] MFA Rules not processed for user `a9c62b7e0faa46ecaf78356c20676a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:20.294122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f7cb9bbb-cf5c-4fe7-af8e-ab7e135b0216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:20.317061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c9d5a-85e1-4698-b8e1-bf66e15cdaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:20.319347 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c9d5a-85e1-4698-b8e1-bf66e15cdaef admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:20.321321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c9d5a-85e1-4698-b8e1-bf66e15cdaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:20.321660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c9d5a-85e1-4698-b8e1-bf66e15cdaef admin admin] PATH_INFO: `/v3/projects/7425b81a3c6f4634a5246e84d8b57004/users/a22350b11bcb4bce81c91adb0c2532fe/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:20.325995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c9d5a-85e1-4698-b8e1-bf66e15cdaef admin admin] RBAC: Authorizing `identity:create_grant(project_id=7425b81a3c6f4634a5246e84d8b57004, user_id=a22350b11bcb4bce81c91adb0c2532fe, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:20.330287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c9d5a-85e1-4698-b8e1-bf66e15cdaef admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:20.345303 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 811/1639] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:20 2022] PUT /identity/v3/projects/7425b81a3c6f4634a5246e84d8b57004/users/a22350b11bcb4bce81c91adb0c2532fe/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:20.346796 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be21d88-2118-499d-b84d-c7845752af11 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:20.347525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be21d88-2118-499d-b84d-c7845752af11 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:20.347525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be21d88-2118-499d-b84d-c7845752af11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:20.410515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3be21d88-2118-499d-b84d-c7845752af11 None None] MFA Rules not processed for user `5becb135afbd43e9bc0b1347ba04e2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:20.416243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3be21d88-2118-499d-b84d-c7845752af11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:20.525943 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 829/1640] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:20.532876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627a24f-1ae6-459d-afb3-42f67578741b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:20.533163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627a24f-1ae6-459d-afb3-42f67578741b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:20.534343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627a24f-1ae6-459d-afb3-42f67578741b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:20.602729 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 812/1641] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 17:10:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:20.604760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be21d88-2118-499d-b84d-c7845752af11 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:20.619346 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6627a24f-1ae6-459d-afb3-42f67578741b None None] MFA Rules not processed for user `a22350b11bcb4bce81c91adb0c2532fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:20.622741 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6627a24f-1ae6-459d-afb3-42f67578741b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:20.699470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be21d88-2118-499d-b84d-c7845752af11 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:20.706597 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e909f2c-095e-47b7-ace9-d24dff33133f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:20.707440 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e909f2c-095e-47b7-ace9-d24dff33133f service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:20.707842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e909f2c-095e-47b7-ace9-d24dff33133f service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:20.710064 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e909f2c-095e-47b7-ace9-d24dff33133f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:20.827331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e909f2c-095e-47b7-ace9-d24dff33133f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:20.829295 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e909f2c-095e-47b7-ace9-d24dff33133f service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:20.842181 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 830/1642] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:20.842181 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627a24f-1ae6-459d-afb3-42f67578741b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:20.849132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 813/1643] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:20 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:20.876307 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627a24f-1ae6-459d-afb3-42f67578741b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:20.896909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a404e-f252-43e5-a43d-2cacc617aaa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:20.897578 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a404e-f252-43e5-a43d-2cacc617aaa7 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:20.897856 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a404e-f252-43e5-a43d-2cacc617aaa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:20.898130 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a404e-f252-43e5-a43d-2cacc617aaa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:21.071093 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a404e-f252-43e5-a43d-2cacc617aaa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:21.072560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a404e-f252-43e5-a43d-2cacc617aaa7 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:21.100498 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 831/1644] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:21.109714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77858e-a038-4f14-94be-bdd0b737f9e3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:21.110220 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77858e-a038-4f14-94be-bdd0b737f9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:21.111887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77858e-a038-4f14-94be-bdd0b737f9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:21.180509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6c77858e-a038-4f14-94be-bdd0b737f9e3 None None] MFA Rules not processed for user `58e161159bbc4339b6ac52213cc7b7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:21.182351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6c77858e-a038-4f14-94be-bdd0b737f9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:21.297827 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a404e-f252-43e5-a43d-2cacc617aaa7 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:21.307252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a404e-f252-43e5-a43d-2cacc617aaa7 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:21.326779 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721471e-bbf8-4edf-a435-780b658fc17d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:21.327462 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721471e-bbf8-4edf-a435-780b658fc17d service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:21.327750 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721471e-bbf8-4edf-a435-780b658fc17d service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:21.328025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721471e-bbf8-4edf-a435-780b658fc17d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:21.331096 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 814/1645] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:21.348105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535c4d-3097-4514-a66c-732c8303f8a8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:21.349527 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535c4d-3097-4514-a66c-732c8303f8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:21.355667 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721471e-bbf8-4edf-a435-780b658fc17d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:21.356824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535c4d-3097-4514-a66c-732c8303f8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:21.357157 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721471e-bbf8-4edf-a435-780b658fc17d service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:21.381582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 832/1646] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:21.403537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-af535c4d-3097-4514-a66c-732c8303f8a8 None None] MFA Rules not processed for user `58e161159bbc4339b6ac52213cc7b7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:21.404974 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-af535c4d-3097-4514-a66c-732c8303f8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:21.433605 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 815/1647] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:21.459292 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1e32a-5b90-4069-8f80-08cb2a180a7d None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:21.460037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1e32a-5b90-4069-8f80-08cb2a180a7d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:21.460037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1e32a-5b90-4069-8f80-08cb2a180a7d None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:21.461630 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 833/1648] 10.222.0.48 () {54 vars in 961 bytes} [Tue May 17 17:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:10:21.467853 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90645cc2-30c8-418b-bb3a-19d8c84c680c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:21.468047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90645cc2-30c8-418b-bb3a-19d8c84c680c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:21.468320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90645cc2-30c8-418b-bb3a-19d8c84c680c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:21.504796 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-90645cc2-30c8-418b-bb3a-19d8c84c680c None None] MFA Rules not processed for user `5becb135afbd43e9bc0b1347ba04e2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:21.506221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-90645cc2-30c8-418b-bb3a-19d8c84c680c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:21.529229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 816/1649] 10.222.0.48 () {58 vars in 1058 bytes} [Tue May 17 17:10:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:21.537193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1e32a-5b90-4069-8f80-08cb2a180a7d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:21.565627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1e32a-5b90-4069-8f80-08cb2a180a7d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:21.577382 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2397e7-a699-446d-b488-868ec1eef47b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:21.578083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2397e7-a699-446d-b488-868ec1eef47b service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:21.580726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2397e7-a699-446d-b488-868ec1eef47b service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:21.580726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2397e7-a699-446d-b488-868ec1eef47b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:21.596510 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2397e7-a699-446d-b488-868ec1eef47b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:21.598200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2397e7-a699-446d-b488-868ec1eef47b service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:21.618827 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 834/1650] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:22.069495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9996de8-21bd-49fa-8c8c-170a76c73382 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:22.071287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9996de8-21bd-49fa-8c8c-170a76c73382 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:22.071287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9996de8-21bd-49fa-8c8c-170a76c73382 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:22.072559 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 817/1651] 10.222.0.48 () {54 vars in 912 bytes} [Tue May 17 17:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:10:22.081756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60900078-adf5-4a82-833c-29ad39f4e75f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:22.083239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60900078-adf5-4a82-833c-29ad39f4e75f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:22.083796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60900078-adf5-4a82-833c-29ad39f4e75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:22.152705 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-60900078-adf5-4a82-833c-29ad39f4e75f None None] MFA Rules not processed for user `5becb135afbd43e9bc0b1347ba04e2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:22.155239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9996de8-21bd-49fa-8c8c-170a76c73382 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:22.160664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-60900078-adf5-4a82-833c-29ad39f4e75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:22.170484 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9996de8-21bd-49fa-8c8c-170a76c73382 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:22.176318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63018cf-5d3d-4c80-8d3f-c37d35c70022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:22.177153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63018cf-5d3d-4c80-8d3f-c37d35c70022 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:22.177578 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63018cf-5d3d-4c80-8d3f-c37d35c70022 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:22.177917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63018cf-5d3d-4c80-8d3f-c37d35c70022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:22.188564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 835/1652] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 17:10:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:22.204677 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63018cf-5d3d-4c80-8d3f-c37d35c70022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:22.209336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63018cf-5d3d-4c80-8d3f-c37d35c70022 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:22.210347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60900078-adf5-4a82-833c-29ad39f4e75f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:22.214992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-60900078-adf5-4a82-833c-29ad39f4e75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:22.234980 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 818/1653] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:22.314004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60900078-adf5-4a82-833c-29ad39f4e75f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:22.328111 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a698f-731f-4acb-a07b-66d445e5aa6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25519cdc25244a0b039ce3097c328d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:22.332144 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a698f-731f-4acb-a07b-66d445e5aa6a service glance] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:22.333031 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a698f-731f-4acb-a07b-66d445e5aa6a service glance] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:22.334238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a698f-731f-4acb-a07b-66d445e5aa6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:22.382565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a698f-731f-4acb-a07b-66d445e5aa6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:22.389359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a698f-731f-4acb-a07b-66d445e5aa6a service glance] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:22.437926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 836/1654] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:22.575030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63018cf-5d3d-4c80-8d3f-c37d35c70022 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:22.586580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63018cf-5d3d-4c80-8d3f-c37d35c70022 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:22.600298 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da054eaa-f04e-47ac-a4a1-36fc2de73b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:22.605768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da054eaa-f04e-47ac-a4a1-36fc2de73b1e service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:22.606487 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da054eaa-f04e-47ac-a4a1-36fc2de73b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:22.609147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da054eaa-f04e-47ac-a4a1-36fc2de73b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:22.744380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da054eaa-f04e-47ac-a4a1-36fc2de73b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:22.746573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da054eaa-f04e-47ac-a4a1-36fc2de73b1e service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:22.767079 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 819/1655] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:23.386576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ca023-1997-4e65-814b-0077889e650e None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:23.389187 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ca023-1997-4e65-814b-0077889e650e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:23.389717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ca023-1997-4e65-814b-0077889e650e None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:23.399168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 837/1656] 10.222.0.48 () {54 vars in 912 bytes} [Tue May 17 17:10:23 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:10:23.421656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1201c66-25ca-41e1-b275-194683753765 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:23.423000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1201c66-25ca-41e1-b275-194683753765 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:23.423543 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1201c66-25ca-41e1-b275-194683753765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:23.507067 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ca023-1997-4e65-814b-0077889e650e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:23.591140 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a1201c66-25ca-41e1-b275-194683753765 None None] MFA Rules not processed for user `5819e022286b454e9e2f23d975c6e921`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:23.593218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a1201c66-25ca-41e1-b275-194683753765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:23.687347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ca023-1997-4e65-814b-0077889e650e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:23.697902 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35faab2-1b0d-4376-a9cd-2cd5994f3ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:23.699397 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35faab2-1b0d-4376-a9cd-2cd5994f3ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:23.699876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35faab2-1b0d-4376-a9cd-2cd5994f3ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:23.700316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35faab2-1b0d-4376-a9cd-2cd5994f3ec8 admin admin] PATH_INFO: `/v3/users/d8ea8199d8204ad5be806d3000f36efc` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:23.704794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35faab2-1b0d-4376-a9cd-2cd5994f3ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ea8199d8204ad5be806d3000f36efc)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:23.705846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: WARNING py.warnings [None req-f35faab2-1b0d-4376-a9cd-2cd5994f3ec8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 17:10:23.705846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: warnings.warn(msg) May 17 17:10:23.705846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: May 17 17:10:23.707091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35faab2-1b0d-4376-a9cd-2cd5994f3ec8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:23.718229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 820/1657] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 17:10:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:23.757056 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1201c66-25ca-41e1-b275-194683753765 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:23.774025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1201c66-25ca-41e1-b275-194683753765 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:23.798663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2e52c-be45-4a05-9842-0d46e0c7c7cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:23.799975 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2e52c-be45-4a05-9842-0d46e0c7c7cb service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:23.800457 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2e52c-be45-4a05-9842-0d46e0c7c7cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:23.801951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2e52c-be45-4a05-9842-0d46e0c7c7cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:23.819755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f35faab2-1b0d-4376-a9cd-2cd5994f3ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ea8199d8204ad5be806d3000f36efc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:23.821414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f35faab2-1b0d-4376-a9cd-2cd5994f3ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ea8199d8204ad5be806d3000f36efc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:23.826499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2e52c-be45-4a05-9842-0d46e0c7c7cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:23.829758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2e52c-be45-4a05-9842-0d46e0c7c7cb service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:23.862473 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 821/1658] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:23.877696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f35faab2-1b0d-4376-a9cd-2cd5994f3ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ea8199d8204ad5be806d3000f36efc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:23.902968 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f35faab2-1b0d-4376-a9cd-2cd5994f3ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ea8199d8204ad5be806d3000f36efc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:23.907251 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f35faab2-1b0d-4376-a9cd-2cd5994f3ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ea8199d8204ad5be806d3000f36efc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:23.936914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 838/1659] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:10:23 2022] DELETE /identity/v3/users/d8ea8199d8204ad5be806d3000f36efc => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:23.942055 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5fefb-c27e-40fd-a746-aa0bfd39cc71 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:23.942572 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5fefb-c27e-40fd-a746-aa0bfd39cc71 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:23.943528 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5fefb-c27e-40fd-a746-aa0bfd39cc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:23.983038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a4b5fefb-c27e-40fd-a746-aa0bfd39cc71 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:23.986034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a4b5fefb-c27e-40fd-a746-aa0bfd39cc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:24.162040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 822/1660] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:24.258823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35faab2-1b0d-4376-a9cd-2cd5994f3ec8 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:24.262055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f35faab2-1b0d-4376-a9cd-2cd5994f3ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:24.411292 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35faab2-1b0d-4376-a9cd-2cd5994f3ec8 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:24.425535 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbf6f6-ec77-4e57-a193-fb1708e085e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:24.426993 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbf6f6-ec77-4e57-a193-fb1708e085e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:24.428658 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbf6f6-ec77-4e57-a193-fb1708e085e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:24.429767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbf6f6-ec77-4e57-a193-fb1708e085e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:24.457367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bbf6f6-ec77-4e57-a193-fb1708e085e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:24.459293 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bbf6f6-ec77-4e57-a193-fb1708e085e2 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:24.492779 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 839/1661] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:26.149384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6b199-9258-4883-aab8-c053feb1e89c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:26.150889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6b199-9258-4883-aab8-c053feb1e89c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:26.151362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6b199-9258-4883-aab8-c053feb1e89c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:26.153225 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 823/1662] 10.222.0.48 () {54 vars in 960 bytes} [Tue May 17 17:10:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:10:26.159415 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b790e-98d8-4b48-9d5e-864e565b2eaa None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:26.161216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b790e-98d8-4b48-9d5e-864e565b2eaa None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:26.161693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b790e-98d8-4b48-9d5e-864e565b2eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:26.202826 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f58b790e-98d8-4b48-9d5e-864e565b2eaa None None] MFA Rules not processed for user `7730d6cad2ba40c19cb671268cf04d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:26.204846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f58b790e-98d8-4b48-9d5e-864e565b2eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:26.423458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 840/1663] 10.222.0.48 () {58 vars in 1057 bytes} [Tue May 17 17:10:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:26.431920 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6b199-9258-4883-aab8-c053feb1e89c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:26.504079 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6b199-9258-4883-aab8-c053feb1e89c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:26.519447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db0f4d-6712-4906-b594-19a17e63a8be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7730d6cad2ba40c19cb671268cf04d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:26.520164 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db0f4d-6712-4906-b594-19a17e63a8be service placement] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:26.520447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db0f4d-6712-4906-b594-19a17e63a8be service placement] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:26.520726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db0f4d-6712-4906-b594-19a17e63a8be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:26.523146 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c6db0f4d-6712-4906-b594-19a17e63a8be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:26.550959 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db0f4d-6712-4906-b594-19a17e63a8be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:26.553053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db0f4d-6712-4906-b594-19a17e63a8be service placement] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:26.598900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 824/1664] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:27.444380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b790e-98d8-4b48-9d5e-864e565b2eaa None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:27.448555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f58b790e-98d8-4b48-9d5e-864e565b2eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:27.558096 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b790e-98d8-4b48-9d5e-864e565b2eaa None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:27.569155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354adf76-a68f-483e-b4d7-3b9ff588b862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:27.570487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354adf76-a68f-483e-b4d7-3b9ff588b862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:27.571017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354adf76-a68f-483e-b4d7-3b9ff588b862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:27.571704 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354adf76-a68f-483e-b4d7-3b9ff588b862 admin admin] PATH_INFO: `/v3/projects/e8cb5cc818724793a5634e8f8dad0753` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:27.576090 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354adf76-a68f-483e-b4d7-3b9ff588b862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8cb5cc818724793a5634e8f8dad0753)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:27.578659 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354adf76-a68f-483e-b4d7-3b9ff588b862 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:27.825318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-354adf76-a68f-483e-b4d7-3b9ff588b862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8cb5cc818724793a5634e8f8dad0753', 'request_id': 'req-354adf76-a68f-483e-b4d7-3b9ff588b862'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:27.831792 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-354adf76-a68f-483e-b4d7-3b9ff588b862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8cb5cc818724793a5634e8f8dad0753', 'request_id': 'req-354adf76-a68f-483e-b4d7-3b9ff588b862'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:27.859447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-354adf76-a68f-483e-b4d7-3b9ff588b862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8cb5cc818724793a5634e8f8dad0753', 'request_id': 'req-354adf76-a68f-483e-b4d7-3b9ff588b862'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:27.888164 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-354adf76-a68f-483e-b4d7-3b9ff588b862 admin admin] The token cache is being invalidate because project e8cb5cc818724793a5634e8f8dad0753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:10:27.888725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-354adf76-a68f-483e-b4d7-3b9ff588b862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:27.889595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-354adf76-a68f-483e-b4d7-3b9ff588b862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:27.901828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db0f4d-6712-4906-b594-19a17e63a8be service placement] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:27.902379 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 841/1665] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:10:27 2022] DELETE /identity/v3/projects/e8cb5cc818724793a5634e8f8dad0753 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:27.914044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db0f4d-6712-4906-b594-19a17e63a8be service placement] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:28.026962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcac6c-4cf1-4fa3-a444-b03022ac534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:28.028224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcac6c-4cf1-4fa3-a444-b03022ac534b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:28.029018 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcac6c-4cf1-4fa3-a444-b03022ac534b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:28.029497 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcac6c-4cf1-4fa3-a444-b03022ac534b admin admin] PATH_INFO: `/v3/users/a9c62b7e0faa46ecaf78356c20676a4b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:28.031594 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcac6c-4cf1-4fa3-a444-b03022ac534b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9c62b7e0faa46ecaf78356c20676a4b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:28.034722 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcac6c-4cf1-4fa3-a444-b03022ac534b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:28.121178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-39dcac6c-4cf1-4fa3-a444-b03022ac534b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9c62b7e0faa46ecaf78356c20676a4b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:28.174266 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-39dcac6c-4cf1-4fa3-a444-b03022ac534b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9c62b7e0faa46ecaf78356c20676a4b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:28.196869 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-39dcac6c-4cf1-4fa3-a444-b03022ac534b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9c62b7e0faa46ecaf78356c20676a4b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:28.200122 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-39dcac6c-4cf1-4fa3-a444-b03022ac534b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9c62b7e0faa46ecaf78356c20676a4b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:28.200803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-39dcac6c-4cf1-4fa3-a444-b03022ac534b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9c62b7e0faa46ecaf78356c20676a4b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:28.227853 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 825/1666] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:10:27 2022] DELETE /identity/v3/users/a9c62b7e0faa46ecaf78356c20676a4b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:28.896160 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354adf76-a68f-483e-b4d7-3b9ff588b862 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:28.897756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-354adf76-a68f-483e-b4d7-3b9ff588b862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:28.920909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354adf76-a68f-483e-b4d7-3b9ff588b862 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:29.062388 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cbb38-872f-4ca6-ae95-c57e20bb6173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:29.063376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cbb38-872f-4ca6-ae95-c57e20bb6173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:29.063751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cbb38-872f-4ca6-ae95-c57e20bb6173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:29.064100 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cbb38-872f-4ca6-ae95-c57e20bb6173 admin admin] PATH_INFO: `/v3/projects/6e98dfc1ed2a47a988d3fc5b1db0728d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:29.066340 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cbb38-872f-4ca6-ae95-c57e20bb6173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e98dfc1ed2a47a988d3fc5b1db0728d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:29.068840 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cbb38-872f-4ca6-ae95-c57e20bb6173 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:29.179428 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fe5cbb38-872f-4ca6-ae95-c57e20bb6173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e98dfc1ed2a47a988d3fc5b1db0728d', 'request_id': 'req-fe5cbb38-872f-4ca6-ae95-c57e20bb6173'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:29.193220 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fe5cbb38-872f-4ca6-ae95-c57e20bb6173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e98dfc1ed2a47a988d3fc5b1db0728d', 'request_id': 'req-fe5cbb38-872f-4ca6-ae95-c57e20bb6173'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:29.247788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fe5cbb38-872f-4ca6-ae95-c57e20bb6173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e98dfc1ed2a47a988d3fc5b1db0728d', 'request_id': 'req-fe5cbb38-872f-4ca6-ae95-c57e20bb6173'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:29.318733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fe5cbb38-872f-4ca6-ae95-c57e20bb6173 admin admin] The token cache is being invalidate because project 6e98dfc1ed2a47a988d3fc5b1db0728d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:10:29.319217 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fe5cbb38-872f-4ca6-ae95-c57e20bb6173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:29.320860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-fe5cbb38-872f-4ca6-ae95-c57e20bb6173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:29.341829 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 842/1667] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:10:28 2022] DELETE /identity/v3/projects/6e98dfc1ed2a47a988d3fc5b1db0728d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:29.344378 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae52154-4b07-4fe8-93a6-710f2f0ec44a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:29.345214 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae52154-4b07-4fe8-93a6-710f2f0ec44a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:29.345708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae52154-4b07-4fe8-93a6-710f2f0ec44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:29.378887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-eae52154-4b07-4fe8-93a6-710f2f0ec44a None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:29.380477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-eae52154-4b07-4fe8-93a6-710f2f0ec44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:29.470101 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 826/1668] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:29.479935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff97d5a-3bcb-4d42-aa13-60e5029eedf9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:29.480744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff97d5a-3bcb-4d42-aa13-60e5029eedf9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:29.481892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff97d5a-3bcb-4d42-aa13-60e5029eedf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:29.516260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2ff97d5a-3bcb-4d42-aa13-60e5029eedf9 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:29.518904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2ff97d5a-3bcb-4d42-aa13-60e5029eedf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:29.532148 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 843/1669] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:29.537467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae52154-4b07-4fe8-93a6-710f2f0ec44a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:29.555870 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae52154-4b07-4fe8-93a6-710f2f0ec44a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:29.569189 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfd834-a43c-4fa3-a843-f0ba28958f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:29.570326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfd834-a43c-4fa3-a843-f0ba28958f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:29.570804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfd834-a43c-4fa3-a843-f0ba28958f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:29.571861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfd834-a43c-4fa3-a843-f0ba28958f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:29.572852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfd834-a43c-4fa3-a843-f0ba28958f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:10:29.573439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfd834-a43c-4fa3-a843-f0ba28958f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:29.575732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfd834-a43c-4fa3-a843-f0ba28958f3d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:29.595807 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff97d5a-3bcb-4d42-aa13-60e5029eedf9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:29.602880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 827/1670] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:10:29.611461 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff97d5a-3bcb-4d42-aa13-60e5029eedf9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:29.622672 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1997d6-5b07-4f72-9ea3-f0aad3e712c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:29.623503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1997d6-5b07-4f72-9ea3-f0aad3e712c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:29.623949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1997d6-5b07-4f72-9ea3-f0aad3e712c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:29.624329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1997d6-5b07-4f72-9ea3-f0aad3e712c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:29.628337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1997d6-5b07-4f72-9ea3-f0aad3e712c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:29.633963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1997d6-5b07-4f72-9ea3-f0aad3e712c7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:29.741653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 844/1671] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:29 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:29.743388 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfd834-a43c-4fa3-a843-f0ba28958f3d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:29.764495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfd834-a43c-4fa3-a843-f0ba28958f3d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:29.924949 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1767f2-7d0e-4002-8366-7dc304c815c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:29.925753 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1767f2-7d0e-4002-8366-7dc304c815c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:29.926202 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1767f2-7d0e-4002-8366-7dc304c815c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:29.926588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1767f2-7d0e-4002-8366-7dc304c815c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:29.927401 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1767f2-7d0e-4002-8366-7dc304c815c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:29.929630 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1767f2-7d0e-4002-8366-7dc304c815c8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:29.967336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 828/1672] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:29 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:29.971693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1997d6-5b07-4f72-9ea3-f0aad3e712c7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:29.990268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1997d6-5b07-4f72-9ea3-f0aad3e712c7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:30.006249 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3118b25-6adb-489b-82aa-325d6c7edcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:30.007063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3118b25-6adb-489b-82aa-325d6c7edcae admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:30.007407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3118b25-6adb-489b-82aa-325d6c7edcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:30.007758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3118b25-6adb-489b-82aa-325d6c7edcae admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:30.008576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3118b25-6adb-489b-82aa-325d6c7edcae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:30.010880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3118b25-6adb-489b-82aa-325d6c7edcae admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:30.045246 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 845/1673] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:30.050115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1767f2-7d0e-4002-8366-7dc304c815c8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:30.070107 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1767f2-7d0e-4002-8366-7dc304c815c8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:30.084627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c95ae8-e1ae-4102-a96a-2097a02c0690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:30.085534 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c95ae8-e1ae-4102-a96a-2097a02c0690 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:30.085920 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c95ae8-e1ae-4102-a96a-2097a02c0690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:30.086263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c95ae8-e1ae-4102-a96a-2097a02c0690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:30.088473 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c95ae8-e1ae-4102-a96a-2097a02c0690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:30.093401 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c95ae8-e1ae-4102-a96a-2097a02c0690 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:30.131873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3118b25-6adb-489b-82aa-325d6c7edcae admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:30.136732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 829/1674] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:30.162575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3118b25-6adb-489b-82aa-325d6c7edcae admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:30.177457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c487ed-7868-430d-8dfe-c140f8719e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:30.179275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c487ed-7868-430d-8dfe-c140f8719e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:30.180090 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c487ed-7868-430d-8dfe-c140f8719e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:30.180893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c487ed-7868-430d-8dfe-c140f8719e89 admin admin] PATH_INFO: `/v3/projects/affa04dcddb049af862886ae9f526353/users/e5daae5f5e7c489fa1c0e440348c2e24/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:30.219965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625e100-f516-45b0-97e4-78302f5f7896 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:30.220478 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625e100-f516-45b0-97e4-78302f5f7896 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:30.220946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625e100-f516-45b0-97e4-78302f5f7896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:30.231737 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c487ed-7868-430d-8dfe-c140f8719e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=affa04dcddb049af862886ae9f526353, user_id=e5daae5f5e7c489fa1c0e440348c2e24, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:30.234831 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c487ed-7868-430d-8dfe-c140f8719e89 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:30.257908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4625e100-f516-45b0-97e4-78302f5f7896 None None] MFA Rules not processed for user `86a0b6c88fe84ba0907d515fd9f38e72`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:30.261280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4625e100-f516-45b0-97e4-78302f5f7896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:30.278779 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 846/1675] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:30 2022] PUT /identity/v3/projects/affa04dcddb049af862886ae9f526353/users/e5daae5f5e7c489fa1c0e440348c2e24/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:10:30.282292 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a79cb-4fa5-47c8-bce8-82a9bdf8c843 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:30.282809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a79cb-4fa5-47c8-bce8-82a9bdf8c843 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:30.283559 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a79cb-4fa5-47c8-bce8-82a9bdf8c843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:30.341039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-201a79cb-4fa5-47c8-bce8-82a9bdf8c843 None None] MFA Rules not processed for user `e5daae5f5e7c489fa1c0e440348c2e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:30.344534 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-201a79cb-4fa5-47c8-bce8-82a9bdf8c843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:30.470868 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 830/1676] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:10:30.486301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625e100-f516-45b0-97e4-78302f5f7896 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:30.487885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4625e100-f516-45b0-97e4-78302f5f7896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:30.523663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 847/1677] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:30.527653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a79cb-4fa5-47c8-bce8-82a9bdf8c843 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:30.629643 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625e100-f516-45b0-97e4-78302f5f7896 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:30.662009 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483b45b-bf12-46df-8f78-166a72c3ca52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:30.667438 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b45b-bf12-46df-8f78-166a72c3ca52 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:30.668236 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b45b-bf12-46df-8f78-166a72c3ca52 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:30.669147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b45b-bf12-46df-8f78-166a72c3ca52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:30.671554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a79cb-4fa5-47c8-bce8-82a9bdf8c843 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:30.684944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5b204-dbec-444c-b721-40dc909a6744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:30.685827 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5b204-dbec-444c-b721-40dc909a6744 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:30.686219 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5b204-dbec-444c-b721-40dc909a6744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:30.686601 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5b204-dbec-444c-b721-40dc909a6744 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:30.687499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5b204-dbec-444c-b721-40dc909a6744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:30.689740 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5b204-dbec-444c-b721-40dc909a6744 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:30.693396 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483b45b-bf12-46df-8f78-166a72c3ca52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:30.696541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483b45b-bf12-46df-8f78-166a72c3ca52 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:30.720719 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 831/1678] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:10:30.779172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 848/1679] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:30 2022] POST /identity/v3/projects => generated 369 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:30.780698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483b45b-bf12-46df-8f78-166a72c3ca52 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:30.803126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483b45b-bf12-46df-8f78-166a72c3ca52 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:31.008119 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad681d9-262c-41e4-836e-3ed1063ab32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:31.008825 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad681d9-262c-41e4-836e-3ed1063ab32b admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:31.009137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad681d9-262c-41e4-836e-3ed1063ab32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:31.009414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad681d9-262c-41e4-836e-3ed1063ab32b admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:31.011390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad681d9-262c-41e4-836e-3ed1063ab32b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:31.026731 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad681d9-262c-41e4-836e-3ed1063ab32b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:31.096400 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 832/1680] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:30 2022] POST /identity/v3/users => generated 291 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:31.100792 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5b204-dbec-444c-b721-40dc909a6744 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:31.131198 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5b204-dbec-444c-b721-40dc909a6744 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:31.144412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d783d4f-4a4b-4519-88c6-e3e8087d6b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:31.145596 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d783d4f-4a4b-4519-88c6-e3e8087d6b8b admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:31.146056 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d783d4f-4a4b-4519-88c6-e3e8087d6b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:31.146511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d783d4f-4a4b-4519-88c6-e3e8087d6b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:31.147442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d783d4f-4a4b-4519-88c6-e3e8087d6b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:31.149728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d783d4f-4a4b-4519-88c6-e3e8087d6b8b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:31.192514 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad681d9-262c-41e4-836e-3ed1063ab32b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:31.193120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 849/1681] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:31.209798 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad681d9-262c-41e4-836e-3ed1063ab32b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:31.238234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d57ba-d1ab-4745-a622-ca6a67c9b532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:31.239229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d57ba-d1ab-4745-a622-ca6a67c9b532 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:31.239527 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d57ba-d1ab-4745-a622-ca6a67c9b532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:31.239839 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d57ba-d1ab-4745-a622-ca6a67c9b532 admin admin] PATH_INFO: `/v3/projects/532999c435224fb6846f8deae2a96d9a/users/74b12e47cbb8483a89dded4f05790a0e/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:31.306990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d57ba-d1ab-4745-a622-ca6a67c9b532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532999c435224fb6846f8deae2a96d9a, user_id=74b12e47cbb8483a89dded4f05790a0e, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:31.311926 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d57ba-d1ab-4745-a622-ca6a67c9b532 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:31.355488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 833/1682] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:31 2022] PUT /identity/v3/projects/532999c435224fb6846f8deae2a96d9a/users/74b12e47cbb8483a89dded4f05790a0e/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:31.357437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d783d4f-4a4b-4519-88c6-e3e8087d6b8b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:31.373846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d783d4f-4a4b-4519-88c6-e3e8087d6b8b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:31.572445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331f408-5448-4e8a-9e9e-ca4cf94f62f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:31.576674 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331f408-5448-4e8a-9e9e-ca4cf94f62f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:31.584955 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331f408-5448-4e8a-9e9e-ca4cf94f62f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:31.588800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331f408-5448-4e8a-9e9e-ca4cf94f62f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:31.589835 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331f408-5448-4e8a-9e9e-ca4cf94f62f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:31.591788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331f408-5448-4e8a-9e9e-ca4cf94f62f9 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:31.647405 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 850/1683] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:31.648188 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d57ba-d1ab-4745-a622-ca6a67c9b532 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:31.669495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d57ba-d1ab-4745-a622-ca6a67c9b532 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:31.709340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a47b2f-a8c8-4b2a-9090-b9bff14a162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:31.710853 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a47b2f-a8c8-4b2a-9090-b9bff14a162b admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:31.711138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a47b2f-a8c8-4b2a-9090-b9bff14a162b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:31.711413 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a47b2f-a8c8-4b2a-9090-b9bff14a162b admin admin] PATH_INFO: `/v3/projects/532999c435224fb6846f8deae2a96d9a/users/74b12e47cbb8483a89dded4f05790a0e/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:31.721183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a47b2f-a8c8-4b2a-9090-b9bff14a162b admin admin] RBAC: Authorizing `identity:create_grant(project_id=532999c435224fb6846f8deae2a96d9a, user_id=74b12e47cbb8483a89dded4f05790a0e, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:31.734277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a47b2f-a8c8-4b2a-9090-b9bff14a162b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:31.794076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 834/1684] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:31 2022] PUT /identity/v3/projects/532999c435224fb6846f8deae2a96d9a/users/74b12e47cbb8483a89dded4f05790a0e/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:10:31.809616 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e25c7-0ca6-40e9-adf7-9d0f44eb9456 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:31.810250 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e25c7-0ca6-40e9-adf7-9d0f44eb9456 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:31.811332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e25c7-0ca6-40e9-adf7-9d0f44eb9456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:31.922262 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-997e25c7-0ca6-40e9-adf7-9d0f44eb9456 None None] MFA Rules not processed for user `74b12e47cbb8483a89dded4f05790a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:31.926337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-997e25c7-0ca6-40e9-adf7-9d0f44eb9456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:32.206476 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 851/1685] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:32.237574 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a47b2f-a8c8-4b2a-9090-b9bff14a162b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:32.242625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-60a47b2f-a8c8-4b2a-9090-b9bff14a162b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:32.372874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a47b2f-a8c8-4b2a-9090-b9bff14a162b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:32.383225 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c04828-8770-48ed-891a-e5aa14a88445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:32.384092 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c04828-8770-48ed-891a-e5aa14a88445 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:32.384465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c04828-8770-48ed-891a-e5aa14a88445 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:32.384855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c04828-8770-48ed-891a-e5aa14a88445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:32.419120 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c04828-8770-48ed-891a-e5aa14a88445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:32.420732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c04828-8770-48ed-891a-e5aa14a88445 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:32.433304 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 835/1686] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:32 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:32.472505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f00f70-1849-4dc0-aec0-66c595810ece None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:32.472907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f00f70-1849-4dc0-aec0-66c595810ece None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:32.473715 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f00f70-1849-4dc0-aec0-66c595810ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:32.528682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c04828-8770-48ed-891a-e5aa14a88445 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:32.530254 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-22c04828-8770-48ed-891a-e5aa14a88445 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:32.545554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c04828-8770-48ed-891a-e5aa14a88445 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:32.553215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-49f00f70-1849-4dc0-aec0-66c595810ece None None] MFA Rules not processed for user `824915e26a724d938e5dd0a3c1f57932`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:32.554461 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-49f00f70-1849-4dc0-aec0-66c595810ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:32.558126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476db7ed-1944-4910-82af-61d7a456cd4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:32.558792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476db7ed-1944-4910-82af-61d7a456cd4a service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:32.559071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476db7ed-1944-4910-82af-61d7a456cd4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:32.559349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476db7ed-1944-4910-82af-61d7a456cd4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:32.642081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476db7ed-1944-4910-82af-61d7a456cd4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:32.645784 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476db7ed-1944-4910-82af-61d7a456cd4a service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:32.680939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 836/1687] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:32 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:32.761327 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 852/1688] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:32.777751 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90573a46-bff8-4b6e-aa60-65327e39fd67 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:32.778380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90573a46-bff8-4b6e-aa60-65327e39fd67 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:32.778662 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90573a46-bff8-4b6e-aa60-65327e39fd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:32.825491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-90573a46-bff8-4b6e-aa60-65327e39fd67 None None] MFA Rules not processed for user `824915e26a724d938e5dd0a3c1f57932`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:32.842061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-90573a46-bff8-4b6e-aa60-65327e39fd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:32.894579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 837/1689] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:32.908565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f00f70-1849-4dc0-aec0-66c595810ece None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:32.910894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-49f00f70-1849-4dc0-aec0-66c595810ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:33.204830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f00f70-1849-4dc0-aec0-66c595810ece None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:33.218248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f52a3d-07ac-4d32-8cd2-0575e8a8cf3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:33.225672 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f52a3d-07ac-4d32-8cd2-0575e8a8cf3f service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:33.225965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f52a3d-07ac-4d32-8cd2-0575e8a8cf3f service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:33.226249 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f52a3d-07ac-4d32-8cd2-0575e8a8cf3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:33.245367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f52a3d-07ac-4d32-8cd2-0575e8a8cf3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:33.246991 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f52a3d-07ac-4d32-8cd2-0575e8a8cf3f service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:33.275789 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 853/1690] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:33.655862 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc5f70-849d-4817-8022-9cdaea1a2e37 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:33.656629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc5f70-849d-4817-8022-9cdaea1a2e37 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:33.657583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc5f70-849d-4817-8022-9cdaea1a2e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:33.692441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ccbc5f70-849d-4817-8022-9cdaea1a2e37 None None] MFA Rules not processed for user `74cc0ddf89664a6f92c84ebb9e1ab3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:33.693652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ccbc5f70-849d-4817-8022-9cdaea1a2e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:33.794785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 838/1691] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:33.803661 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f52a3d-07ac-4d32-8cd2-0575e8a8cf3f service nova] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:33.820352 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f52a3d-07ac-4d32-8cd2-0575e8a8cf3f service nova] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:33.832821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3bbf5-e4f0-4ae0-9128-2c8782fa8122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:33.834339 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3bbf5-e4f0-4ae0-9128-2c8782fa8122 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:33.834767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3bbf5-e4f0-4ae0-9128-2c8782fa8122 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:33.835255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3bbf5-e4f0-4ae0-9128-2c8782fa8122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:33.844980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3bbf5-e4f0-4ae0-9128-2c8782fa8122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:33.846791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3bbf5-e4f0-4ae0-9128-2c8782fa8122 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:33.860105 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 854/1692] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:34.804161 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5369725-212b-4b61-bab8-a624f058be6d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:34.805153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5369725-212b-4b61-bab8-a624f058be6d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:34.805723 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5369725-212b-4b61-bab8-a624f058be6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:34.854815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b5369725-212b-4b61-bab8-a624f058be6d None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:34.857950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b5369725-212b-4b61-bab8-a624f058be6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:35.043545 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 839/1693] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:35.330696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3bbf5-e4f0-4ae0-9128-2c8782fa8122 service nova] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:35.332381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-dce3bbf5-e4f0-4ae0-9128-2c8782fa8122 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:35.533323 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3bbf5-e4f0-4ae0-9128-2c8782fa8122 service nova] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:35.543994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8811f-ddd4-472d-9723-9da85bf8e009 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:35.544778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8811f-ddd4-472d-9723-9da85bf8e009 service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:35.544991 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8811f-ddd4-472d-9723-9da85bf8e009 service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:35.545261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8811f-ddd4-472d-9723-9da85bf8e009 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:35.569767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8811f-ddd4-472d-9723-9da85bf8e009 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:35.571407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8811f-ddd4-472d-9723-9da85bf8e009 service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:35.608049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 855/1694] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:10:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:10:35.639168 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3d319-7a20-4a2c-a7bf-5f72c54a8836 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:35.639934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3d319-7a20-4a2c-a7bf-5f72c54a8836 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:35.640393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3d319-7a20-4a2c-a7bf-5f72c54a8836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:35.718954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c3d3d319-7a20-4a2c-a7bf-5f72c54a8836 None None] MFA Rules not processed for user `824915e26a724d938e5dd0a3c1f57932`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:35.722157 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c3d3d319-7a20-4a2c-a7bf-5f72c54a8836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:35.735490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 840/1695] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:36.072846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8811f-ddd4-472d-9723-9da85bf8e009 service swift] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:36.074690 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1de8811f-ddd4-472d-9723-9da85bf8e009 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:36.387321 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8811f-ddd4-472d-9723-9da85bf8e009 service swift] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:36.411858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e1a3f-e086-4152-bfaa-28304ff43837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:36.412989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e1a3f-e086-4152-bfaa-28304ff43837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:36.413410 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e1a3f-e086-4152-bfaa-28304ff43837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:36.413821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e1a3f-e086-4152-bfaa-28304ff43837 admin admin] PATH_INFO: `/v3/users/3ec0c45e973343259ecf037e00c12248` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:36.417761 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e1a3f-e086-4152-bfaa-28304ff43837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec0c45e973343259ecf037e00c12248)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:36.424335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e1a3f-e086-4152-bfaa-28304ff43837 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:36.545661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3d319-7a20-4a2c-a7bf-5f72c54a8836 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:36.547738 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c3d3d319-7a20-4a2c-a7bf-5f72c54a8836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:36.608446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-477e1a3f-e086-4152-bfaa-28304ff43837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec0c45e973343259ecf037e00c12248'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:36.610999 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3d319-7a20-4a2c-a7bf-5f72c54a8836 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:36.614874 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-477e1a3f-e086-4152-bfaa-28304ff43837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec0c45e973343259ecf037e00c12248'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:36.646939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8e073-f67d-4278-be1e-8cfe73103106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:36.663735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8e073-f67d-4278-be1e-8cfe73103106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:36.667468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8e073-f67d-4278-be1e-8cfe73103106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:36.668001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8e073-f67d-4278-be1e-8cfe73103106 admin admin] PATH_INFO: `/v3/users/611d81db704b4f0ebc1fa0414d061925` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:36.670014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8e073-f67d-4278-be1e-8cfe73103106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=611d81db704b4f0ebc1fa0414d061925)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:36.680081 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-477e1a3f-e086-4152-bfaa-28304ff43837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec0c45e973343259ecf037e00c12248'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:36.683190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8e073-f67d-4278-be1e-8cfe73103106 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:36.720159 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-477e1a3f-e086-4152-bfaa-28304ff43837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec0c45e973343259ecf037e00c12248'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:36.721954 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-477e1a3f-e086-4152-bfaa-28304ff43837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec0c45e973343259ecf037e00c12248'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:36.784625 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 856/1696] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:10:36 2022] DELETE /identity/v3/users/3ec0c45e973343259ecf037e00c12248 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:36.786776 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceed2b-8517-4d41-8d0e-8b6f2f32ec38 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:36.787082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceed2b-8517-4d41-8d0e-8b6f2f32ec38 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:36.787371 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceed2b-8517-4d41-8d0e-8b6f2f32ec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:36.875484 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f5ceed2b-8517-4d41-8d0e-8b6f2f32ec38 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:36.878657 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f5ceed2b-8517-4d41-8d0e-8b6f2f32ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:36.944045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2dc8e073-f67d-4278-be1e-8cfe73103106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '611d81db704b4f0ebc1fa0414d061925'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:37.033002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2dc8e073-f67d-4278-be1e-8cfe73103106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '611d81db704b4f0ebc1fa0414d061925'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:37.053012 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 857/1697] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:37.075280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2dc8e073-f67d-4278-be1e-8cfe73103106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '611d81db704b4f0ebc1fa0414d061925'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:37.078003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceed2b-8517-4d41-8d0e-8b6f2f32ec38 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:37.079764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f5ceed2b-8517-4d41-8d0e-8b6f2f32ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:37.081166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2dc8e073-f67d-4278-be1e-8cfe73103106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '611d81db704b4f0ebc1fa0414d061925'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:37.086984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2dc8e073-f67d-4278-be1e-8cfe73103106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '611d81db704b4f0ebc1fa0414d061925'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:37.151907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 841/1698] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:10:36 2022] DELETE /identity/v3/users/611d81db704b4f0ebc1fa0414d061925 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:37.161510 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd593db-e9d4-4934-a6eb-3dbae8a701eb None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:37.167099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd593db-e9d4-4934-a6eb-3dbae8a701eb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:37.171258 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd593db-e9d4-4934-a6eb-3dbae8a701eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:37.272024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceed2b-8517-4d41-8d0e-8b6f2f32ec38 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:37.282196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4dd593db-e9d4-4934-a6eb-3dbae8a701eb None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:37.290929 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4dd593db-e9d4-4934-a6eb-3dbae8a701eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:37.580058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c65b2-65a1-443e-b9f3-fc3347d24e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:37.582134 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c65b2-65a1-443e-b9f3-fc3347d24e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:37.582590 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c65b2-65a1-443e-b9f3-fc3347d24e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:37.584199 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c65b2-65a1-443e-b9f3-fc3347d24e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:37.591642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-167c65b2-65a1-443e-b9f3-fc3347d24e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:37.649164 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 842/1699] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:37.672153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd593db-e9d4-4934-a6eb-3dbae8a701eb None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:37.690758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4dd593db-e9d4-4934-a6eb-3dbae8a701eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:37.728887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd593db-e9d4-4934-a6eb-3dbae8a701eb None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:37.743317 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1e3e1-c6d5-472e-9738-f8055246844e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:37.745269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1e3e1-c6d5-472e-9738-f8055246844e service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:37.745662 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1e3e1-c6d5-472e-9738-f8055246844e service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:37.746044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1e3e1-c6d5-472e-9738-f8055246844e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:37.775341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1e3e1-c6d5-472e-9738-f8055246844e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:37.777204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1e3e1-c6d5-472e-9738-f8055246844e service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:37.821588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 843/1700] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:10:37.907299 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c65b2-65a1-443e-b9f3-fc3347d24e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:37.921717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c65b2-65a1-443e-b9f3-fc3347d24e15 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:37.978972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f4b92-3b64-4694-9572-083e4ab9e44a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:37.979324 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f4b92-3b64-4694-9572-083e4ab9e44a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:37.979757 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f4b92-3b64-4694-9572-083e4ab9e44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:38.003560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 858/1701] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 926 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:38.031310 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e24f4b92-3b64-4694-9572-083e4ab9e44a None None] MFA Rules not processed for user `86a0b6c88fe84ba0907d515fd9f38e72`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:38.038811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e24f4b92-3b64-4694-9572-083e4ab9e44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:38.197329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c8c93-72ac-4ada-90bd-125fbe8eba41 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:38.197595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c8c93-72ac-4ada-90bd-125fbe8eba41 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:38.197877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c8c93-72ac-4ada-90bd-125fbe8eba41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:38.218112 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 844/1702] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:38.235386 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4c6c8c93-72ac-4ada-90bd-125fbe8eba41 None None] MFA Rules not processed for user `74cc0ddf89664a6f92c84ebb9e1ab3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:38.238268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4c6c8c93-72ac-4ada-90bd-125fbe8eba41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:38.526205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 859/1703] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:38.601526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f4b92-3b64-4694-9572-083e4ab9e44a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:38.603421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e24f4b92-3b64-4694-9572-083e4ab9e44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:38.674029 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f4b92-3b64-4694-9572-083e4ab9e44a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:38.682424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16474e5a-ba26-42cd-a0ca-3952fbcb44ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:38.683933 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16474e5a-ba26-42cd-a0ca-3952fbcb44ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:38.685557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16474e5a-ba26-42cd-a0ca-3952fbcb44ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:38.686707 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16474e5a-ba26-42cd-a0ca-3952fbcb44ec admin admin] PATH_INFO: `/v3/users/e5daae5f5e7c489fa1c0e440348c2e24` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:38.688773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16474e5a-ba26-42cd-a0ca-3952fbcb44ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5daae5f5e7c489fa1c0e440348c2e24)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:38.698251 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16474e5a-ba26-42cd-a0ca-3952fbcb44ec admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:38.765840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-16474e5a-ba26-42cd-a0ca-3952fbcb44ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5daae5f5e7c489fa1c0e440348c2e24'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:38.784089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-16474e5a-ba26-42cd-a0ca-3952fbcb44ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5daae5f5e7c489fa1c0e440348c2e24'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:38.794900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-16474e5a-ba26-42cd-a0ca-3952fbcb44ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5daae5f5e7c489fa1c0e440348c2e24'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:38.796032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-16474e5a-ba26-42cd-a0ca-3952fbcb44ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5daae5f5e7c489fa1c0e440348c2e24'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:38.797252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-16474e5a-ba26-42cd-a0ca-3952fbcb44ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5daae5f5e7c489fa1c0e440348c2e24'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:38.846322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 845/1704] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:10:38 2022] DELETE /identity/v3/users/e5daae5f5e7c489fa1c0e440348c2e24 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:38.848092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20b667-4972-4094-9fda-9602d688e284 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:38.848521 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20b667-4972-4094-9fda-9602d688e284 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:38.848648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20b667-4972-4094-9fda-9602d688e284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:38.931828 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6d20b667-4972-4094-9fda-9602d688e284 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:38.934064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6d20b667-4972-4094-9fda-9602d688e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:39.122101 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 860/1705] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:39.177825 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16474e5a-ba26-42cd-a0ca-3952fbcb44ec admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:39.179589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-16474e5a-ba26-42cd-a0ca-3952fbcb44ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:39.432913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16474e5a-ba26-42cd-a0ca-3952fbcb44ec admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:39.438294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe0f19-c0a2-4ae2-af37-c3d8726f5b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:39.439427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe0f19-c0a2-4ae2-af37-c3d8726f5b9e service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:39.440021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe0f19-c0a2-4ae2-af37-c3d8726f5b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:39.440452 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe0f19-c0a2-4ae2-af37-c3d8726f5b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:39.454107 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe0f19-c0a2-4ae2-af37-c3d8726f5b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:39.456233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe0f19-c0a2-4ae2-af37-c3d8726f5b9e service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:39.480683 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 846/1706] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:40.110854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20b667-4972-4094-9fda-9602d688e284 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:40.112430 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6d20b667-4972-4094-9fda-9602d688e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:40.150441 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20b667-4972-4094-9fda-9602d688e284 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:40.162256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe0f19-c0a2-4ae2-af37-c3d8726f5b9e service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:40.166631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bfbe0f19-c0a2-4ae2-af37-c3d8726f5b9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:40.185383 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46291e58-ce8c-4df6-96e3-45a4732bf1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:40.186327 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46291e58-ce8c-4df6-96e3-45a4732bf1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:40.186616 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46291e58-ce8c-4df6-96e3-45a4732bf1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:40.186973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46291e58-ce8c-4df6-96e3-45a4732bf1b1 admin admin] PATH_INFO: `/v3/projects/d95e2dc551c24d2aaed985cacbb3b03e` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:40.189102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe0f19-c0a2-4ae2-af37-c3d8726f5b9e service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:40.199081 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46291e58-ce8c-4df6-96e3-45a4732bf1b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95e2dc551c24d2aaed985cacbb3b03e)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:40.201121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46291e58-ce8c-4df6-96e3-45a4732bf1b1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:40.203323 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551207d1-7c04-482d-bcea-31e4126ae1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:40.204367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551207d1-7c04-482d-bcea-31e4126ae1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:40.204879 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551207d1-7c04-482d-bcea-31e4126ae1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:40.205259 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551207d1-7c04-482d-bcea-31e4126ae1e6 admin admin] PATH_INFO: `/v3/projects/db7972884e6b4df686b005676e6d1b7c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:40.207555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551207d1-7c04-482d-bcea-31e4126ae1e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db7972884e6b4df686b005676e6d1b7c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:40.212815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-551207d1-7c04-482d-bcea-31e4126ae1e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 17:10:40.212815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: warnings.warn(msg) May 17 17:10:40.212815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: May 17 17:10:40.217069 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551207d1-7c04-482d-bcea-31e4126ae1e6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:40.393566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-46291e58-ce8c-4df6-96e3-45a4732bf1b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95e2dc551c24d2aaed985cacbb3b03e', 'request_id': 'req-46291e58-ce8c-4df6-96e3-45a4732bf1b1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:40.412620 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-46291e58-ce8c-4df6-96e3-45a4732bf1b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95e2dc551c24d2aaed985cacbb3b03e', 'request_id': 'req-46291e58-ce8c-4df6-96e3-45a4732bf1b1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:40.431634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-551207d1-7c04-482d-bcea-31e4126ae1e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7972884e6b4df686b005676e6d1b7c', 'request_id': 'req-551207d1-7c04-482d-bcea-31e4126ae1e6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:40.454445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-46291e58-ce8c-4df6-96e3-45a4732bf1b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95e2dc551c24d2aaed985cacbb3b03e', 'request_id': 'req-46291e58-ce8c-4df6-96e3-45a4732bf1b1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:40.461582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-551207d1-7c04-482d-bcea-31e4126ae1e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7972884e6b4df686b005676e6d1b7c', 'request_id': 'req-551207d1-7c04-482d-bcea-31e4126ae1e6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:40.484026 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-46291e58-ce8c-4df6-96e3-45a4732bf1b1 admin admin] The token cache is being invalidate because project d95e2dc551c24d2aaed985cacbb3b03e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:10:40.484283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-46291e58-ce8c-4df6-96e3-45a4732bf1b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:40.490668 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-551207d1-7c04-482d-bcea-31e4126ae1e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7972884e6b4df686b005676e6d1b7c', 'request_id': 'req-551207d1-7c04-482d-bcea-31e4126ae1e6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:40.492060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-46291e58-ce8c-4df6-96e3-45a4732bf1b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:40.499341 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 861/1707] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:10:40 2022] DELETE /identity/v3/projects/d95e2dc551c24d2aaed985cacbb3b03e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:40.500342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46291e58-ce8c-4df6-96e3-45a4732bf1b1 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:40.513898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-46291e58-ce8c-4df6-96e3-45a4732bf1b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:40.567880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-551207d1-7c04-482d-bcea-31e4126ae1e6 admin admin] The token cache is being invalidate because project db7972884e6b4df686b005676e6d1b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:10:40.569613 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-551207d1-7c04-482d-bcea-31e4126ae1e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:40.574280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-551207d1-7c04-482d-bcea-31e4126ae1e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:40.579108 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 847/1708] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:10:40 2022] DELETE /identity/v3/projects/db7972884e6b4df686b005676e6d1b7c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:40.585610 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed3029-3921-4d11-aad2-5d93c56509e1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:40.586913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed3029-3921-4d11-aad2-5d93c56509e1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:40.587558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed3029-3921-4d11-aad2-5d93c56509e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:40.640474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d1ed3029-3921-4d11-aad2-5d93c56509e1 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:40.646349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d1ed3029-3921-4d11-aad2-5d93c56509e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:40.761923 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46291e58-ce8c-4df6-96e3-45a4732bf1b1 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:40.787003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31735f1-f1b8-4c37-a94c-4c6e56ec4889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:40.787003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31735f1-f1b8-4c37-a94c-4c6e56ec4889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:40.787003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31735f1-f1b8-4c37-a94c-4c6e56ec4889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:40.787003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31735f1-f1b8-4c37-a94c-4c6e56ec4889 admin admin] PATH_INFO: `/v3/users/6423fc767fdf40b5878b1ce70688fd0e` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:40.792455 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 848/1709] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:40.802490 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31735f1-f1b8-4c37-a94c-4c6e56ec4889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6423fc767fdf40b5878b1ce70688fd0e)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:40.804878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31735f1-f1b8-4c37-a94c-4c6e56ec4889 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:40.812001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227bb2-b708-451b-b423-98f69bf106c4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:40.812553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227bb2-b708-451b-b423-98f69bf106c4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:40.813947 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89227bb2-b708-451b-b423-98f69bf106c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:40.855397 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-89227bb2-b708-451b-b423-98f69bf106c4 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:40.857749 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-89227bb2-b708-451b-b423-98f69bf106c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:40.872769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 849/1710] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:40.882653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89227bb2-b708-451b-b423-98f69bf106c4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:40.916050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c31735f1-f1b8-4c37-a94c-4c6e56ec4889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6423fc767fdf40b5878b1ce70688fd0e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:40.918286 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c31735f1-f1b8-4c37-a94c-4c6e56ec4889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6423fc767fdf40b5878b1ce70688fd0e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:40.925649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89227bb2-b708-451b-b423-98f69bf106c4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:40.941982 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66b203-e239-41b7-b26c-323a9618e5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:40.942808 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66b203-e239-41b7-b26c-323a9618e5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:40.943279 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66b203-e239-41b7-b26c-323a9618e5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:40.943758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66b203-e239-41b7-b26c-323a9618e5f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:40.945854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66b203-e239-41b7-b26c-323a9618e5f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:10:40.946415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66b203-e239-41b7-b26c-323a9618e5f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:40.952926 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66b203-e239-41b7-b26c-323a9618e5f5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:40.971138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c31735f1-f1b8-4c37-a94c-4c6e56ec4889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6423fc767fdf40b5878b1ce70688fd0e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:40.988907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 850/1711] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:10:40.993251 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66b203-e239-41b7-b26c-323a9618e5f5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:41.008448 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c31735f1-f1b8-4c37-a94c-4c6e56ec4889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6423fc767fdf40b5878b1ce70688fd0e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:41.011541 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c31735f1-f1b8-4c37-a94c-4c6e56ec4889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6423fc767fdf40b5878b1ce70688fd0e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:41.012644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66b203-e239-41b7-b26c-323a9618e5f5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:41.038402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb7059-afbc-493a-af50-1c386a17a820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:41.041279 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb7059-afbc-493a-af50-1c386a17a820 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:41.042011 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb7059-afbc-493a-af50-1c386a17a820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:41.042535 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb7059-afbc-493a-af50-1c386a17a820 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:41.044965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb7059-afbc-493a-af50-1c386a17a820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:41.049650 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb7059-afbc-493a-af50-1c386a17a820 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:41.065890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 862/1712] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:10:40 2022] DELETE /identity/v3/users/6423fc767fdf40b5878b1ce70688fd0e => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:41.117313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 851/1713] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:40 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:41.119247 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31735f1-f1b8-4c37-a94c-4c6e56ec4889 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:41.122450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c31735f1-f1b8-4c37-a94c-4c6e56ec4889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:41.266747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31735f1-f1b8-4c37-a94c-4c6e56ec4889 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:41.513747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85aab4-bedc-435e-a97e-80b531149f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:41.515800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85aab4-bedc-435e-a97e-80b531149f68 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:41.516118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85aab4-bedc-435e-a97e-80b531149f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:41.516406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85aab4-bedc-435e-a97e-80b531149f68 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:41.517133 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85aab4-bedc-435e-a97e-80b531149f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:41.529629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85aab4-bedc-435e-a97e-80b531149f68 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:41.656936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb7059-afbc-493a-af50-1c386a17a820 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:41.657573 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 863/1714] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:41 2022] POST /identity/v3/users => generated 287 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:41.673710 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb7059-afbc-493a-af50-1c386a17a820 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:41.684425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa21d7-1b3e-4cc7-bc62-bc180a3fe219 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:41.684710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa21d7-1b3e-4cc7-bc62-bc180a3fe219 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:41.686189 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa21d7-1b3e-4cc7-bc62-bc180a3fe219 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:41.687697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 864/1715] 10.222.0.48 () {54 vars in 912 bytes} [Tue May 17 17:10:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:10:41.695823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af7d57-0b07-484f-a02f-9201520dfd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:41.700698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af7d57-0b07-484f-a02f-9201520dfd8b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:41.701364 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af7d57-0b07-484f-a02f-9201520dfd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:41.701826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af7d57-0b07-484f-a02f-9201520dfd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:41.705243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af7d57-0b07-484f-a02f-9201520dfd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:41.705391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcb3e7-86fc-4bb2-9637-42cb87d512db None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:41.705609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcb3e7-86fc-4bb2-9637-42cb87d512db None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:41.705877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcb3e7-86fc-4bb2-9637-42cb87d512db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:41.715366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af7d57-0b07-484f-a02f-9201520dfd8b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:41.770563 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 852/1716] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:41.776375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af7d57-0b07-484f-a02f-9201520dfd8b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:41.805625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af7d57-0b07-484f-a02f-9201520dfd8b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:41.818777 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a42fc2-5bd0-49b4-9816-6267df163ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:41.824366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a42fc2-5bd0-49b4-9816-6267df163ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:41.824651 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a42fc2-5bd0-49b4-9816-6267df163ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:41.830166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a42fc2-5bd0-49b4-9816-6267df163ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:41.832909 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a42fc2-5bd0-49b4-9816-6267df163ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:41.840217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a42fc2-5bd0-49b4-9816-6267df163ec7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:41.880898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 853/1717] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:41.885531 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba4227-676e-41b3-816a-3e7f998f46a5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:41.885850 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba4227-676e-41b3-816a-3e7f998f46a5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:41.886120 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba4227-676e-41b3-816a-3e7f998f46a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:41.888406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-17bcb3e7-86fc-4bb2-9637-42cb87d512db None None] MFA Rules not processed for user `5819e022286b454e9e2f23d975c6e921`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:41.894367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-17bcb3e7-86fc-4bb2-9637-42cb87d512db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:41.974647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bfba4227-676e-41b3-816a-3e7f998f46a5 None None] MFA Rules not processed for user `5819e022286b454e9e2f23d975c6e921`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:41.976017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bfba4227-676e-41b3-816a-3e7f998f46a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:42.137951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 854/1718] 10.222.0.23 () {58 vars in 1015 bytes} [Tue May 17 17:10:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:42.139712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba4227-676e-41b3-816a-3e7f998f46a5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:42.176500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba4227-676e-41b3-816a-3e7f998f46a5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:42.182547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edc9ac-69ce-47e1-b66b-ec4209a63a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:42.183687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edc9ac-69ce-47e1-b66b-ec4209a63a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:42.183971 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edc9ac-69ce-47e1-b66b-ec4209a63a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:42.184250 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edc9ac-69ce-47e1-b66b-ec4209a63a26 admin admin] PATH_INFO: `/v3/projects/9fb556e657784309a9f977cba20df9fa/users/e36386b1793a4cec81f0669aea3bcb30/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:42.187939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 865/1719] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 17:10:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:42.189722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcb3e7-86fc-4bb2-9637-42cb87d512db None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:42.196973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-17bcb3e7-86fc-4bb2-9637-42cb87d512db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:42.219901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edc9ac-69ce-47e1-b66b-ec4209a63a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb556e657784309a9f977cba20df9fa, user_id=e36386b1793a4cec81f0669aea3bcb30, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:42.231596 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edc9ac-69ce-47e1-b66b-ec4209a63a26 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:42.257058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcb3e7-86fc-4bb2-9637-42cb87d512db None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:42.264992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 855/1720] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:42 2022] PUT /identity/v3/projects/9fb556e657784309a9f977cba20df9fa/users/e36386b1793a4cec81f0669aea3bcb30/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:42.276604 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6e35-bd75-442e-8979-1fef91f75b0b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:42.276901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6e35-bd75-442e-8979-1fef91f75b0b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:42.277236 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6e35-bd75-442e-8979-1fef91f75b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:42.376315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-844b6e35-bd75-442e-8979-1fef91f75b0b None None] MFA Rules not processed for user `e36386b1793a4cec81f0669aea3bcb30`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:42.380673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-844b6e35-bd75-442e-8979-1fef91f75b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:42.495194 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:42.504745 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:42.505037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:42.505538 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea admin admin] PATH_INFO: `/v3/projects/1cdbe86a9b19464daf091f9e5001bc1b` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:42.507078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cdbe86a9b19464daf091f9e5001bc1b)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:42.511087 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:42.617656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 856/1721] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:42.617656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b6e35-bd75-442e-8979-1fef91f75b0b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:42.620412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-844b6e35-bd75-442e-8979-1fef91f75b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:42.698315 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cdbe86a9b19464daf091f9e5001bc1b', 'request_id': 'req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:42.710938 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cdbe86a9b19464daf091f9e5001bc1b', 'request_id': 'req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:42.736695 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cdbe86a9b19464daf091f9e5001bc1b', 'request_id': 'req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:42.781795 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea admin admin] The token cache is being invalidate because project 1cdbe86a9b19464daf091f9e5001bc1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:10:42.782091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:42.788248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:42.795784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 866/1722] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:10:42 2022] DELETE /identity/v3/projects/1cdbe86a9b19464daf091f9e5001bc1b => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:42.803208 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:42.809139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:42.879802 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b6e35-bd75-442e-8979-1fef91f75b0b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:43.012742 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40411459-44d1-4e42-84b5-fcd51efb0ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:43.015734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40411459-44d1-4e42-84b5-fcd51efb0ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:43.016030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40411459-44d1-4e42-84b5-fcd51efb0ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:43.016318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40411459-44d1-4e42-84b5-fcd51efb0ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:43.023073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-40411459-44d1-4e42-84b5-fcd51efb0ef8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:43.046954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40411459-44d1-4e42-84b5-fcd51efb0ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:43.050953 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40411459-44d1-4e42-84b5-fcd51efb0ef8 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:43.075437 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 857/1723] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:43.076976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d698cb-3c7d-4977-bc3b-865f1640085b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:43.079063 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d698cb-3c7d-4977-bc3b-865f1640085b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:43.079435 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d698cb-3c7d-4977-bc3b-865f1640085b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:43.091753 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adb5a2-5542-4d11-922e-e0dd3e9d15ea admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:43.104799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-66d698cb-3c7d-4977-bc3b-865f1640085b None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:43.106322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-66d698cb-3c7d-4977-bc3b-865f1640085b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:43.125924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543c755-214b-455e-ab5a-28032efd9045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:43.126822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543c755-214b-455e-ab5a-28032efd9045 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:43.147317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543c755-214b-455e-ab5a-28032efd9045 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:43.149950 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543c755-214b-455e-ab5a-28032efd9045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:43.160580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f543c755-214b-455e-ab5a-28032efd9045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:43.195284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543c755-214b-455e-ab5a-28032efd9045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:43.198175 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543c755-214b-455e-ab5a-28032efd9045 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:43.232226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 867/1724] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:43.236306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543c755-214b-455e-ab5a-28032efd9045 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:43.249524 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f543c755-214b-455e-ab5a-28032efd9045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:43.285070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 858/1725] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:43.286439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d698cb-3c7d-4977-bc3b-865f1640085b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:43.294169 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-66d698cb-3c7d-4977-bc3b-865f1640085b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:43.295542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543c755-214b-455e-ab5a-28032efd9045 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:43.315143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2059aa2-52e0-48af-b8d1-53943249b36b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:43.316402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2059aa2-52e0-48af-b8d1-53943249b36b service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:43.316922 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2059aa2-52e0-48af-b8d1-53943249b36b service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:43.317457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2059aa2-52e0-48af-b8d1-53943249b36b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:43.346372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d698cb-3c7d-4977-bc3b-865f1640085b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:43.353329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2059aa2-52e0-48af-b8d1-53943249b36b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:43.356277 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2059aa2-52e0-48af-b8d1-53943249b36b service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:43.365057 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a54875-a684-4c3c-8dca-618ce3736049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:43.367044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a54875-a684-4c3c-8dca-618ce3736049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:43.367336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a54875-a684-4c3c-8dca-618ce3736049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:43.367690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a54875-a684-4c3c-8dca-618ce3736049 admin admin] PATH_INFO: `/v3/projects/affa04dcddb049af862886ae9f526353` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:43.371773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a54875-a684-4c3c-8dca-618ce3736049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=affa04dcddb049af862886ae9f526353)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:43.376456 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a54875-a684-4c3c-8dca-618ce3736049 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:43.421048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 868/1726] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:43.459526 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca4160-5e41-47ad-9634-a10cebf558c9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:43.466110 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca4160-5e41-47ad-9634-a10cebf558c9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:43.467884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca4160-5e41-47ad-9634-a10cebf558c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:43.546333 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3bca4160-5e41-47ad-9634-a10cebf558c9 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:43.553371 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3bca4160-5e41-47ad-9634-a10cebf558c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:43.590514 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a1a54875-a684-4c3c-8dca-618ce3736049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'affa04dcddb049af862886ae9f526353', 'request_id': 'req-a1a54875-a684-4c3c-8dca-618ce3736049'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:43.616506 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a1a54875-a684-4c3c-8dca-618ce3736049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'affa04dcddb049af862886ae9f526353', 'request_id': 'req-a1a54875-a684-4c3c-8dca-618ce3736049'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:43.642592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a1a54875-a684-4c3c-8dca-618ce3736049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'affa04dcddb049af862886ae9f526353', 'request_id': 'req-a1a54875-a684-4c3c-8dca-618ce3736049'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:43.705360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a1a54875-a684-4c3c-8dca-618ce3736049 admin admin] The token cache is being invalidate because project affa04dcddb049af862886ae9f526353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:10:43.707420 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a1a54875-a684-4c3c-8dca-618ce3736049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:43.715507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a1a54875-a684-4c3c-8dca-618ce3736049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:43.719249 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 859/1727] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:10:43 2022] DELETE /identity/v3/projects/affa04dcddb049af862886ae9f526353 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:43.724158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a54875-a684-4c3c-8dca-618ce3736049 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:43.729091 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a1a54875-a684-4c3c-8dca-618ce3736049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:43.805152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 869/1728] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:43.810040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca4160-5e41-47ad-9634-a10cebf558c9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:43.832755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca4160-5e41-47ad-9634-a10cebf558c9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:43.850057 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdbd90-839b-40d5-ae59-f3e5d80336bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:43.851726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdbd90-839b-40d5-ae59-f3e5d80336bb admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:43.854315 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdbd90-839b-40d5-ae59-f3e5d80336bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:43.855202 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdbd90-839b-40d5-ae59-f3e5d80336bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:43.856231 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdbd90-839b-40d5-ae59-f3e5d80336bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:10:43.857736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdbd90-839b-40d5-ae59-f3e5d80336bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:43.861200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdbd90-839b-40d5-ae59-f3e5d80336bb admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:43.903822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 870/1729] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:10:43.909654 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdbd90-839b-40d5-ae59-f3e5d80336bb admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:43.937054 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a54875-a684-4c3c-8dca-618ce3736049 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:43.939744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdbd90-839b-40d5-ae59-f3e5d80336bb admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:43.950531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d065f7-4ac5-4f24-b055-68e1c8c3e47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:43.953404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2151119-4de1-4412-9d22-4c5fc476cbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:43.955035 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d065f7-4ac5-4f24-b055-68e1c8c3e47e admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:43.955446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d065f7-4ac5-4f24-b055-68e1c8c3e47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:43.955938 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2151119-4de1-4412-9d22-4c5fc476cbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:43.956342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d065f7-4ac5-4f24-b055-68e1c8c3e47e admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:43.957261 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2151119-4de1-4412-9d22-4c5fc476cbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:43.957643 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2151119-4de1-4412-9d22-4c5fc476cbd6 admin admin] PATH_INFO: `/v3/users/74b12e47cbb8483a89dded4f05790a0e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:43.957989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d065f7-4ac5-4f24-b055-68e1c8c3e47e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:43.963020 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2151119-4de1-4412-9d22-4c5fc476cbd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b12e47cbb8483a89dded4f05790a0e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:43.977883 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d065f7-4ac5-4f24-b055-68e1c8c3e47e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:43.979184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2151119-4de1-4412-9d22-4c5fc476cbd6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:44.084280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 871/1730] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:43 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:44.090036 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d065f7-4ac5-4f24-b055-68e1c8c3e47e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:44.161484 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c2151119-4de1-4412-9d22-4c5fc476cbd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b12e47cbb8483a89dded4f05790a0e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:44.202704 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c2151119-4de1-4412-9d22-4c5fc476cbd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b12e47cbb8483a89dded4f05790a0e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:44.227558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c2151119-4de1-4412-9d22-4c5fc476cbd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b12e47cbb8483a89dded4f05790a0e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:44.230161 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c2151119-4de1-4412-9d22-4c5fc476cbd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b12e47cbb8483a89dded4f05790a0e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:44.233792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c2151119-4de1-4412-9d22-4c5fc476cbd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b12e47cbb8483a89dded4f05790a0e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:44.269148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 860/1731] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:10:43 2022] DELETE /identity/v3/users/74b12e47cbb8483a89dded4f05790a0e => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:44.295204 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d065f7-4ac5-4f24-b055-68e1c8c3e47e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:44.370061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35f93e-f416-40d9-b48a-8207626bb7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:44.371569 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35f93e-f416-40d9-b48a-8207626bb7fd admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:44.372148 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35f93e-f416-40d9-b48a-8207626bb7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:44.372839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35f93e-f416-40d9-b48a-8207626bb7fd admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:44.374189 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35f93e-f416-40d9-b48a-8207626bb7fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:44.376519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35f93e-f416-40d9-b48a-8207626bb7fd admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:44.408153 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 872/1732] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:44 2022] POST /identity/v3/users => generated 290 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:10:44.413594 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2151119-4de1-4412-9d22-4c5fc476cbd6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:44.416550 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c2151119-4de1-4412-9d22-4c5fc476cbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:44.466641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2151119-4de1-4412-9d22-4c5fc476cbd6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:44.484756 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8afea-fd47-4390-ac03-7c3b78193d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:44.488665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8afea-fd47-4390-ac03-7c3b78193d0b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:44.488999 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8afea-fd47-4390-ac03-7c3b78193d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:44.489280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8afea-fd47-4390-ac03-7c3b78193d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:44.490136 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8afea-fd47-4390-ac03-7c3b78193d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:44.491845 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8afea-fd47-4390-ac03-7c3b78193d0b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:44.542135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 861/1733] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:44.544000 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35f93e-f416-40d9-b48a-8207626bb7fd admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:44.575176 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35f93e-f416-40d9-b48a-8207626bb7fd admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:44.582289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a59c1-2dce-43f5-8be1-3e2fb51fea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:44.599197 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a59c1-2dce-43f5-8be1-3e2fb51fea99 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:44.599631 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a59c1-2dce-43f5-8be1-3e2fb51fea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:44.600634 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a59c1-2dce-43f5-8be1-3e2fb51fea99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:44.603396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a59c1-2dce-43f5-8be1-3e2fb51fea99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:44.604826 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a59c1-2dce-43f5-8be1-3e2fb51fea99 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:44.631048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 873/1734] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:44.631292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8afea-fd47-4390-ac03-7c3b78193d0b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:44.644933 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8afea-fd47-4390-ac03-7c3b78193d0b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:44.673059 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737aa935-d2fc-4536-b142-4fbc8f064925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:44.673844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737aa935-d2fc-4536-b142-4fbc8f064925 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:44.674534 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737aa935-d2fc-4536-b142-4fbc8f064925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:44.674534 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737aa935-d2fc-4536-b142-4fbc8f064925 admin admin] PATH_INFO: `/v3/projects/e96c1872059d462cb28ddd686ddd1179/users/83cb94b8fb7e4419941fa744abadddba/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:44.753137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737aa935-d2fc-4536-b142-4fbc8f064925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96c1872059d462cb28ddd686ddd1179, user_id=83cb94b8fb7e4419941fa744abadddba, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:44.755921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737aa935-d2fc-4536-b142-4fbc8f064925 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:44.809797 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 862/1735] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:44 2022] PUT /identity/v3/projects/e96c1872059d462cb28ddd686ddd1179/users/83cb94b8fb7e4419941fa744abadddba/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:44.819143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5de3-c8c1-46d7-9aa5-0c1510526441 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:44.821017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5de3-c8c1-46d7-9aa5-0c1510526441 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:44.824979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5de3-c8c1-46d7-9aa5-0c1510526441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:44.901844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-915b5de3-c8c1-46d7-9aa5-0c1510526441 None None] MFA Rules not processed for user `83cb94b8fb7e4419941fa744abadddba`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:44.904674 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-915b5de3-c8c1-46d7-9aa5-0c1510526441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:45.095985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737aa935-d2fc-4536-b142-4fbc8f064925 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:45.100958 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-737aa935-d2fc-4536-b142-4fbc8f064925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:45.225990 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 874/1736] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:45.230499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b5de3-c8c1-46d7-9aa5-0c1510526441 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:45.400263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737aa935-d2fc-4536-b142-4fbc8f064925 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:45.422332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bf097-639f-450f-b639-30332bad1187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:45.423039 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf097-639f-450f-b639-30332bad1187 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:45.423296 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf097-639f-450f-b639-30332bad1187 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:45.434892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf097-639f-450f-b639-30332bad1187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:45.448499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-867bf097-639f-450f-b639-30332bad1187 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:45.464995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b5de3-c8c1-46d7-9aa5-0c1510526441 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:45.480395 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e98fe-8005-422a-ba33-fb3fe9fdf2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:45.481096 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e98fe-8005-422a-ba33-fb3fe9fdf2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:45.481385 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e98fe-8005-422a-ba33-fb3fe9fdf2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:45.481805 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e98fe-8005-422a-ba33-fb3fe9fdf2e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:45.482400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e98fe-8005-422a-ba33-fb3fe9fdf2e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:45.491086 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e98fe-8005-422a-ba33-fb3fe9fdf2e1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:45.677095 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 875/1737] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:45 2022] POST /identity/v3/projects => generated 379 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:10:45.682656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e98fe-8005-422a-ba33-fb3fe9fdf2e1 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:45.756509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bf097-639f-450f-b639-30332bad1187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:45.764523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bf097-639f-450f-b639-30332bad1187 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:45.809526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 863/1738] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:46.303901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e98fe-8005-422a-ba33-fb3fe9fdf2e1 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:46.329368 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c492892-44eb-4687-97f8-a6e83b668ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:46.330101 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c492892-44eb-4687-97f8-a6e83b668ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:46.332918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c492892-44eb-4687-97f8-a6e83b668ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:46.334807 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c492892-44eb-4687-97f8-a6e83b668ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:46.336029 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c492892-44eb-4687-97f8-a6e83b668ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:46.341811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c492892-44eb-4687-97f8-a6e83b668ad7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:46.407060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 876/1739] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:45 2022] POST /identity/v3/users => generated 290 bytes in 726 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:46.411357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bf097-639f-450f-b639-30332bad1187 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:46.476451 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bf097-639f-450f-b639-30332bad1187 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:46.503246 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec359eee-9825-4c4d-b084-7952b27791fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:46.521741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec359eee-9825-4c4d-b084-7952b27791fa admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:46.521741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec359eee-9825-4c4d-b084-7952b27791fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:46.521741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec359eee-9825-4c4d-b084-7952b27791fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:46.521741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec359eee-9825-4c4d-b084-7952b27791fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:46.544610 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec359eee-9825-4c4d-b084-7952b27791fa admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:46.582445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c492892-44eb-4687-97f8-a6e83b668ad7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:46.593458 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 864/1740] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:46.617721 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c492892-44eb-4687-97f8-a6e83b668ad7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:46.636576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2c718-f98b-4c5c-8f5d-77ce4ce5424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:46.637453 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2c718-f98b-4c5c-8f5d-77ce4ce5424c admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:46.651507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2c718-f98b-4c5c-8f5d-77ce4ce5424c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:46.651938 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2c718-f98b-4c5c-8f5d-77ce4ce5424c admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:46.656122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2c718-f98b-4c5c-8f5d-77ce4ce5424c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:46.661519 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2c718-f98b-4c5c-8f5d-77ce4ce5424c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:46.706863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 877/1741] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:46.713383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec359eee-9825-4c4d-b084-7952b27791fa admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:46.726807 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec359eee-9825-4c4d-b084-7952b27791fa admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:46.755072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7955286-e7e9-4046-bd17-87fcf41ab620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:46.757485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7955286-e7e9-4046-bd17-87fcf41ab620 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:46.757797 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7955286-e7e9-4046-bd17-87fcf41ab620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:46.758054 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7955286-e7e9-4046-bd17-87fcf41ab620 admin admin] PATH_INFO: `/v3/projects/a96c087b28da46e7a8bf48338b229b40/users/b204abaf5f6a40fcac83afa67bce7437/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:46.819312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7955286-e7e9-4046-bd17-87fcf41ab620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a96c087b28da46e7a8bf48338b229b40, user_id=b204abaf5f6a40fcac83afa67bce7437, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:46.828903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7955286-e7e9-4046-bd17-87fcf41ab620 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:46.889579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 865/1742] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:46 2022] PUT /identity/v3/projects/a96c087b28da46e7a8bf48338b229b40/users/b204abaf5f6a40fcac83afa67bce7437/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:46.909981 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff389-960c-4ca6-8dde-0a9672d66826 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:46.910256 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff389-960c-4ca6-8dde-0a9672d66826 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:46.910544 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff389-960c-4ca6-8dde-0a9672d66826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:47.020184 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-da6ff389-960c-4ca6-8dde-0a9672d66826 None None] MFA Rules not processed for user `b204abaf5f6a40fcac83afa67bce7437`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:47.032560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-da6ff389-960c-4ca6-8dde-0a9672d66826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:47.271303 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 878/1743] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:47.276211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7955286-e7e9-4046-bd17-87fcf41ab620 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:47.353139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ff389-960c-4ca6-8dde-0a9672d66826 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:47.355001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-da6ff389-960c-4ca6-8dde-0a9672d66826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:47.439303 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7955286-e7e9-4046-bd17-87fcf41ab620 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:47.454649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df086d3-98d2-47d8-95f3-484b26cf6729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:47.455964 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df086d3-98d2-47d8-95f3-484b26cf6729 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:47.464638 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df086d3-98d2-47d8-95f3-484b26cf6729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:47.465157 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df086d3-98d2-47d8-95f3-484b26cf6729 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:47.465311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ff389-960c-4ca6-8dde-0a9672d66826 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:47.466269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df086d3-98d2-47d8-95f3-484b26cf6729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:47.474853 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df086d3-98d2-47d8-95f3-484b26cf6729 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:47.478879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7de0a5-a48d-4146-bbab-118d192cce7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:47.480047 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7de0a5-a48d-4146-bbab-118d192cce7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:47.480542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7de0a5-a48d-4146-bbab-118d192cce7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:47.480961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7de0a5-a48d-4146-bbab-118d192cce7f admin admin] PATH_INFO: `/v3/users/e36386b1793a4cec81f0669aea3bcb30` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:47.482623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7de0a5-a48d-4146-bbab-118d192cce7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e36386b1793a4cec81f0669aea3bcb30)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:47.488002 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7de0a5-a48d-4146-bbab-118d192cce7f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:47.538794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 866/1744] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:47 2022] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:10:47.542831 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df086d3-98d2-47d8-95f3-484b26cf6729 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:47.582099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6f7de0a5-a48d-4146-bbab-118d192cce7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e36386b1793a4cec81f0669aea3bcb30'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:47.583287 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6f7de0a5-a48d-4146-bbab-118d192cce7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e36386b1793a4cec81f0669aea3bcb30'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:47.621626 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6f7de0a5-a48d-4146-bbab-118d192cce7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e36386b1793a4cec81f0669aea3bcb30'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:47.639492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6f7de0a5-a48d-4146-bbab-118d192cce7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e36386b1793a4cec81f0669aea3bcb30'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:47.641430 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6f7de0a5-a48d-4146-bbab-118d192cce7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e36386b1793a4cec81f0669aea3bcb30'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:47.667965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 879/1745] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:10:47 2022] DELETE /identity/v3/users/e36386b1793a4cec81f0669aea3bcb30 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:47.673442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e61d89-2cfe-4c61-906c-30dc05125d31 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:47.674145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e61d89-2cfe-4c61-906c-30dc05125d31 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:47.674636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e61d89-2cfe-4c61-906c-30dc05125d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:47.701368 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-01e61d89-2cfe-4c61-906c-30dc05125d31 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:47.703537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-01e61d89-2cfe-4c61-906c-30dc05125d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:47.744120 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df086d3-98d2-47d8-95f3-484b26cf6729 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:47.810155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 880/1746] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:47.897455 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b6641-a818-4f46-8fc2-f0d4dba791e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:47.898201 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b6641-a818-4f46-8fc2-f0d4dba791e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:47.898504 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b6641-a818-4f46-8fc2-f0d4dba791e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:47.898967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b6641-a818-4f46-8fc2-f0d4dba791e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:47.900338 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b6641-a818-4f46-8fc2-f0d4dba791e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:47.902787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b6641-a818-4f46-8fc2-f0d4dba791e5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:47.967221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 867/1747] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:47 2022] POST /identity/v3/users => generated 295 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:47.971396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e61d89-2cfe-4c61-906c-30dc05125d31 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:47.985541 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-01e61d89-2cfe-4c61-906c-30dc05125d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:48.004662 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e61d89-2cfe-4c61-906c-30dc05125d31 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:48.013429 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af03d25-6b3e-4fcb-8cec-4a545aa8791f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:48.016676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af03d25-6b3e-4fcb-8cec-4a545aa8791f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:48.017160 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af03d25-6b3e-4fcb-8cec-4a545aa8791f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:48.017615 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af03d25-6b3e-4fcb-8cec-4a545aa8791f admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:48.018797 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b3ea2-0b57-437c-818b-ea5603e12898 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:48.019348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b3ea2-0b57-437c-818b-ea5603e12898 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:48.019799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af03d25-6b3e-4fcb-8cec-4a545aa8791f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:48.019928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b3ea2-0b57-437c-818b-ea5603e12898 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:48.025354 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 868/1748] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 17:10:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:10:48.026765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b3ea2-0b57-437c-818b-ea5603e12898 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:48.029768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c41b3ea2-0b57-437c-818b-ea5603e12898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:48.053644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af03d25-6b3e-4fcb-8cec-4a545aa8791f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:48.077491 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 881/1749] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:48.079698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01580e28-9630-490f-bdc1-228ffd1455ff None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:48.080183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01580e28-9630-490f-bdc1-228ffd1455ff None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:48.080601 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01580e28-9630-490f-bdc1-228ffd1455ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:48.116677 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-01580e28-9630-490f-bdc1-228ffd1455ff None None] MFA Rules not processed for user `5becb135afbd43e9bc0b1347ba04e2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:48.119260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-01580e28-9630-490f-bdc1-228ffd1455ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:48.313956 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b3ea2-0b57-437c-818b-ea5603e12898 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:48.330782 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd812ef5-ca04-4dec-8039-2a801b8ceb87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:48.333413 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd812ef5-ca04-4dec-8039-2a801b8ceb87 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:48.333742 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd812ef5-ca04-4dec-8039-2a801b8ceb87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:48.334025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd812ef5-ca04-4dec-8039-2a801b8ceb87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:48.374256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd812ef5-ca04-4dec-8039-2a801b8ceb87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:48.375977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd812ef5-ca04-4dec-8039-2a801b8ceb87 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:48.401481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 882/1750] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 17:10:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:48.402403 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01580e28-9630-490f-bdc1-228ffd1455ff None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:48.412783 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 869/1751] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:48.416092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01580e28-9630-490f-bdc1-228ffd1455ff None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:48.419287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd812ef5-ca04-4dec-8039-2a801b8ceb87 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:48.423050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63b387-32f2-44ee-b6e1-275d7905da77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:48.425795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bd812ef5-ca04-4dec-8039-2a801b8ceb87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:48.428475 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63b387-32f2-44ee-b6e1-275d7905da77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:48.428762 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63b387-32f2-44ee-b6e1-275d7905da77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:48.429047 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63b387-32f2-44ee-b6e1-275d7905da77 admin admin] PATH_INFO: `/v3/projects/e4c8e3a089274bd0808e0cd7acaa848c/users/d463d7ce3a8f436c9b3888d7f370ad06/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:48.455425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63b387-32f2-44ee-b6e1-275d7905da77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c8e3a089274bd0808e0cd7acaa848c, user_id=d463d7ce3a8f436c9b3888d7f370ad06, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:48.458761 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63b387-32f2-44ee-b6e1-275d7905da77 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:48.472862 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd812ef5-ca04-4dec-8039-2a801b8ceb87 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:48.501865 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 883/1752] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:48 2022] PUT /identity/v3/projects/e4c8e3a089274bd0808e0cd7acaa848c/users/d463d7ce3a8f436c9b3888d7f370ad06/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:48.506333 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63b387-32f2-44ee-b6e1-275d7905da77 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:48.559360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:48.560406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:48.560787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:48.561171 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb admin admin] PATH_INFO: `/v3/projects/532999c435224fb6846f8deae2a96d9a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:48.562587 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=532999c435224fb6846f8deae2a96d9a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:48.564688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:48.720038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532999c435224fb6846f8deae2a96d9a', 'request_id': 'req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:48.739061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532999c435224fb6846f8deae2a96d9a', 'request_id': 'req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:48.750746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63b387-32f2-44ee-b6e1-275d7905da77 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:48.758012 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532999c435224fb6846f8deae2a96d9a', 'request_id': 'req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:48.790493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb admin admin] The token cache is being invalidate because project 532999c435224fb6846f8deae2a96d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:10:48.790706 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:48.793219 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:48.809430 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 870/1753] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:10:48 2022] DELETE /identity/v3/projects/532999c435224fb6846f8deae2a96d9a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:48.810767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:48.813594 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:48.922512 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa239b-0afd-45be-8130-8d07ba2cc64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:48.923196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa239b-0afd-45be-8130-8d07ba2cc64e admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:48.925623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa239b-0afd-45be-8130-8d07ba2cc64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:48.925912 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa239b-0afd-45be-8130-8d07ba2cc64e admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:48.926665 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa239b-0afd-45be-8130-8d07ba2cc64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:48.932138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa239b-0afd-45be-8130-8d07ba2cc64e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:48.960851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 884/1754] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:48.965578 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376149d-7731-4a9c-90a3-fa8fcde09ece None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:48.966035 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376149d-7731-4a9c-90a3-fa8fcde09ece None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:48.969259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376149d-7731-4a9c-90a3-fa8fcde09ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:49.037817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2aaa8-1f8b-4536-84a2-40022018e0eb admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:49.047741 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a376149d-7731-4a9c-90a3-fa8fcde09ece None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:49.049781 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a376149d-7731-4a9c-90a3-fa8fcde09ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:49.051178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93dfaaa-bf98-4b4c-9c57-4e2e5fc4f210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:49.053403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dfaaa-bf98-4b4c-9c57-4e2e5fc4f210 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:49.053771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dfaaa-bf98-4b4c-9c57-4e2e5fc4f210 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:49.054104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dfaaa-bf98-4b4c-9c57-4e2e5fc4f210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:49.060389 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d93dfaaa-bf98-4b4c-9c57-4e2e5fc4f210 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:49.073656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 885/1755] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:49.074612 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376149d-7731-4a9c-90a3-fa8fcde09ece None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:49.076302 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a376149d-7731-4a9c-90a3-fa8fcde09ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:49.103438 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93dfaaa-bf98-4b4c-9c57-4e2e5fc4f210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:49.106196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376149d-7731-4a9c-90a3-fa8fcde09ece None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:49.106510 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93dfaaa-bf98-4b4c-9c57-4e2e5fc4f210 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:49.113837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7160e0-66d0-4f0f-9d42-89a9dead949f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:49.115035 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7160e0-66d0-4f0f-9d42-89a9dead949f admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:49.115326 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7160e0-66d0-4f0f-9d42-89a9dead949f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:49.115683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7160e0-66d0-4f0f-9d42-89a9dead949f admin admin] PATH_INFO: `/v3/projects/e4c8e3a089274bd0808e0cd7acaa848c/users/d463d7ce3a8f436c9b3888d7f370ad06/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:49.120515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7160e0-66d0-4f0f-9d42-89a9dead949f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c8e3a089274bd0808e0cd7acaa848c, user_id=d463d7ce3a8f436c9b3888d7f370ad06, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:49.125878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7160e0-66d0-4f0f-9d42-89a9dead949f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:49.132004 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 871/1756] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:49.134130 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b0122-72ee-49d4-adc3-c07559294790 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:49.140091 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b0122-72ee-49d4-adc3-c07559294790 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:49.140565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b0122-72ee-49d4-adc3-c07559294790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:49.159228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 886/1757] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:49 2022] PUT /identity/v3/projects/e4c8e3a089274bd0808e0cd7acaa848c/users/d463d7ce3a8f436c9b3888d7f370ad06/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:49.170745 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dbefc-1678-4d0d-ae19-d3ae6b7636fe None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:49.171045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dbefc-1678-4d0d-ae19-d3ae6b7636fe None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:49.171330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dbefc-1678-4d0d-ae19-d3ae6b7636fe None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:49.174716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 887/1758] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 17:10:49 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:10:49.176375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9f3b0122-72ee-49d4-adc3-c07559294790 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:49.177895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9f3b0122-72ee-49d4-adc3-c07559294790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:49.182217 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cd08f-eecf-43f3-ab75-99906a4676c2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:49.182521 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cd08f-eecf-43f3-ab75-99906a4676c2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:49.182769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cd08f-eecf-43f3-ab75-99906a4676c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:49.293386 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0e2cd08f-eecf-43f3-ab75-99906a4676c2 None None] MFA Rules not processed for user `d463d7ce3a8f436c9b3888d7f370ad06`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:49.295225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0e2cd08f-eecf-43f3-ab75-99906a4676c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:49.388171 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 872/1759] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:49.393126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b0122-72ee-49d4-adc3-c07559294790 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:49.408734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b0122-72ee-49d4-adc3-c07559294790 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:49.443074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcc439-df87-4b64-a024-f831689e7488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:49.447931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcc439-df87-4b64-a024-f831689e7488 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:49.448341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcc439-df87-4b64-a024-f831689e7488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:49.448862 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcc439-df87-4b64-a024-f831689e7488 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:49.450630 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcc439-df87-4b64-a024-f831689e7488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:10:49.451152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcc439-df87-4b64-a024-f831689e7488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:49.453521 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcc439-df87-4b64-a024-f831689e7488 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:49.497098 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 873/1760] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:10:49.503124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcc439-df87-4b64-a024-f831689e7488 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:49.575023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 888/1761] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:49.589063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cd08f-eecf-43f3-ab75-99906a4676c2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:49.601580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0e2cd08f-eecf-43f3-ab75-99906a4676c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:49.628038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcc439-df87-4b64-a024-f831689e7488 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:49.647630 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f324e0-ce6b-4d61-b0d7-06f2dffb3569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:49.655716 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f324e0-ce6b-4d61-b0d7-06f2dffb3569 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:49.656249 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f324e0-ce6b-4d61-b0d7-06f2dffb3569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:49.657645 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f324e0-ce6b-4d61-b0d7-06f2dffb3569 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:49.659170 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f324e0-ce6b-4d61-b0d7-06f2dffb3569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:49.669339 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f324e0-ce6b-4d61-b0d7-06f2dffb3569 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:49.746818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cd08f-eecf-43f3-ab75-99906a4676c2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:49.755293 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8518a0-0634-43e4-a9e3-d434801c05b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:49.755975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8518a0-0634-43e4-a9e3-d434801c05b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:49.756273 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8518a0-0634-43e4-a9e3-d434801c05b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:49.756534 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8518a0-0634-43e4-a9e3-d434801c05b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:49.776298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8518a0-0634-43e4-a9e3-d434801c05b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:49.777764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8518a0-0634-43e4-a9e3-d434801c05b1 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:49.814228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 889/1763] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:49.815304 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 874/1763] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:49 2022] POST /identity/v3/projects => generated 385 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:49.817048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d3203-9626-494f-a182-5aec430ddaf2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:49.817343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d3203-9626-494f-a182-5aec430ddaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:49.817639 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d3203-9626-494f-a182-5aec430ddaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:49.818727 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f324e0-ce6b-4d61-b0d7-06f2dffb3569 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:49.901444 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-145d3203-9626-494f-a182-5aec430ddaf2 None None] MFA Rules not processed for user `5becb135afbd43e9bc0b1347ba04e2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:49.902955 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-145d3203-9626-494f-a182-5aec430ddaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:50.029686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f324e0-ce6b-4d61-b0d7-06f2dffb3569 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:50.041304 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b72a1-06d7-4856-bc2b-d02db6470350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:50.041994 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b72a1-06d7-4856-bc2b-d02db6470350 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:50.042846 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b72a1-06d7-4856-bc2b-d02db6470350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:50.043054 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b72a1-06d7-4856-bc2b-d02db6470350 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:50.043786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b72a1-06d7-4856-bc2b-d02db6470350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:50.046000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b72a1-06d7-4856-bc2b-d02db6470350 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:50.072444 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 890/1764] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 17:10:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:50.075579 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d3203-9626-494f-a182-5aec430ddaf2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:50.077364 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-145d3203-9626-494f-a182-5aec430ddaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:50.095336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 875/1765] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:49 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:50.103173 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b72a1-06d7-4856-bc2b-d02db6470350 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:50.126206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b72a1-06d7-4856-bc2b-d02db6470350 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:50.139369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628c72a-32a6-42f0-b621-1352bbda0514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:50.140454 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628c72a-32a6-42f0-b621-1352bbda0514 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:50.140454 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628c72a-32a6-42f0-b621-1352bbda0514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:50.140741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628c72a-32a6-42f0-b621-1352bbda0514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:50.144538 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628c72a-32a6-42f0-b621-1352bbda0514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:50.147208 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628c72a-32a6-42f0-b621-1352bbda0514 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:50.180054 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 876/1766] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:10:50.183341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628c72a-32a6-42f0-b621-1352bbda0514 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:50.201620 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628c72a-32a6-42f0-b621-1352bbda0514 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:50.216431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15502b84-e4f7-41d6-ad06-c8f794a6f10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:50.218323 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15502b84-e4f7-41d6-ad06-c8f794a6f10d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:50.218323 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15502b84-e4f7-41d6-ad06-c8f794a6f10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:50.220138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15502b84-e4f7-41d6-ad06-c8f794a6f10d admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:50.220914 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15502b84-e4f7-41d6-ad06-c8f794a6f10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:50.222691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15502b84-e4f7-41d6-ad06-c8f794a6f10d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:50.226474 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d3203-9626-494f-a182-5aec430ddaf2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:50.238679 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4faae10-90f9-4c88-8ca2-0bc7688a5953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:50.239390 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4faae10-90f9-4c88-8ca2-0bc7688a5953 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:50.239694 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4faae10-90f9-4c88-8ca2-0bc7688a5953 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:50.239951 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4faae10-90f9-4c88-8ca2-0bc7688a5953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:50.245341 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b4faae10-90f9-4c88-8ca2-0bc7688a5953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:50.257756 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 877/1767] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:50.260966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15502b84-e4f7-41d6-ad06-c8f794a6f10d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:50.288357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15502b84-e4f7-41d6-ad06-c8f794a6f10d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:50.306387 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc198207-2c38-4f2b-a001-f94787196569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:50.307070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc198207-2c38-4f2b-a001-f94787196569 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:50.307353 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc198207-2c38-4f2b-a001-f94787196569 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:50.307649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc198207-2c38-4f2b-a001-f94787196569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:50.318062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc198207-2c38-4f2b-a001-f94787196569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:50.319886 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc198207-2c38-4f2b-a001-f94787196569 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:50.333632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 878/1768] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:50.334472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc198207-2c38-4f2b-a001-f94787196569 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:50.346032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc198207-2c38-4f2b-a001-f94787196569 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:50.351648 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c50a0-b0bc-4a18-8ed3-b5af3d5f1150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:50.353289 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c50a0-b0bc-4a18-8ed3-b5af3d5f1150 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:50.353614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c50a0-b0bc-4a18-8ed3-b5af3d5f1150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:50.353921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c50a0-b0bc-4a18-8ed3-b5af3d5f1150 admin admin] PATH_INFO: `/v3/projects/0e4d6d3a006c486ca5f752c6f0c6f411/users/e1f0e71e0a34494a876ad3318cb25d68/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:50.370324 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4faae10-90f9-4c88-8ca2-0bc7688a5953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:50.372607 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4faae10-90f9-4c88-8ca2-0bc7688a5953 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:50.374944 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c50a0-b0bc-4a18-8ed3-b5af3d5f1150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4d6d3a006c486ca5f752c6f0c6f411, user_id=e1f0e71e0a34494a876ad3318cb25d68, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:50.378290 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c50a0-b0bc-4a18-8ed3-b5af3d5f1150 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:50.386241 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 891/1769] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:50.421339 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 879/1770] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:50 2022] PUT /identity/v3/projects/0e4d6d3a006c486ca5f752c6f0c6f411/users/e1f0e71e0a34494a876ad3318cb25d68/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:50.432705 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5f7a4-ab52-4410-a0c3-63a284cee692 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:50.433092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5f7a4-ab52-4410-a0c3-63a284cee692 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:50.433566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5f7a4-ab52-4410-a0c3-63a284cee692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:50.469670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c50a0-b0bc-4a18-8ed3-b5af3d5f1150 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:50.471715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f34c50a0-b0bc-4a18-8ed3-b5af3d5f1150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:50.514669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1bf5f7a4-ab52-4410-a0c3-63a284cee692 None None] MFA Rules not processed for user `e1f0e71e0a34494a876ad3318cb25d68`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:50.516011 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1bf5f7a4-ab52-4410-a0c3-63a284cee692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:50.638326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c50a0-b0bc-4a18-8ed3-b5af3d5f1150 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:50.649230 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68fcfc4-2095-491a-9962-c524b3564002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:50.650820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fcfc4-2095-491a-9962-c524b3564002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:50.652028 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fcfc4-2095-491a-9962-c524b3564002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:50.652330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fcfc4-2095-491a-9962-c524b3564002 admin admin] PATH_INFO: `/v3/projects/9fb556e657784309a9f977cba20df9fa` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:50.655387 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68fcfc4-2095-491a-9962-c524b3564002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb556e657784309a9f977cba20df9fa)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:50.658020 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68fcfc4-2095-491a-9962-c524b3564002 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:50.716512 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 892/1771] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:50.717699 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5f7a4-ab52-4410-a0c3-63a284cee692 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:50.747532 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5f7a4-ab52-4410-a0c3-63a284cee692 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:50.763016 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c9633-34f7-4d3f-9928-7b6e9e45cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:50.766924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c9633-34f7-4d3f-9928-7b6e9e45cb54 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:50.768221 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c9633-34f7-4d3f-9928-7b6e9e45cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:50.769728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c9633-34f7-4d3f-9928-7b6e9e45cb54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:50.772122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c9633-34f7-4d3f-9928-7b6e9e45cb54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:50.777246 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c9633-34f7-4d3f-9928-7b6e9e45cb54 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:50.797784 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f68fcfc4-2095-491a-9962-c524b3564002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb556e657784309a9f977cba20df9fa', 'request_id': 'req-f68fcfc4-2095-491a-9962-c524b3564002'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:50.807989 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f68fcfc4-2095-491a-9962-c524b3564002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb556e657784309a9f977cba20df9fa', 'request_id': 'req-f68fcfc4-2095-491a-9962-c524b3564002'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:50.821582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f68fcfc4-2095-491a-9962-c524b3564002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb556e657784309a9f977cba20df9fa', 'request_id': 'req-f68fcfc4-2095-491a-9962-c524b3564002'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:50.849838 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 893/1772] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:50 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:50.853048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f68fcfc4-2095-491a-9962-c524b3564002 admin admin] The token cache is being invalidate because project 9fb556e657784309a9f977cba20df9fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:10:50.853486 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f68fcfc4-2095-491a-9962-c524b3564002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:50.854782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c9633-34f7-4d3f-9928-7b6e9e45cb54 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:50.859504 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f68fcfc4-2095-491a-9962-c524b3564002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:50.863294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 880/1773] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:10:50 2022] DELETE /identity/v3/projects/9fb556e657784309a9f977cba20df9fa => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:10:50.869704 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb183c-8256-489d-86b9-5a76b1e61bf0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:50.870050 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb183c-8256-489d-86b9-5a76b1e61bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:50.871944 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb183c-8256-489d-86b9-5a76b1e61bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:50.919491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cecb183c-8256-489d-86b9-5a76b1e61bf0 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:50.922811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cecb183c-8256-489d-86b9-5a76b1e61bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:51.161411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c9633-34f7-4d3f-9928-7b6e9e45cb54 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:51.169154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974d8b4-f92d-43c7-8add-b558a04a7287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:51.169836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974d8b4-f92d-43c7-8add-b558a04a7287 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:51.170117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974d8b4-f92d-43c7-8add-b558a04a7287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:51.170413 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974d8b4-f92d-43c7-8add-b558a04a7287 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:51.171123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974d8b4-f92d-43c7-8add-b558a04a7287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:51.173949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974d8b4-f92d-43c7-8add-b558a04a7287 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:51.212599 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 894/1774] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:50 2022] POST /identity/v3/users => generated 294 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:51.215041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974d8b4-f92d-43c7-8add-b558a04a7287 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:51.225788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 881/1775] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:51.239447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27155fd2-b104-4e52-8e36-561ca407a7d0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:51.239447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27155fd2-b104-4e52-8e36-561ca407a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:51.239447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27155fd2-b104-4e52-8e36-561ca407a7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:51.244198 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8974d8b4-f92d-43c7-8add-b558a04a7287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:51.278578 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974d8b4-f92d-43c7-8add-b558a04a7287 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:51.285879 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-27155fd2-b104-4e52-8e36-561ca407a7d0 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:51.288881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-27155fd2-b104-4e52-8e36-561ca407a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:51.290974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00274ba-66f4-4887-a01f-9d8a9f7db4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:51.291978 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00274ba-66f4-4887-a01f-9d8a9f7db4ef admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:51.297061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00274ba-66f4-4887-a01f-9d8a9f7db4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:51.298741 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00274ba-66f4-4887-a01f-9d8a9f7db4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:51.304693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00274ba-66f4-4887-a01f-9d8a9f7db4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:51.307241 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00274ba-66f4-4887-a01f-9d8a9f7db4ef admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:51.317529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 882/1776] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:51.322357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27155fd2-b104-4e52-8e36-561ca407a7d0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:51.336295 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27155fd2-b104-4e52-8e36-561ca407a7d0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:51.345109 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38cb07-036b-409a-be90-3c1b4611ed3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:51.346162 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38cb07-036b-409a-be90-3c1b4611ed3c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:51.346642 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38cb07-036b-409a-be90-3c1b4611ed3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:51.347101 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38cb07-036b-409a-be90-3c1b4611ed3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:51.348701 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38cb07-036b-409a-be90-3c1b4611ed3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:10:51.349422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 895/1777] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:51.349899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38cb07-036b-409a-be90-3c1b4611ed3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:51.352846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00274ba-66f4-4887-a01f-9d8a9f7db4ef admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:51.354310 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38cb07-036b-409a-be90-3c1b4611ed3c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:51.374957 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00274ba-66f4-4887-a01f-9d8a9f7db4ef admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:51.382065 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 883/1778] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:10:51.388161 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38cb07-036b-409a-be90-3c1b4611ed3c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:51.392074 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb0c5f-9f29-49f2-9f39-d131c817a737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:51.394296 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb0c5f-9f29-49f2-9f39-d131c817a737 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:51.394932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb0c5f-9f29-49f2-9f39-d131c817a737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:51.396614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb0c5f-9f29-49f2-9f39-d131c817a737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:51.397534 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb0c5f-9f29-49f2-9f39-d131c817a737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:51.401986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb0c5f-9f29-49f2-9f39-d131c817a737 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:51.413203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38cb07-036b-409a-be90-3c1b4611ed3c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:51.421175 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a298b9-3657-46ff-a030-bc1824240623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:51.422297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a298b9-3657-46ff-a030-bc1824240623 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:51.422915 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a298b9-3657-46ff-a030-bc1824240623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:51.423549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a298b9-3657-46ff-a030-bc1824240623 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:51.425028 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a298b9-3657-46ff-a030-bc1824240623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:51.428181 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a298b9-3657-46ff-a030-bc1824240623 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:51.429287 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 896/1779] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:51.434759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb0c5f-9f29-49f2-9f39-d131c817a737 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:51.471521 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 884/1780] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:51 2022] POST /identity/v3/projects => generated 405 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:51.472357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb0c5f-9f29-49f2-9f39-d131c817a737 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:51.475152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a298b9-3657-46ff-a030-bc1824240623 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:51.629768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a298b9-3657-46ff-a030-bc1824240623 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:51.655958 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007eb17-a9e5-4b2d-9f9a-03f2e907463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:51.656780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007eb17-a9e5-4b2d-9f9a-03f2e907463d admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:51.657043 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007eb17-a9e5-4b2d-9f9a-03f2e907463d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:51.657284 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007eb17-a9e5-4b2d-9f9a-03f2e907463d admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:51.659473 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007eb17-a9e5-4b2d-9f9a-03f2e907463d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:51.663062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007eb17-a9e5-4b2d-9f9a-03f2e907463d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:51.712393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 885/1781] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:51 2022] POST /identity/v3/users => generated 303 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:10:51.716552 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007eb17-a9e5-4b2d-9f9a-03f2e907463d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:51.750918 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007eb17-a9e5-4b2d-9f9a-03f2e907463d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:51.755962 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cb6f9-2d69-45d6-bef1-6e80f036291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:51.761790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cb6f9-2d69-45d6-bef1-6e80f036291e admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:51.763255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cb6f9-2d69-45d6-bef1-6e80f036291e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:51.764145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cb6f9-2d69-45d6-bef1-6e80f036291e admin admin] PATH_INFO: `/v3/projects/57f208a3e9764565a6f19307de23a8af/users/e0162614d5704b99a5ec40fee8d88030/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:51.770579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630a029-3ec1-4866-b3c9-52610aa88f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:51.771283 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630a029-3ec1-4866-b3c9-52610aa88f87 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:51.771593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630a029-3ec1-4866-b3c9-52610aa88f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:51.771906 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630a029-3ec1-4866-b3c9-52610aa88f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:51.772639 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630a029-3ec1-4866-b3c9-52610aa88f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:51.774925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630a029-3ec1-4866-b3c9-52610aa88f87 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:51.805275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 886/1782] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:51.806478 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630a029-3ec1-4866-b3c9-52610aa88f87 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:51.823398 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cb6f9-2d69-45d6-bef1-6e80f036291e admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f208a3e9764565a6f19307de23a8af, user_id=e0162614d5704b99a5ec40fee8d88030, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:51.823729 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630a029-3ec1-4866-b3c9-52610aa88f87 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:51.837389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cb6f9-2d69-45d6-bef1-6e80f036291e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:51.841463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6e6eb-33ac-4ac3-a988-abe1691aec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:51.842237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6e6eb-33ac-4ac3-a988-abe1691aec96 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:51.842525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6e6eb-33ac-4ac3-a988-abe1691aec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:51.842794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6e6eb-33ac-4ac3-a988-abe1691aec96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:51.843582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6e6eb-33ac-4ac3-a988-abe1691aec96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:51.848847 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6e6eb-33ac-4ac3-a988-abe1691aec96 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:51.885994 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 887/1783] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:51.886985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6e6eb-33ac-4ac3-a988-abe1691aec96 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:51.905900 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 897/1784] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:51 2022] PUT /identity/v3/projects/57f208a3e9764565a6f19307de23a8af/users/e0162614d5704b99a5ec40fee8d88030/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:51.917840 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991960cf-d020-4875-b33e-69d012828529 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:51.918044 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991960cf-d020-4875-b33e-69d012828529 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:51.918362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991960cf-d020-4875-b33e-69d012828529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:51.935235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6e6eb-33ac-4ac3-a988-abe1691aec96 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:52.022579 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-991960cf-d020-4875-b33e-69d012828529 None None] MFA Rules not processed for user `e0162614d5704b99a5ec40fee8d88030`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:52.026082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-991960cf-d020-4875-b33e-69d012828529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:52.120484 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fcea5-d1d8-4c37-9103-83b5a1a672a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:52.121533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fcea5-d1d8-4c37-9103-83b5a1a672a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:52.122072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fcea5-d1d8-4c37-9103-83b5a1a672a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:52.123365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fcea5-d1d8-4c37-9103-83b5a1a672a1 admin admin] PATH_INFO: `/v3/projects/2bd8f7731379433ca2df12e176b09683/users/3d3be8092c0b4bc59f56e4e867054c86/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:52.167450 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fcea5-d1d8-4c37-9103-83b5a1a672a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd8f7731379433ca2df12e176b09683, user_id=3d3be8092c0b4bc59f56e4e867054c86, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:52.171573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fcea5-d1d8-4c37-9103-83b5a1a672a1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:52.216400 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 888/1785] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:51 2022] PUT /identity/v3/projects/2bd8f7731379433ca2df12e176b09683/users/3d3be8092c0b4bc59f56e4e867054c86/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:52.229642 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec54ee0-ea8a-4f26-acdb-3278f45f91a7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:52.229830 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec54ee0-ea8a-4f26-acdb-3278f45f91a7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:52.230099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec54ee0-ea8a-4f26-acdb-3278f45f91a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:52.260965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4ec54ee0-ea8a-4f26-acdb-3278f45f91a7 None None] MFA Rules not processed for user `3d3be8092c0b4bc59f56e4e867054c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:52.262461 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4ec54ee0-ea8a-4f26-acdb-3278f45f91a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:52.263659 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 898/1786] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:52.268499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991960cf-d020-4875-b33e-69d012828529 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:52.312565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991960cf-d020-4875-b33e-69d012828529 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:52.366502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 889/1787] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:52.367498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec54ee0-ea8a-4f26-acdb-3278f45f91a7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:52.430851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbafcc-ab7f-4794-8d75-32954f48077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:52.432681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbafcc-ab7f-4794-8d75-32954f48077d admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:52.433212 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbafcc-ab7f-4794-8d75-32954f48077d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:52.433729 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbafcc-ab7f-4794-8d75-32954f48077d admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:52.434635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbafcc-ab7f-4794-8d75-32954f48077d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:52.438063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbafcc-ab7f-4794-8d75-32954f48077d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:52.489993 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec54ee0-ea8a-4f26-acdb-3278f45f91a7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:52.495523 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 899/1788] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:52 2022] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:52.499617 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbafcc-ab7f-4794-8d75-32954f48077d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:52.628441 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbafcc-ab7f-4794-8d75-32954f48077d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:52.633297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70572e34-3531-43c1-8ad6-07054cefd778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:52.634151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70572e34-3531-43c1-8ad6-07054cefd778 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:52.634436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70572e34-3531-43c1-8ad6-07054cefd778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:52.634709 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70572e34-3531-43c1-8ad6-07054cefd778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:52.635330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b218a4-10b7-46e9-b577-92e404a376cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:52.635550 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70572e34-3531-43c1-8ad6-07054cefd778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:52.636281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b218a4-10b7-46e9-b577-92e404a376cf admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:52.636669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b218a4-10b7-46e9-b577-92e404a376cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:52.637048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b218a4-10b7-46e9-b577-92e404a376cf admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:52.637855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70572e34-3531-43c1-8ad6-07054cefd778 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:52.638018 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b218a4-10b7-46e9-b577-92e404a376cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:52.640311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b218a4-10b7-46e9-b577-92e404a376cf admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:52.679481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 900/1789] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:52 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:52.683990 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b218a4-10b7-46e9-b577-92e404a376cf admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:52.690904 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 890/1790] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:52 2022] POST /identity/v3/projects => generated 405 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:52.692330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70572e34-3531-43c1-8ad6-07054cefd778 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:52.699249 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b218a4-10b7-46e9-b577-92e404a376cf admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:52.782124 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42b445-f43b-4f22-a314-36211ad2f717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:52.784257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42b445-f43b-4f22-a314-36211ad2f717 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:52.784257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42b445-f43b-4f22-a314-36211ad2f717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:52.784257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42b445-f43b-4f22-a314-36211ad2f717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:52.784922 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42b445-f43b-4f22-a314-36211ad2f717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:52.785678 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70572e34-3531-43c1-8ad6-07054cefd778 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:52.786988 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42b445-f43b-4f22-a314-36211ad2f717 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:52.793044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2001f9-b3ef-4be8-a210-88c440020b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:52.793792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2001f9-b3ef-4be8-a210-88c440020b30 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:52.794142 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2001f9-b3ef-4be8-a210-88c440020b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:52.794512 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2001f9-b3ef-4be8-a210-88c440020b30 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:52.795310 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2001f9-b3ef-4be8-a210-88c440020b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:52.798544 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2001f9-b3ef-4be8-a210-88c440020b30 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:52.802663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 901/1791] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:52.807907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42b445-f43b-4f22-a314-36211ad2f717 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:52.821691 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42b445-f43b-4f22-a314-36211ad2f717 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:52.828699 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0199b-b49d-4d70-922b-30c383baab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:52.830612 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0199b-b49d-4d70-922b-30c383baab51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:52.830913 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0199b-b49d-4d70-922b-30c383baab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:52.831194 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0199b-b49d-4d70-922b-30c383baab51 admin admin] PATH_INFO: `/v3/projects/9576cf63a004497e80bbefc35c787c27/users/baa528f8b30c42919d0913adedae178e/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:52.833666 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 891/1792] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:52 2022] POST /identity/v3/users => generated 309 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:52.838675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2001f9-b3ef-4be8-a210-88c440020b30 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:52.854033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0199b-b49d-4d70-922b-30c383baab51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9576cf63a004497e80bbefc35c787c27, user_id=baa528f8b30c42919d0913adedae178e, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:52.856974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0199b-b49d-4d70-922b-30c383baab51 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:52.861037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2001f9-b3ef-4be8-a210-88c440020b30 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:52.873147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a706f33-deda-449e-a870-cb0e113c1be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:52.875276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a706f33-deda-449e-a870-cb0e113c1be5 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:52.875679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a706f33-deda-449e-a870-cb0e113c1be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:52.876870 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a706f33-deda-449e-a870-cb0e113c1be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:52.879027 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a706f33-deda-449e-a870-cb0e113c1be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:52.880543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 902/1793] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:52 2022] PUT /identity/v3/projects/9576cf63a004497e80bbefc35c787c27/users/baa528f8b30c42919d0913adedae178e/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:52.891280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a706f33-deda-449e-a870-cb0e113c1be5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:52.892474 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0199b-b49d-4d70-922b-30c383baab51 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:52.944430 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 892/1794] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:52.949903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a706f33-deda-449e-a870-cb0e113c1be5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:52.974082 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a706f33-deda-449e-a870-cb0e113c1be5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:53.035325 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0199b-b49d-4d70-922b-30c383baab51 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:53.052267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8add79-8e47-43c1-9b70-65f39d89a60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:53.056274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8add79-8e47-43c1-9b70-65f39d89a60f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:53.057043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8add79-8e47-43c1-9b70-65f39d89a60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:53.058497 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8add79-8e47-43c1-9b70-65f39d89a60f admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:53.059284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8add79-8e47-43c1-9b70-65f39d89a60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:53.062486 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8add79-8e47-43c1-9b70-65f39d89a60f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:53.098770 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 903/1795] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:53.100063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8add79-8e47-43c1-9b70-65f39d89a60f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:53.107731 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e90e73-5d9b-4914-9bd7-79ccd7a72069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:53.108645 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90e73-5d9b-4914-9bd7-79ccd7a72069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:53.109355 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90e73-5d9b-4914-9bd7-79ccd7a72069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:53.109355 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90e73-5d9b-4914-9bd7-79ccd7a72069 admin admin] PATH_INFO: `/v3/projects/612c8680351b428ea0faf45b5fab4afe/users/64b6cfaf19eb44e5b853e14f13b7a4fe/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:53.119117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8add79-8e47-43c1-9b70-65f39d89a60f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:53.143875 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf33293-7b9f-4d04-9f9a-cf101286a5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:53.146203 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf33293-7b9f-4d04-9f9a-cf101286a5af admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:53.146203 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf33293-7b9f-4d04-9f9a-cf101286a5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:53.146495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf33293-7b9f-4d04-9f9a-cf101286a5af admin admin] PATH_INFO: `/v3/projects/9576cf63a004497e80bbefc35c787c27/users/baa528f8b30c42919d0913adedae178e/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:53.153151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf33293-7b9f-4d04-9f9a-cf101286a5af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9576cf63a004497e80bbefc35c787c27, user_id=baa528f8b30c42919d0913adedae178e, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:53.157632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e90e73-5d9b-4914-9bd7-79ccd7a72069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=612c8680351b428ea0faf45b5fab4afe, user_id=64b6cfaf19eb44e5b853e14f13b7a4fe, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:53.160561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf33293-7b9f-4d04-9f9a-cf101286a5af admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:53.166390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e90e73-5d9b-4914-9bd7-79ccd7a72069 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:53.199868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 904/1796] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:53 2022] PUT /identity/v3/projects/9576cf63a004497e80bbefc35c787c27/users/baa528f8b30c42919d0913adedae178e/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:10:53.204376 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 893/1797] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:52 2022] PUT /identity/v3/projects/612c8680351b428ea0faf45b5fab4afe/users/64b6cfaf19eb44e5b853e14f13b7a4fe/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:53.213060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c04f8-ebec-4632-9cb5-aa22b4aadf4f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:53.213504 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c04f8-ebec-4632-9cb5-aa22b4aadf4f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:53.213864 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c04f8-ebec-4632-9cb5-aa22b4aadf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:53.217240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e90e73-5d9b-4914-9bd7-79ccd7a72069 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:53.285446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c69c04f8-ebec-4632-9cb5-aa22b4aadf4f None None] MFA Rules not processed for user `baa528f8b30c42919d0913adedae178e`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:53.287239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c69c04f8-ebec-4632-9cb5-aa22b4aadf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:53.326006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e90e73-5d9b-4914-9bd7-79ccd7a72069 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:53.347517 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b1340-c8d2-41d1-95b5-ac14498c1deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:53.349077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b1340-c8d2-41d1-95b5-ac14498c1deb admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:53.349375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b1340-c8d2-41d1-95b5-ac14498c1deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:53.349663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b1340-c8d2-41d1-95b5-ac14498c1deb admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:53.352900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b1340-c8d2-41d1-95b5-ac14498c1deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:53.356689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b1340-c8d2-41d1-95b5-ac14498c1deb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:53.374824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 894/1798] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:53.378592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b1340-c8d2-41d1-95b5-ac14498c1deb admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:53.392855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b1340-c8d2-41d1-95b5-ac14498c1deb admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:53.398023 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38528c2-1548-4da2-a148-1cf09b8ef47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:53.400059 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38528c2-1548-4da2-a148-1cf09b8ef47a admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:53.400499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38528c2-1548-4da2-a148-1cf09b8ef47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:53.400783 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38528c2-1548-4da2-a148-1cf09b8ef47a admin admin] PATH_INFO: `/v3/projects/612c8680351b428ea0faf45b5fab4afe/users/64b6cfaf19eb44e5b853e14f13b7a4fe/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:53.402938 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38528c2-1548-4da2-a148-1cf09b8ef47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=612c8680351b428ea0faf45b5fab4afe, user_id=64b6cfaf19eb44e5b853e14f13b7a4fe, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:53.405908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38528c2-1548-4da2-a148-1cf09b8ef47a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:53.408778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 905/1799] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:53.420477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c04f8-ebec-4632-9cb5-aa22b4aadf4f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:53.421509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 895/1800] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:53 2022] PUT /identity/v3/projects/612c8680351b428ea0faf45b5fab4afe/users/64b6cfaf19eb44e5b853e14f13b7a4fe/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:10:53.422162 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c69c04f8-ebec-4632-9cb5-aa22b4aadf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:53.432616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bce99d-eaf5-4141-84ab-b7f5c053bc09 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:53.433132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bce99d-eaf5-4141-84ab-b7f5c053bc09 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:53.433573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bce99d-eaf5-4141-84ab-b7f5c053bc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:53.465380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e9bce99d-eaf5-4141-84ab-b7f5c053bc09 None None] MFA Rules not processed for user `64b6cfaf19eb44e5b853e14f13b7a4fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:53.466850 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e9bce99d-eaf5-4141-84ab-b7f5c053bc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:53.519946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c04f8-ebec-4632-9cb5-aa22b4aadf4f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:53.591935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da9d5b-33a7-487c-b01f-63725e165b9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:53.592742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da9d5b-33a7-487c-b01f-63725e165b9f service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:53.593106 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da9d5b-33a7-487c-b01f-63725e165b9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:53.593419 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da9d5b-33a7-487c-b01f-63725e165b9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:53.596073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 896/1801] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:53 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:10:53.608638 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bce99d-eaf5-4141-84ab-b7f5c053bc09 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:53.610082 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e9bce99d-eaf5-4141-84ab-b7f5c053bc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:53.636088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bce99d-eaf5-4141-84ab-b7f5c053bc09 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:53.639936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d384fe-93c9-45fc-9b66-d6220b22ac42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:53.640613 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d384fe-93c9-45fc-9b66-d6220b22ac42 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:53.640896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d384fe-93c9-45fc-9b66-d6220b22ac42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:53.641170 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d384fe-93c9-45fc-9b66-d6220b22ac42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:53.658135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d384fe-93c9-45fc-9b66-d6220b22ac42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:53.659937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d384fe-93c9-45fc-9b66-d6220b22ac42 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:53.688978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 897/1802] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:53 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:53.777700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da9d5b-33a7-487c-b01f-63725e165b9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:53.779581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da9d5b-33a7-487c-b01f-63725e165b9f service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:53.800053 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 906/1803] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:54.033017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d384fe-93c9-45fc-9b66-d6220b22ac42 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:54.229855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d384fe-93c9-45fc-9b66-d6220b22ac42 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:54.260992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9754744-2c7c-4afe-b2d8-3a41525655c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:54.261904 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754744-2c7c-4afe-b2d8-3a41525655c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:54.262228 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754744-2c7c-4afe-b2d8-3a41525655c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:54.262505 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754744-2c7c-4afe-b2d8-3a41525655c6 admin admin] PATH_INFO: `/v3/users/3d3be8092c0b4bc59f56e4e867054c86` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:54.265009 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9754744-2c7c-4afe-b2d8-3a41525655c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3be8092c0b4bc59f56e4e867054c86)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:54.267342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9754744-2c7c-4afe-b2d8-3a41525655c6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:54.435542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e9754744-2c7c-4afe-b2d8-3a41525655c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3be8092c0b4bc59f56e4e867054c86'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:54.472241 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e9754744-2c7c-4afe-b2d8-3a41525655c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3be8092c0b4bc59f56e4e867054c86'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:54.519118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e9754744-2c7c-4afe-b2d8-3a41525655c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3be8092c0b4bc59f56e4e867054c86'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:54.521983 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e9754744-2c7c-4afe-b2d8-3a41525655c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3be8092c0b4bc59f56e4e867054c86'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:54.523186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e9754744-2c7c-4afe-b2d8-3a41525655c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3be8092c0b4bc59f56e4e867054c86'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:54.528687 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da9d5b-33a7-487c-b01f-63725e165b9f service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:54.530201 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a2da9d5b-33a7-487c-b01f-63725e165b9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:54.557913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 898/1804] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:10:54 2022] DELETE /identity/v3/users/3d3be8092c0b4bc59f56e4e867054c86 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:54.567050 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa0382-6b2d-42f2-b092-3b1b2a3c6a3e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:54.568229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa0382-6b2d-42f2-b092-3b1b2a3c6a3e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:54.568617 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa0382-6b2d-42f2-b092-3b1b2a3c6a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:54.577301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da9d5b-33a7-487c-b01f-63725e165b9f service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:54.593060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0daa0382-6b2d-42f2-b092-3b1b2a3c6a3e None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:54.593060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0daa0382-6b2d-42f2-b092-3b1b2a3c6a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:54.780987 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 899/1805] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:54.793651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c0226-53b0-4bbe-973a-c07aab24b1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:54.794385 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c0226-53b0-4bbe-973a-c07aab24b1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:54.794673 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c0226-53b0-4bbe-973a-c07aab24b1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:54.794952 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c0226-53b0-4bbe-973a-c07aab24b1a9 admin admin] PATH_INFO: `/v3/users/83cb94b8fb7e4419941fa744abadddba` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:54.803901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c0226-53b0-4bbe-973a-c07aab24b1a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83cb94b8fb7e4419941fa744abadddba)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:54.807002 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c0226-53b0-4bbe-973a-c07aab24b1a9 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:54.974759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa0382-6b2d-42f2-b092-3b1b2a3c6a3e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:54.976354 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0daa0382-6b2d-42f2-b092-3b1b2a3c6a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:54.981563 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-424c0226-53b0-4bbe-973a-c07aab24b1a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83cb94b8fb7e4419941fa744abadddba'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:54.983471 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-424c0226-53b0-4bbe-973a-c07aab24b1a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83cb94b8fb7e4419941fa744abadddba'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:55.030228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-424c0226-53b0-4bbe-973a-c07aab24b1a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83cb94b8fb7e4419941fa744abadddba'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:55.038504 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-424c0226-53b0-4bbe-973a-c07aab24b1a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83cb94b8fb7e4419941fa744abadddba'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:55.042464 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-424c0226-53b0-4bbe-973a-c07aab24b1a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83cb94b8fb7e4419941fa744abadddba'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:55.074200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 907/1806] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:10:54 2022] DELETE /identity/v3/users/83cb94b8fb7e4419941fa744abadddba => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:55.078881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99dc22-30a3-43e7-9c2f-c647346a323b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:55.079314 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99dc22-30a3-43e7-9c2f-c647346a323b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:55.079733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99dc22-30a3-43e7-9c2f-c647346a323b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:55.138071 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-af99dc22-30a3-43e7-9c2f-c647346a323b None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:55.141864 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-af99dc22-30a3-43e7-9c2f-c647346a323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:55.143559 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa0382-6b2d-42f2-b092-3b1b2a3c6a3e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:55.266328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f64e1-639e-4a73-9fc8-b835438f6a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:55.267697 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f64e1-639e-4a73-9fc8-b835438f6a64 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:55.268231 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f64e1-639e-4a73-9fc8-b835438f6a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:55.268523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f64e1-639e-4a73-9fc8-b835438f6a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:55.272611 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-957f64e1-639e-4a73-9fc8-b835438f6a64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:55.314436 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 908/1807] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:10:55.315461 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99dc22-30a3-43e7-9c2f-c647346a323b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:55.323626 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-af99dc22-30a3-43e7-9c2f-c647346a323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:55.397667 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f64e1-639e-4a73-9fc8-b835438f6a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:55.400599 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f64e1-639e-4a73-9fc8-b835438f6a64 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:55.401883 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99dc22-30a3-43e7-9c2f-c647346a323b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:55.406230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acb93f-1579-41d9-9620-d2973d0a588a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:55.406998 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acb93f-1579-41d9-9620-d2973d0a588a service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:55.407489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acb93f-1579-41d9-9620-d2973d0a588a service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:55.407859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acb93f-1579-41d9-9620-d2973d0a588a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:55.409998 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e8acb93f-1579-41d9-9620-d2973d0a588a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:55.413835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 900/1808] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:10:55.415092 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f64e1-639e-4a73-9fc8-b835438f6a64 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:55.417000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-957f64e1-639e-4a73-9fc8-b835438f6a64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:55.432745 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f64e1-639e-4a73-9fc8-b835438f6a64 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:55.438657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503a26d-e580-4876-a3c4-fe8e4de2a18a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:55.439411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503a26d-e580-4876-a3c4-fe8e4de2a18a service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:55.439801 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503a26d-e580-4876-a3c4-fe8e4de2a18a service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:55.440152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503a26d-e580-4876-a3c4-fe8e4de2a18a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:55.456764 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503a26d-e580-4876-a3c4-fe8e4de2a18a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:55.460009 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503a26d-e580-4876-a3c4-fe8e4de2a18a service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:55.476332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 901/1809] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:55.489325 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acb93f-1579-41d9-9620-d2973d0a588a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:55.490944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acb93f-1579-41d9-9620-d2973d0a588a service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:55.511943 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 909/1810] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:56.072137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503a26d-e580-4876-a3c4-fe8e4de2a18a service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:56.073804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7503a26d-e580-4876-a3c4-fe8e4de2a18a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:56.087636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503a26d-e580-4876-a3c4-fe8e4de2a18a service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:56.098918 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38179e-aa6b-41a1-ad57-1543bd1c3c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:56.100018 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38179e-aa6b-41a1-ad57-1543bd1c3c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:56.100423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38179e-aa6b-41a1-ad57-1543bd1c3c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:56.100957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38179e-aa6b-41a1-ad57-1543bd1c3c61 admin admin] PATH_INFO: `/v3/projects/2bd8f7731379433ca2df12e176b09683` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:56.102903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38179e-aa6b-41a1-ad57-1543bd1c3c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd8f7731379433ca2df12e176b09683)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:56.105394 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38179e-aa6b-41a1-ad57-1543bd1c3c61 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:56.147974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acb93f-1579-41d9-9620-d2973d0a588a service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:56.150099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e8acb93f-1579-41d9-9620-d2973d0a588a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:56.165025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da38179e-aa6b-41a1-ad57-1543bd1c3c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd8f7731379433ca2df12e176b09683', 'request_id': 'req-da38179e-aa6b-41a1-ad57-1543bd1c3c61'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.167093 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acb93f-1579-41d9-9620-d2973d0a588a service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:56.170850 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da38179e-aa6b-41a1-ad57-1543bd1c3c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd8f7731379433ca2df12e176b09683', 'request_id': 'req-da38179e-aa6b-41a1-ad57-1543bd1c3c61'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.181603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da38179e-aa6b-41a1-ad57-1543bd1c3c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd8f7731379433ca2df12e176b09683', 'request_id': 'req-da38179e-aa6b-41a1-ad57-1543bd1c3c61'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.193489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da38179e-aa6b-41a1-ad57-1543bd1c3c61 admin admin] The token cache is being invalidate because project 2bd8f7731379433ca2df12e176b09683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:10:56.193972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da38179e-aa6b-41a1-ad57-1543bd1c3c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.194628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da38179e-aa6b-41a1-ad57-1543bd1c3c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.196661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 902/1811] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:10:56 2022] DELETE /identity/v3/projects/2bd8f7731379433ca2df12e176b09683 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:56.200412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38179e-aa6b-41a1-ad57-1543bd1c3c61 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:56.201807 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-da38179e-aa6b-41a1-ad57-1543bd1c3c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:56.224012 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:56.224882 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:56.225176 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:56.225435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3 admin admin] PATH_INFO: `/v3/projects/e96c1872059d462cb28ddd686ddd1179` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:56.226649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e96c1872059d462cb28ddd686ddd1179)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:56.228662 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:56.265961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38179e-aa6b-41a1-ad57-1543bd1c3c61 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:56.274413 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e96c1872059d462cb28ddd686ddd1179', 'request_id': 'req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.279719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e96c1872059d462cb28ddd686ddd1179', 'request_id': 'req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.288757 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e96c1872059d462cb28ddd686ddd1179', 'request_id': 'req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.302955 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3 admin admin] The token cache is being invalidate because project e96c1872059d462cb28ddd686ddd1179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:10:56.303195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.303880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.305706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 910/1812] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:10:56 2022] DELETE /identity/v3/projects/e96c1872059d462cb28ddd686ddd1179 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:56.310005 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:56.311505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:56.326660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec5c1a-3d44-4648-8052-ef521ff017cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:56.327556 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec5c1a-3d44-4648-8052-ef521ff017cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:56.327874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec5c1a-3d44-4648-8052-ef521ff017cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:56.328154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec5c1a-3d44-4648-8052-ef521ff017cd admin admin] PATH_INFO: `/v3/users/64b6cfaf19eb44e5b853e14f13b7a4fe` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:56.329525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec5c1a-3d44-4648-8052-ef521ff017cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b6cfaf19eb44e5b853e14f13b7a4fe)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:56.331827 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec5c1a-3d44-4648-8052-ef521ff017cd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:56.384331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-11ec5c1a-3d44-4648-8052-ef521ff017cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b6cfaf19eb44e5b853e14f13b7a4fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.386258 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7154e-cd53-46b0-9a0b-da4982e74dd3 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:56.391110 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4113c-0db0-4396-acd0-be74cc25d122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:56.392055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4113c-0db0-4396-acd0-be74cc25d122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:56.392340 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4113c-0db0-4396-acd0-be74cc25d122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:56.392615 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4113c-0db0-4396-acd0-be74cc25d122 admin admin] PATH_INFO: `/v3/users/b204abaf5f6a40fcac83afa67bce7437` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:56.393832 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4113c-0db0-4396-acd0-be74cc25d122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b204abaf5f6a40fcac83afa67bce7437)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:56.395818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4113c-0db0-4396-acd0-be74cc25d122 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:56.396423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-11ec5c1a-3d44-4648-8052-ef521ff017cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b6cfaf19eb44e5b853e14f13b7a4fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.403566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-11ec5c1a-3d44-4648-8052-ef521ff017cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b6cfaf19eb44e5b853e14f13b7a4fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.404309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-11ec5c1a-3d44-4648-8052-ef521ff017cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b6cfaf19eb44e5b853e14f13b7a4fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.404935 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-11ec5c1a-3d44-4648-8052-ef521ff017cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b6cfaf19eb44e5b853e14f13b7a4fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.419195 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 903/1813] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:10:56 2022] DELETE /identity/v3/users/64b6cfaf19eb44e5b853e14f13b7a4fe => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:10:56.443675 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-82f4113c-0db0-4396-acd0-be74cc25d122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b204abaf5f6a40fcac83afa67bce7437'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.444454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-82f4113c-0db0-4396-acd0-be74cc25d122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b204abaf5f6a40fcac83afa67bce7437'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.456656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-82f4113c-0db0-4396-acd0-be74cc25d122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b204abaf5f6a40fcac83afa67bce7437'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.464664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-82f4113c-0db0-4396-acd0-be74cc25d122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b204abaf5f6a40fcac83afa67bce7437'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.465416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-82f4113c-0db0-4396-acd0-be74cc25d122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b204abaf5f6a40fcac83afa67bce7437'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.478416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 911/1814] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:10:56 2022] DELETE /identity/v3/users/b204abaf5f6a40fcac83afa67bce7437 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:10:56.772889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec5c1a-3d44-4648-8052-ef521ff017cd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:56.775028 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-11ec5c1a-3d44-4648-8052-ef521ff017cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:56.851187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec5c1a-3d44-4648-8052-ef521ff017cd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:56.932164 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22905081-fc7c-42cb-ba36-07ed07851203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:56.932164 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22905081-fc7c-42cb-ba36-07ed07851203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:56.932164 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22905081-fc7c-42cb-ba36-07ed07851203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:56.932164 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22905081-fc7c-42cb-ba36-07ed07851203 admin admin] PATH_INFO: `/v3/projects/612c8680351b428ea0faf45b5fab4afe` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:56.932548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22905081-fc7c-42cb-ba36-07ed07851203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=612c8680351b428ea0faf45b5fab4afe)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:56.932548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22905081-fc7c-42cb-ba36-07ed07851203 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:56.937417 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4113c-0db0-4396-acd0-be74cc25d122 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:56.938893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-82f4113c-0db0-4396-acd0-be74cc25d122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:56.952416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4113c-0db0-4396-acd0-be74cc25d122 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:56.963290 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:56.964549 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:56.964846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:56.965275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1 admin admin] PATH_INFO: `/v3/projects/a96c087b28da46e7a8bf48338b229b40` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:56.968984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a96c087b28da46e7a8bf48338b229b40)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:56.971516 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:56.983137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-22905081-fc7c-42cb-ba36-07ed07851203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '612c8680351b428ea0faf45b5fab4afe', 'request_id': 'req-22905081-fc7c-42cb-ba36-07ed07851203'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:56.990402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-22905081-fc7c-42cb-ba36-07ed07851203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '612c8680351b428ea0faf45b5fab4afe', 'request_id': 'req-22905081-fc7c-42cb-ba36-07ed07851203'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.002669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-22905081-fc7c-42cb-ba36-07ed07851203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '612c8680351b428ea0faf45b5fab4afe', 'request_id': 'req-22905081-fc7c-42cb-ba36-07ed07851203'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.016675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-22905081-fc7c-42cb-ba36-07ed07851203 admin admin] The token cache is being invalidate because project 612c8680351b428ea0faf45b5fab4afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:10:57.016978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-22905081-fc7c-42cb-ba36-07ed07851203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.017745 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-22905081-fc7c-42cb-ba36-07ed07851203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.020279 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 904/1815] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:10:56 2022] DELETE /identity/v3/projects/612c8680351b428ea0faf45b5fab4afe => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:10:57.025595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804fd4-bb38-4cd6-af89-c65a6c88be17 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:57.025814 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804fd4-bb38-4cd6-af89-c65a6c88be17 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:57.026094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804fd4-bb38-4cd6-af89-c65a6c88be17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:57.029492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a96c087b28da46e7a8bf48338b229b40', 'request_id': 'req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.035298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a96c087b28da46e7a8bf48338b229b40', 'request_id': 'req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.044613 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a96c087b28da46e7a8bf48338b229b40', 'request_id': 'req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.049441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4f804fd4-bb38-4cd6-af89-c65a6c88be17 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:57.050198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4f804fd4-bb38-4cd6-af89-c65a6c88be17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:57.059472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1 admin admin] The token cache is being invalidate because project a96c087b28da46e7a8bf48338b229b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:10:57.059795 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.060464 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.062350 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 912/1816] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:10:56 2022] DELETE /identity/v3/projects/a96c087b28da46e7a8bf48338b229b40 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:10:57.067932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:57.072914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:57.119418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 905/1817] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:10:57.126668 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78cc12-6668-4996-94f9-8473086eb63d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:57.128359 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78cc12-6668-4996-94f9-8473086eb63d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:57.128825 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78cc12-6668-4996-94f9-8473086eb63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:57.153012 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7e78cc12-6668-4996-94f9-8473086eb63d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:57.154315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7e78cc12-6668-4996-94f9-8473086eb63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:57.160039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de68f3-6ae4-4cc8-8b19-47abb1321ce1 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:57.166518 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c079-a579-4fde-8dd6-d33b8e2fb65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:57.167427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 906/1818] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:10:57.170726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c079-a579-4fde-8dd6-d33b8e2fb65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:57.171042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c079-a579-4fde-8dd6-d33b8e2fb65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:57.171326 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c079-a579-4fde-8dd6-d33b8e2fb65f admin admin] PATH_INFO: `/v3/users/d463d7ce3a8f436c9b3888d7f370ad06` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:57.172600 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78cc12-6668-4996-94f9-8473086eb63d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:57.172751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3c079-a579-4fde-8dd6-d33b8e2fb65f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d463d7ce3a8f436c9b3888d7f370ad06)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:57.174816 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3c079-a579-4fde-8dd6-d33b8e2fb65f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:57.183448 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78cc12-6668-4996-94f9-8473086eb63d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:57.193387 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e2ab7-a8ec-44c7-addc-621ff53a52c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:57.194861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e2ab7-a8ec-44c7-addc-621ff53a52c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:57.195223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e2ab7-a8ec-44c7-addc-621ff53a52c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:57.196133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e2ab7-a8ec-44c7-addc-621ff53a52c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:57.197738 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e2ab7-a8ec-44c7-addc-621ff53a52c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:10:57.198256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e2ab7-a8ec-44c7-addc-621ff53a52c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:57.200678 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e2ab7-a8ec-44c7-addc-621ff53a52c6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:57.216978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 907/1819] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:10:57.223532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e2ab7-a8ec-44c7-addc-621ff53a52c6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:57.241877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e2ab7-a8ec-44c7-addc-621ff53a52c6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:57.245770 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6cf3c079-a579-4fde-8dd6-d33b8e2fb65f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd463d7ce3a8f436c9b3888d7f370ad06'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.246452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6cf3c079-a579-4fde-8dd6-d33b8e2fb65f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd463d7ce3a8f436c9b3888d7f370ad06'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.247326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625522d-1eae-4c2e-93f9-715f7798a1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:57.248155 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625522d-1eae-4c2e-93f9-715f7798a1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:57.248444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625522d-1eae-4c2e-93f9-715f7798a1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:57.248767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625522d-1eae-4c2e-93f9-715f7798a1b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:57.249471 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625522d-1eae-4c2e-93f9-715f7798a1b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:57.252226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625522d-1eae-4c2e-93f9-715f7798a1b8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:57.265093 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6cf3c079-a579-4fde-8dd6-d33b8e2fb65f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd463d7ce3a8f436c9b3888d7f370ad06'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.273469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6cf3c079-a579-4fde-8dd6-d33b8e2fb65f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd463d7ce3a8f436c9b3888d7f370ad06'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.275101 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6cf3c079-a579-4fde-8dd6-d33b8e2fb65f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd463d7ce3a8f436c9b3888d7f370ad06'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.287128 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 908/1820] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:57 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:57.288135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625522d-1eae-4c2e-93f9-715f7798a1b8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:57.290612 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3625522d-1eae-4c2e-93f9-715f7798a1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:57.292828 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 913/1821] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:10:57 2022] DELETE /identity/v3/users/d463d7ce3a8f436c9b3888d7f370ad06 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:57.381268 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625522d-1eae-4c2e-93f9-715f7798a1b8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:57.453937 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38126885-0858-42f3-b450-34585ffde58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:57.454883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38126885-0858-42f3-b450-34585ffde58a admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:57.455168 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38126885-0858-42f3-b450-34585ffde58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:57.455474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38126885-0858-42f3-b450-34585ffde58a admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:57.456394 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38126885-0858-42f3-b450-34585ffde58a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:57.458190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38126885-0858-42f3-b450-34585ffde58a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:57.485609 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 909/1822] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:57 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:10:57.487265 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c079-a579-4fde-8dd6-d33b8e2fb65f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:57.499210 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c079-a579-4fde-8dd6-d33b8e2fb65f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:57.505165 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb49da-bfd2-4b63-ad61-2fd587f058b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:57.506084 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb49da-bfd2-4b63-ad61-2fd587f058b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:57.506084 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb49da-bfd2-4b63-ad61-2fd587f058b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:57.506373 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb49da-bfd2-4b63-ad61-2fd587f058b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:57.507102 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb49da-bfd2-4b63-ad61-2fd587f058b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:57.509021 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb49da-bfd2-4b63-ad61-2fd587f058b8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:57.522286 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 914/1823] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:10:57.524069 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38126885-0858-42f3-b450-34585ffde58a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:57.537070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38126885-0858-42f3-b450-34585ffde58a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:57.547845 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e817f-c273-4861-aac8-ee012b013a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:57.548795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e817f-c273-4861-aac8-ee012b013a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:57.549239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e817f-c273-4861-aac8-ee012b013a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:57.549782 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e817f-c273-4861-aac8-ee012b013a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:57.551043 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e817f-c273-4861-aac8-ee012b013a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:57.552712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e817f-c273-4861-aac8-ee012b013a75 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:57.564606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 910/1824] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:57.569049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb49da-bfd2-4b63-ad61-2fd587f058b8 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:57.579238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb49da-bfd2-4b63-ad61-2fd587f058b8 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:57.585918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef81456-77b5-4b5e-93b3-2cd3308e132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:57.587468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef81456-77b5-4b5e-93b3-2cd3308e132b admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:57.587759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef81456-77b5-4b5e-93b3-2cd3308e132b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:57.588031 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef81456-77b5-4b5e-93b3-2cd3308e132b admin admin] PATH_INFO: `/v3/projects/12ab87ddb60942e39eaf9caa63220a91/users/fcc36cb113c748f9a423328c2ca193c5/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:57.609714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef81456-77b5-4b5e-93b3-2cd3308e132b admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ab87ddb60942e39eaf9caa63220a91, user_id=fcc36cb113c748f9a423328c2ca193c5, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:57.612866 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e817f-c273-4861-aac8-ee012b013a75 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:57.613019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef81456-77b5-4b5e-93b3-2cd3308e132b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:57.614587 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-561e817f-c273-4861-aac8-ee012b013a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:57.629326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e817f-c273-4861-aac8-ee012b013a75 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:57.636671 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 915/1825] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:57 2022] PUT /identity/v3/projects/12ab87ddb60942e39eaf9caa63220a91/users/fcc36cb113c748f9a423328c2ca193c5/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:10:57.648173 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101eb274-6e27-46b0-8a04-97d381a0ed2e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:57.648458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101eb274-6e27-46b0-8a04-97d381a0ed2e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:57.649309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101eb274-6e27-46b0-8a04-97d381a0ed2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:57.677881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-101eb274-6e27-46b0-8a04-97d381a0ed2e None None] MFA Rules not processed for user `fcc36cb113c748f9a423328c2ca193c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:57.679369 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-101eb274-6e27-46b0-8a04-97d381a0ed2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:57.705655 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30574e-88d8-4abe-a7ac-e5e9a9c72e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:57.706647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30574e-88d8-4abe-a7ac-e5e9a9c72e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:57.707032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30574e-88d8-4abe-a7ac-e5e9a9c72e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:57.707419 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30574e-88d8-4abe-a7ac-e5e9a9c72e92 admin admin] PATH_INFO: `/v3/projects/e4c8e3a089274bd0808e0cd7acaa848c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:57.709357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30574e-88d8-4abe-a7ac-e5e9a9c72e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4c8e3a089274bd0808e0cd7acaa848c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:57.713504 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30574e-88d8-4abe-a7ac-e5e9a9c72e92 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:57.753499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 916/1826] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:10:57.758423 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101eb274-6e27-46b0-8a04-97d381a0ed2e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:57.770839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101eb274-6e27-46b0-8a04-97d381a0ed2e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:57.785060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ae30574e-88d8-4abe-a7ac-e5e9a9c72e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4c8e3a089274bd0808e0cd7acaa848c', 'request_id': 'req-ae30574e-88d8-4abe-a7ac-e5e9a9c72e92'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.792080 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ae30574e-88d8-4abe-a7ac-e5e9a9c72e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4c8e3a089274bd0808e0cd7acaa848c', 'request_id': 'req-ae30574e-88d8-4abe-a7ac-e5e9a9c72e92'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.802380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ae30574e-88d8-4abe-a7ac-e5e9a9c72e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4c8e3a089274bd0808e0cd7acaa848c', 'request_id': 'req-ae30574e-88d8-4abe-a7ac-e5e9a9c72e92'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.814618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ae30574e-88d8-4abe-a7ac-e5e9a9c72e92 admin admin] The token cache is being invalidate because project e4c8e3a089274bd0808e0cd7acaa848c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:10:57.814911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ae30574e-88d8-4abe-a7ac-e5e9a9c72e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.815822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ae30574e-88d8-4abe-a7ac-e5e9a9c72e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:57.817619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 911/1827] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:10:57 2022] DELETE /identity/v3/projects/e4c8e3a089274bd0808e0cd7acaa848c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:10:57.824113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ab4e7-40b4-470d-9e67-0f090b3f5e61 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:57.825136 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ab4e7-40b4-470d-9e67-0f090b3f5e61 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:57.825715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ab4e7-40b4-470d-9e67-0f090b3f5e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:57.843930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03942a-1d99-4132-9abc-1ab28532e3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:57.844754 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03942a-1d99-4132-9abc-1ab28532e3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:57.845135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03942a-1d99-4132-9abc-1ab28532e3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:57.845414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03942a-1d99-4132-9abc-1ab28532e3c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:57.846129 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03942a-1d99-4132-9abc-1ab28532e3c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:57.846305 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7c4ab4e7-40b4-470d-9e67-0f090b3f5e61 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:57.847496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7c4ab4e7-40b4-470d-9e67-0f090b3f5e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:57.848177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03942a-1d99-4132-9abc-1ab28532e3c3 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:57.863725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 912/1828] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:10:57.865965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f65f3-d5f6-457d-993b-90122d67043f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:57.866440 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f65f3-d5f6-457d-993b-90122d67043f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:57.866793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f65f3-d5f6-457d-993b-90122d67043f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:57.885860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 917/1829] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:57 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:57.886435 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-df3f65f3-d5f6-457d-993b-90122d67043f None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:57.887658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-df3f65f3-d5f6-457d-993b-90122d67043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:57.889621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03942a-1d99-4132-9abc-1ab28532e3c3 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:57.891199 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ce03942a-1d99-4132-9abc-1ab28532e3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:57.967770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 913/1830] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:10:57.970809 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f65f3-d5f6-457d-993b-90122d67043f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:57.985149 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f65f3-d5f6-457d-993b-90122d67043f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:57.992907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe3017-061a-401d-9af9-d59841c4ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:57.994217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe3017-061a-401d-9af9-d59841c4ad49 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:57.994732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe3017-061a-401d-9af9-d59841c4ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:57.995222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe3017-061a-401d-9af9-d59841c4ad49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:57.996188 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe3017-061a-401d-9af9-d59841c4ad49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:10:57.996711 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe3017-061a-401d-9af9-d59841c4ad49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:57.999082 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe3017-061a-401d-9af9-d59841c4ad49 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.020210 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03942a-1d99-4132-9abc-1ab28532e3c3 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:58.021360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 914/1831] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:10:58.022973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe3017-061a-401d-9af9-d59841c4ad49 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:58.038290 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe3017-061a-401d-9af9-d59841c4ad49 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:58.038938 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf17438-4d1a-4da0-9726-e53b13e529a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:58.040340 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf17438-4d1a-4da0-9726-e53b13e529a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.040775 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf17438-4d1a-4da0-9726-e53b13e529a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.041151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf17438-4d1a-4da0-9726-e53b13e529a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.042036 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf17438-4d1a-4da0-9726-e53b13e529a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:58.044312 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf17438-4d1a-4da0-9726-e53b13e529a6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.047052 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7709cc-6ea0-4a24-9b74-ea0c5baedd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:58.048223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7709cc-6ea0-4a24-9b74-ea0c5baedd79 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.048723 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7709cc-6ea0-4a24-9b74-ea0c5baedd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.049215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7709cc-6ea0-4a24-9b74-ea0c5baedd79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.050151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7709cc-6ea0-4a24-9b74-ea0c5baedd79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:58.053229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7709cc-6ea0-4a24-9b74-ea0c5baedd79 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.072376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 918/1832] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:57 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:10:58.076544 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf17438-4d1a-4da0-9726-e53b13e529a6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:58.089811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf17438-4d1a-4da0-9726-e53b13e529a6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:58.096589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b66c03-7c1c-469e-8230-def6186b7bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:58.097479 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b66c03-7c1c-469e-8230-def6186b7bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.097870 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b66c03-7c1c-469e-8230-def6186b7bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.098256 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b66c03-7c1c-469e-8230-def6186b7bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.099157 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b66c03-7c1c-469e-8230-def6186b7bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:58.100898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b66c03-7c1c-469e-8230-def6186b7bf8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.113278 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 919/1833] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:58.117313 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b66c03-7c1c-469e-8230-def6186b7bf8 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:58.124895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 915/1834] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:58 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:58.126276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7709cc-6ea0-4a24-9b74-ea0c5baedd79 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:58.156342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b66c03-7c1c-469e-8230-def6186b7bf8 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:58.226566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7709cc-6ea0-4a24-9b74-ea0c5baedd79 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:58.233091 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e24be6-a6f0-4e6a-901a-1bfcff34afa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:58.234160 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e24be6-a6f0-4e6a-901a-1bfcff34afa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.234502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e24be6-a6f0-4e6a-901a-1bfcff34afa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.234959 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e24be6-a6f0-4e6a-901a-1bfcff34afa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.235832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e24be6-a6f0-4e6a-901a-1bfcff34afa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:58.238191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e24be6-a6f0-4e6a-901a-1bfcff34afa7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.280468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 916/1835] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:58 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:58.282278 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e24be6-a6f0-4e6a-901a-1bfcff34afa7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:58.298003 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e24be6-a6f0-4e6a-901a-1bfcff34afa7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:58.298638 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea145550-1534-42f8-a13a-8f7788b98608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:58.300359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea145550-1534-42f8-a13a-8f7788b98608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.301077 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea145550-1534-42f8-a13a-8f7788b98608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.301616 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea145550-1534-42f8-a13a-8f7788b98608 admin admin] PATH_INFO: `/v3/projects/79a2f808e86b4b67b6b9d3b54be4ac5d/users/28765816568b4656b83426830ef1ed97/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.303463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db612e3d-1451-4a1b-8051-2752b7b8fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:58.304304 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db612e3d-1451-4a1b-8051-2752b7b8fd19 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.304908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db612e3d-1451-4a1b-8051-2752b7b8fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.305405 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db612e3d-1451-4a1b-8051-2752b7b8fd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.306871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db612e3d-1451-4a1b-8051-2752b7b8fd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:58.309796 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db612e3d-1451-4a1b-8051-2752b7b8fd19 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.327309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea145550-1534-42f8-a13a-8f7788b98608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a2f808e86b4b67b6b9d3b54be4ac5d, user_id=28765816568b4656b83426830ef1ed97, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:58.331955 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea145550-1534-42f8-a13a-8f7788b98608 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.336979 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 917/1836] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:10:58.338311 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db612e3d-1451-4a1b-8051-2752b7b8fd19 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:58.351726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db612e3d-1451-4a1b-8051-2752b7b8fd19 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:58.358589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581fd9a-ea29-4c79-af02-e8cdfdc25aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:58.359552 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581fd9a-ea29-4c79-af02-e8cdfdc25aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.360180 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581fd9a-ea29-4c79-af02-e8cdfdc25aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.360616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581fd9a-ea29-4c79-af02-e8cdfdc25aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.361553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581fd9a-ea29-4c79-af02-e8cdfdc25aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:58.363057 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 920/1837] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:58 2022] PUT /identity/v3/projects/79a2f808e86b4b67b6b9d3b54be4ac5d/users/28765816568b4656b83426830ef1ed97/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:58.363751 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581fd9a-ea29-4c79-af02-e8cdfdc25aa0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.367971 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea145550-1534-42f8-a13a-8f7788b98608 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:58.382660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 918/1838] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:58.385131 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581fd9a-ea29-4c79-af02-e8cdfdc25aa0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:58.401154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581fd9a-ea29-4c79-af02-e8cdfdc25aa0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:58.456628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea145550-1534-42f8-a13a-8f7788b98608 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:58.463491 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963e4d5-286a-4173-acc6-4cad279a2731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:58.464383 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963e4d5-286a-4173-acc6-4cad279a2731 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.464774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963e4d5-286a-4173-acc6-4cad279a2731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.465156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963e4d5-286a-4173-acc6-4cad279a2731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.466008 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963e4d5-286a-4173-acc6-4cad279a2731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:58.468000 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963e4d5-286a-4173-acc6-4cad279a2731 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.483241 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 921/1839] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:10:58.488434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963e4d5-286a-4173-acc6-4cad279a2731 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:58.489276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f125e97-b722-4220-9595-355437618b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:58.490854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f125e97-b722-4220-9595-355437618b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.491570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f125e97-b722-4220-9595-355437618b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.492896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f125e97-b722-4220-9595-355437618b29 admin admin] PATH_INFO: `/v3/projects/c37d5415c79c40ed9beffa8590202bd7/users/d9df67f09eef41db849f028390d147e3/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.514667 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963e4d5-286a-4173-acc6-4cad279a2731 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:58.528299 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f125e97-b722-4220-9595-355437618b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37d5415c79c40ed9beffa8590202bd7, user_id=d9df67f09eef41db849f028390d147e3, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:58.529188 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0d291-ed30-48e7-84c5-0013e70d4d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:58.533218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f125e97-b722-4220-9595-355437618b29 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.533752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0d291-ed30-48e7-84c5-0013e70d4d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.534143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0d291-ed30-48e7-84c5-0013e70d4d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.534544 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0d291-ed30-48e7-84c5-0013e70d4d9c admin admin] PATH_INFO: `/v3/projects/79a2f808e86b4b67b6b9d3b54be4ac5d/users/28765816568b4656b83426830ef1ed97/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.552406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0d291-ed30-48e7-84c5-0013e70d4d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a2f808e86b4b67b6b9d3b54be4ac5d, user_id=28765816568b4656b83426830ef1ed97, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:58.558522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0d291-ed30-48e7-84c5-0013e70d4d9c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.594387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 922/1841] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:58 2022] PUT /identity/v3/projects/79a2f808e86b4b67b6b9d3b54be4ac5d/users/28765816568b4656b83426830ef1ed97/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:58.598894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 919/1841] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:58 2022] PUT /identity/v3/projects/c37d5415c79c40ed9beffa8590202bd7/users/d9df67f09eef41db849f028390d147e3/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:58.605028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238917ea-7976-48c1-adef-70c3310073d0 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.605365 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238917ea-7976-48c1-adef-70c3310073d0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.605649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238917ea-7976-48c1-adef-70c3310073d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.608893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ed024-2da5-456c-8efc-fb0951a2d761 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.611125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ed024-2da5-456c-8efc-fb0951a2d761 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.611425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ed024-2da5-456c-8efc-fb0951a2d761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.672612 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-238917ea-7976-48c1-adef-70c3310073d0 None None] MFA Rules not processed for user `d9df67f09eef41db849f028390d147e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:58.673382 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-238917ea-7976-48c1-adef-70c3310073d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:58.685316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-396ed024-2da5-456c-8efc-fb0951a2d761 None None] MFA Rules not processed for user `28765816568b4656b83426830ef1ed97`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:58.686513 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-396ed024-2da5-456c-8efc-fb0951a2d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:58.754089 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 923/1842] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:58.759117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238917ea-7976-48c1-adef-70c3310073d0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:58.767507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 920/1843] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:58.778986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ed024-2da5-456c-8efc-fb0951a2d761 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:58.780405 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-396ed024-2da5-456c-8efc-fb0951a2d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:58.821136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238917ea-7976-48c1-adef-70c3310073d0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:58.825552 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712afdbb-1cf1-481d-952a-cb4732923f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:58.826215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712afdbb-1cf1-481d-952a-cb4732923f83 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.826548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712afdbb-1cf1-481d-952a-cb4732923f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.826827 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712afdbb-1cf1-481d-952a-cb4732923f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.827570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712afdbb-1cf1-481d-952a-cb4732923f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:58.829548 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712afdbb-1cf1-481d-952a-cb4732923f83 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.835917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ed024-2da5-456c-8efc-fb0951a2d761 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:58.839581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040f13b-f61d-4eb6-a80b-f6c5e3ad1da6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:58.840248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040f13b-f61d-4eb6-a80b-f6c5e3ad1da6 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.840525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040f13b-f61d-4eb6-a80b-f6c5e3ad1da6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.840793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040f13b-f61d-4eb6-a80b-f6c5e3ad1da6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.851218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040f13b-f61d-4eb6-a80b-f6c5e3ad1da6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:58.853483 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040f13b-f61d-4eb6-a80b-f6c5e3ad1da6 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.857745 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 924/1844] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:10:58 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:10:58.859653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712afdbb-1cf1-481d-952a-cb4732923f83 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:58.864081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 921/1845] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:10:58.893175 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040f13b-f61d-4eb6-a80b-f6c5e3ad1da6 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:58.903204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040f13b-f61d-4eb6-a80b-f6c5e3ad1da6 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:58.921531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712afdbb-1cf1-481d-952a-cb4732923f83 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:58.926370 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bafec8-98cf-4883-bb27-d09f08cc830e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:58.927042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bafec8-98cf-4883-bb27-d09f08cc830e admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.927321 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bafec8-98cf-4883-bb27-d09f08cc830e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.927615 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bafec8-98cf-4883-bb27-d09f08cc830e admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.928453 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bafec8-98cf-4883-bb27-d09f08cc830e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:58.930462 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bafec8-98cf-4883-bb27-d09f08cc830e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.952449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 925/1846] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:10:58 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:10:58.956477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bafec8-98cf-4883-bb27-d09f08cc830e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:58.967215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bafec8-98cf-4883-bb27-d09f08cc830e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:58.968426 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed093e-0091-4bc6-a63d-a5b586a08243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:58.969301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed093e-0091-4bc6-a63d-a5b586a08243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.969672 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed093e-0091-4bc6-a63d-a5b586a08243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.970003 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed093e-0091-4bc6-a63d-a5b586a08243 admin admin] PATH_INFO: `/v3/users/fcc36cb113c748f9a423328c2ca193c5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.971198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed093e-0091-4bc6-a63d-a5b586a08243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc36cb113c748f9a423328c2ca193c5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:58.973098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc9772-6316-47b5-9212-cb70879af31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:58.973474 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc9772-6316-47b5-9212-cb70879af31b admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:58.973973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed093e-0091-4bc6-a63d-a5b586a08243 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.974074 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc9772-6316-47b5-9212-cb70879af31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:58.974365 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc9772-6316-47b5-9212-cb70879af31b admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:58.975267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc9772-6316-47b5-9212-cb70879af31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:58.977559 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc9772-6316-47b5-9212-cb70879af31b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:58.993455 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 926/1847] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:58.994504 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc9772-6316-47b5-9212-cb70879af31b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:59.007125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc9772-6316-47b5-9212-cb70879af31b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:59.012981 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1090c1-1745-4eed-a9eb-d70a8c117a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:59.013967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1090c1-1745-4eed-a9eb-d70a8c117a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:59.014255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1090c1-1745-4eed-a9eb-d70a8c117a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:59.014565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1090c1-1745-4eed-a9eb-d70a8c117a81 admin admin] PATH_INFO: `/v3/projects/586f0ff5217c4e1eb6819f1904cb8fd2/users/82bdf6f2217b4a59878c83cef765c95a/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:59.041224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f4ed093e-0091-4bc6-a63d-a5b586a08243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc36cb113c748f9a423328c2ca193c5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:59.056136 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f4ed093e-0091-4bc6-a63d-a5b586a08243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc36cb113c748f9a423328c2ca193c5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:59.056709 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1090c1-1745-4eed-a9eb-d70a8c117a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=586f0ff5217c4e1eb6819f1904cb8fd2, user_id=82bdf6f2217b4a59878c83cef765c95a, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:59.060431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1090c1-1745-4eed-a9eb-d70a8c117a81 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:59.065388 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f4ed093e-0091-4bc6-a63d-a5b586a08243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc36cb113c748f9a423328c2ca193c5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:59.066274 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f4ed093e-0091-4bc6-a63d-a5b586a08243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc36cb113c748f9a423328c2ca193c5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:59.067138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f4ed093e-0091-4bc6-a63d-a5b586a08243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc36cb113c748f9a423328c2ca193c5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:59.080083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 927/1848] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:58 2022] PUT /identity/v3/projects/586f0ff5217c4e1eb6819f1904cb8fd2/users/82bdf6f2217b4a59878c83cef765c95a/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:59.084097 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1090c1-1745-4eed-a9eb-d70a8c117a81 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:59.086085 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7b1090c1-1745-4eed-a9eb-d70a8c117a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:59.088219 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 922/1849] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:10:58 2022] DELETE /identity/v3/users/fcc36cb113c748f9a423328c2ca193c5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:10:59.091246 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e13492-016a-4748-9585-ad6bb10de048 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:59.093554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e13492-016a-4748-9585-ad6bb10de048 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:59.094121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e13492-016a-4748-9585-ad6bb10de048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:59.126133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-77e13492-016a-4748-9585-ad6bb10de048 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:59.127440 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-77e13492-016a-4748-9585-ad6bb10de048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:59.177831 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1090c1-1745-4eed-a9eb-d70a8c117a81 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:59.199642 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 923/1850] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:10:59.207144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e13492-016a-4748-9585-ad6bb10de048 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:59.209406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-77e13492-016a-4748-9585-ad6bb10de048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:59.235883 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac1c92-b701-4ce8-9400-e24a498aa1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:59.236568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac1c92-b701-4ce8-9400-e24a498aa1ba admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:59.236860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac1c92-b701-4ce8-9400-e24a498aa1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:59.237140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac1c92-b701-4ce8-9400-e24a498aa1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:59.237869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac1c92-b701-4ce8-9400-e24a498aa1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:59.239508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac1c92-b701-4ce8-9400-e24a498aa1ba admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:59.250276 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 928/1851] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:10:59.254241 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac1c92-b701-4ce8-9400-e24a498aa1ba admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:59.264722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac1c92-b701-4ce8-9400-e24a498aa1ba admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:59.269354 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efd32f-787f-4384-b4b9-c069fcf206ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:59.270226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efd32f-787f-4384-b4b9-c069fcf206ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:59.270508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efd32f-787f-4384-b4b9-c069fcf206ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:59.270617 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e13492-016a-4748-9585-ad6bb10de048 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:59.271055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efd32f-787f-4384-b4b9-c069fcf206ca admin admin] PATH_INFO: `/v3/projects/586f0ff5217c4e1eb6819f1904cb8fd2/users/82bdf6f2217b4a59878c83cef765c95a/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:59.272775 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efd32f-787f-4384-b4b9-c069fcf206ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=586f0ff5217c4e1eb6819f1904cb8fd2, user_id=82bdf6f2217b4a59878c83cef765c95a, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:59.274302 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3949d5-ded8-48a9-9e2a-5be23d3d1293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:59.274945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3949d5-ded8-48a9-9e2a-5be23d3d1293 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:59.275226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3949d5-ded8-48a9-9e2a-5be23d3d1293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:59.275499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3949d5-ded8-48a9-9e2a-5be23d3d1293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:59.275643 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efd32f-787f-4384-b4b9-c069fcf206ca admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:59.284900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3949d5-ded8-48a9-9e2a-5be23d3d1293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:59.286498 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 929/1852] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:10:59 2022] PUT /identity/v3/projects/586f0ff5217c4e1eb6819f1904cb8fd2/users/82bdf6f2217b4a59878c83cef765c95a/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:10:59.286608 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3949d5-ded8-48a9-9e2a-5be23d3d1293 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:59.297033 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 924/1853] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:10:59.297212 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0e4bd-0f96-4d3f-8ce8-ebd009a24d2d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:59.297300 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0e4bd-0f96-4d3f-8ce8-ebd009a24d2d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:59.297535 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0e4bd-0f96-4d3f-8ce8-ebd009a24d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:59.327682 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-caf0e4bd-0f96-4d3f-8ce8-ebd009a24d2d None None] MFA Rules not processed for user `82bdf6f2217b4a59878c83cef765c95a`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:10:59.328978 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-caf0e4bd-0f96-4d3f-8ce8-ebd009a24d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:59.402823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 930/1854] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:10:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:10:59.415087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3949d5-ded8-48a9-9e2a-5be23d3d1293 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:59.416538 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5e3949d5-ded8-48a9-9e2a-5be23d3d1293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:59.476812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3949d5-ded8-48a9-9e2a-5be23d3d1293 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:59.525421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6983dfb-30df-45e6-9e39-e028a832465c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:59.526113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6983dfb-30df-45e6-9e39-e028a832465c service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:59.526388 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6983dfb-30df-45e6-9e39-e028a832465c service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:59.526660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6983dfb-30df-45e6-9e39-e028a832465c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:59.535972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6983dfb-30df-45e6-9e39-e028a832465c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:59.537415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6983dfb-30df-45e6-9e39-e028a832465c service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:59.548122 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 925/1855] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:10:59.580269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0e4bd-0f96-4d3f-8ce8-ebd009a24d2d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:59.582365 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-caf0e4bd-0f96-4d3f-8ce8-ebd009a24d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:59.649657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6983dfb-30df-45e6-9e39-e028a832465c service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:59.658243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6983dfb-30df-45e6-9e39-e028a832465c service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:59.662151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0963435-cf50-4013-9dd7-f7304cc29387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:59.662799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0963435-cf50-4013-9dd7-f7304cc29387 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:59.663086 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0963435-cf50-4013-9dd7-f7304cc29387 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:59.663362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0963435-cf50-4013-9dd7-f7304cc29387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:59.666280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a0963435-cf50-4013-9dd7-f7304cc29387 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:10:59.666699 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0e4bd-0f96-4d3f-8ce8-ebd009a24d2d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:59.671740 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:59.672604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:59.672890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:59.673163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83 admin admin] PATH_INFO: `/v3/projects/12ab87ddb60942e39eaf9caa63220a91` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:59.674360 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ab87ddb60942e39eaf9caa63220a91)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:59.676376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:59.738383 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ab87ddb60942e39eaf9caa63220a91', 'request_id': 'req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:59.745705 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ab87ddb60942e39eaf9caa63220a91', 'request_id': 'req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:59.755941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0963435-cf50-4013-9dd7-f7304cc29387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:59.758186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0963435-cf50-4013-9dd7-f7304cc29387 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:59.759951 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ab87ddb60942e39eaf9caa63220a91', 'request_id': 'req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:59.768638 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 926/1856] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:10:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:10:59.777899 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83 admin admin] The token cache is being invalidate because project 12ab87ddb60942e39eaf9caa63220a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:10:59.778270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:59.779040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:59.783673 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 931/1857] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:10:59 2022] DELETE /identity/v3/projects/12ab87ddb60942e39eaf9caa63220a91 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:10:59.784766 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0963435-cf50-4013-9dd7-f7304cc29387 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:10:59.806573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0963435-cf50-4013-9dd7-f7304cc29387 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:10:59.887202 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c80fc-dd63-44d1-8828-9849f53aea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:10:59.888212 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c80fc-dd63-44d1-8828-9849f53aea43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:10:59.888576 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c80fc-dd63-44d1-8828-9849f53aea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:10:59.889330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c80fc-dd63-44d1-8828-9849f53aea43 admin admin] PATH_INFO: `/v3/users/28765816568b4656b83426830ef1ed97` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:10:59.890242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c80fc-dd63-44d1-8828-9849f53aea43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28765816568b4656b83426830ef1ed97)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:10:59.892343 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c80fc-dd63-44d1-8828-9849f53aea43 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:10:59.964795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-967c80fc-dd63-44d1-8828-9849f53aea43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28765816568b4656b83426830ef1ed97'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:59.980040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-967c80fc-dd63-44d1-8828-9849f53aea43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28765816568b4656b83426830ef1ed97'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:59.987829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-967c80fc-dd63-44d1-8828-9849f53aea43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28765816568b4656b83426830ef1ed97'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:59.988587 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-967c80fc-dd63-44d1-8828-9849f53aea43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28765816568b4656b83426830ef1ed97'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:10:59.989242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-967c80fc-dd63-44d1-8828-9849f53aea43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28765816568b4656b83426830ef1ed97'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.007853 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 927/1858] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:10:59 2022] DELETE /identity/v3/users/28765816568b4656b83426830ef1ed97 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:00.074755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:00.076411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:00.091471 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060b6a8-0a49-4de1-80ca-d22b4a2d0e83 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:00.161684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7464ed-a677-4e5b-a2a6-80106b10ff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:00.161684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7464ed-a677-4e5b-a2a6-80106b10ff45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:00.161684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7464ed-a677-4e5b-a2a6-80106b10ff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:00.161684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7464ed-a677-4e5b-a2a6-80106b10ff45 admin admin] PATH_INFO: `/v3/users/d9df67f09eef41db849f028390d147e3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:00.162001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7464ed-a677-4e5b-a2a6-80106b10ff45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9df67f09eef41db849f028390d147e3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:00.166341 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7464ed-a677-4e5b-a2a6-80106b10ff45 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:00.218351 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7b7464ed-a677-4e5b-a2a6-80106b10ff45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9df67f09eef41db849f028390d147e3'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.219009 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7b7464ed-a677-4e5b-a2a6-80106b10ff45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9df67f09eef41db849f028390d147e3'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.232361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7b7464ed-a677-4e5b-a2a6-80106b10ff45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9df67f09eef41db849f028390d147e3'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.239786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7b7464ed-a677-4e5b-a2a6-80106b10ff45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9df67f09eef41db849f028390d147e3'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.242226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7b7464ed-a677-4e5b-a2a6-80106b10ff45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9df67f09eef41db849f028390d147e3'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.261033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 932/1859] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:00 2022] DELETE /identity/v3/users/d9df67f09eef41db849f028390d147e3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:00.269683 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57434aa-7a6a-41fa-97c7-6b57fe12667f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:00.270454 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57434aa-7a6a-41fa-97c7-6b57fe12667f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:00.270985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57434aa-7a6a-41fa-97c7-6b57fe12667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:00.294326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b57434aa-7a6a-41fa-97c7-6b57fe12667f None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:00.294864 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b57434aa-7a6a-41fa-97c7-6b57fe12667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:00.366632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 928/1860] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:00.377725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7464ed-a677-4e5b-a2a6-80106b10ff45 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:00.379383 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7b7464ed-a677-4e5b-a2a6-80106b10ff45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:00.388364 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57434aa-7a6a-41fa-97c7-6b57fe12667f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:00.390016 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b57434aa-7a6a-41fa-97c7-6b57fe12667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:00.403840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57434aa-7a6a-41fa-97c7-6b57fe12667f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:00.409800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8462f3-b1a9-4009-b73c-479a9abf33d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:00.410071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8462f3-b1a9-4009-b73c-479a9abf33d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:00.410382 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8462f3-b1a9-4009-b73c-479a9abf33d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:00.410613 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8462f3-b1a9-4009-b73c-479a9abf33d6 admin admin] PATH_INFO: `/v3/projects/79a2f808e86b4b67b6b9d3b54be4ac5d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:00.412275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8462f3-b1a9-4009-b73c-479a9abf33d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a2f808e86b4b67b6b9d3b54be4ac5d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:00.415027 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8462f3-b1a9-4009-b73c-479a9abf33d6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:00.444614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7464ed-a677-4e5b-a2a6-80106b10ff45 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:00.448527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f9612-1c1d-4530-b78b-77b2b0815e04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:00.449190 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f9612-1c1d-4530-b78b-77b2b0815e04 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:00.449472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f9612-1c1d-4530-b78b-77b2b0815e04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:00.449749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f9612-1c1d-4530-b78b-77b2b0815e04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:00.462905 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f9612-1c1d-4530-b78b-77b2b0815e04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:00.464402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f9612-1c1d-4530-b78b-77b2b0815e04 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:00.475743 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 933/1861] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:00.478778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba8462f3-b1a9-4009-b73c-479a9abf33d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a2f808e86b4b67b6b9d3b54be4ac5d', 'request_id': 'req-ba8462f3-b1a9-4009-b73c-479a9abf33d6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.485458 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba8462f3-b1a9-4009-b73c-479a9abf33d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a2f808e86b4b67b6b9d3b54be4ac5d', 'request_id': 'req-ba8462f3-b1a9-4009-b73c-479a9abf33d6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.494983 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba8462f3-b1a9-4009-b73c-479a9abf33d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a2f808e86b4b67b6b9d3b54be4ac5d', 'request_id': 'req-ba8462f3-b1a9-4009-b73c-479a9abf33d6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.507557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba8462f3-b1a9-4009-b73c-479a9abf33d6 admin admin] The token cache is being invalidate because project 79a2f808e86b4b67b6b9d3b54be4ac5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:00.507930 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba8462f3-b1a9-4009-b73c-479a9abf33d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.508619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba8462f3-b1a9-4009-b73c-479a9abf33d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.510240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 929/1862] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:00 2022] DELETE /identity/v3/projects/79a2f808e86b4b67b6b9d3b54be4ac5d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:00.515193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15270c1-dd30-4315-9455-e35cd4352d7f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:00.515559 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15270c1-dd30-4315-9455-e35cd4352d7f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:00.515945 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15270c1-dd30-4315-9455-e35cd4352d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:00.534832 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a15270c1-dd30-4315-9455-e35cd4352d7f None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:00.536231 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a15270c1-dd30-4315-9455-e35cd4352d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:00.597636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 934/1863] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:00.605983 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea852b4-6600-4bed-96a8-9892f51bec0e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:00.606365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea852b4-6600-4bed-96a8-9892f51bec0e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:00.606718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea852b4-6600-4bed-96a8-9892f51bec0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:00.625946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0ea852b4-6600-4bed-96a8-9892f51bec0e None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:00.627333 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0ea852b4-6600-4bed-96a8-9892f51bec0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:00.636785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 930/1864] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:00.641208 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15270c1-dd30-4315-9455-e35cd4352d7f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:00.651785 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15270c1-dd30-4315-9455-e35cd4352d7f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:00.657363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70febf50-3642-4ea7-a7bd-bdc0bca9a199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:00.658208 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70febf50-3642-4ea7-a7bd-bdc0bca9a199 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:00.658490 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70febf50-3642-4ea7-a7bd-bdc0bca9a199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:00.658762 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70febf50-3642-4ea7-a7bd-bdc0bca9a199 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:00.659485 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70febf50-3642-4ea7-a7bd-bdc0bca9a199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:00.659876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70febf50-3642-4ea7-a7bd-bdc0bca9a199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:00.661443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70febf50-3642-4ea7-a7bd-bdc0bca9a199 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:00.674133 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 935/1865] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:00.678599 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea852b4-6600-4bed-96a8-9892f51bec0e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:00.688732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea852b4-6600-4bed-96a8-9892f51bec0e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:00.693566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fe522-e232-4f61-aa19-f6f9d0d998e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:00.694261 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fe522-e232-4f61-aa19-f6f9d0d998e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:00.694547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fe522-e232-4f61-aa19-f6f9d0d998e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:00.694819 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fe522-e232-4f61-aa19-f6f9d0d998e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:00.695623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fe522-e232-4f61-aa19-f6f9d0d998e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:00.697978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fe522-e232-4f61-aa19-f6f9d0d998e6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:00.724961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 931/1866] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:00 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:00.729827 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70febf50-3642-4ea7-a7bd-bdc0bca9a199 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:00.741482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70febf50-3642-4ea7-a7bd-bdc0bca9a199 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:00.754317 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fe522-e232-4f61-aa19-f6f9d0d998e6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:00.756480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e05fe522-e232-4f61-aa19-f6f9d0d998e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:00.808693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25129a3e-55f8-4a40-a665-9dcbebf28df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:00.809380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25129a3e-55f8-4a40-a665-9dcbebf28df1 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:00.809664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25129a3e-55f8-4a40-a665-9dcbebf28df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:00.809940 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25129a3e-55f8-4a40-a665-9dcbebf28df1 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:00.810687 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25129a3e-55f8-4a40-a665-9dcbebf28df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:00.812660 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25129a3e-55f8-4a40-a665-9dcbebf28df1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:00.828123 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fe522-e232-4f61-aa19-f6f9d0d998e6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:00.832962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2a8d5-ec07-4c38-b11c-d94154c21712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:00.833869 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2a8d5-ec07-4c38-b11c-d94154c21712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:00.834149 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2a8d5-ec07-4c38-b11c-d94154c21712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:00.834442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2a8d5-ec07-4c38-b11c-d94154c21712 admin admin] PATH_INFO: `/v3/projects/c37d5415c79c40ed9beffa8590202bd7` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:00.835786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2a8d5-ec07-4c38-b11c-d94154c21712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c37d5415c79c40ed9beffa8590202bd7)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:00.838072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2a8d5-ec07-4c38-b11c-d94154c21712 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:00.838618 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 936/1867] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:00 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:11:00.842847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25129a3e-55f8-4a40-a665-9dcbebf28df1 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:00.854186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25129a3e-55f8-4a40-a665-9dcbebf28df1 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:00.861306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c840-c645-4f96-8684-6a5852ad91e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:00.861306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c840-c645-4f96-8684-6a5852ad91e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:00.861306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c840-c645-4f96-8684-6a5852ad91e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:00.861715 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c840-c645-4f96-8684-6a5852ad91e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:00.862325 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0c840-c645-4f96-8684-6a5852ad91e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:00.864013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0c840-c645-4f96-8684-6a5852ad91e6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:00.879222 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 937/1868] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:11:00.879769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c840-c645-4f96-8684-6a5852ad91e6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:00.895361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c840-c645-4f96-8684-6a5852ad91e6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:00.908684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-87a2a8d5-ec07-4c38-b11c-d94154c21712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c37d5415c79c40ed9beffa8590202bd7', 'request_id': 'req-87a2a8d5-ec07-4c38-b11c-d94154c21712'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.916974 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-87a2a8d5-ec07-4c38-b11c-d94154c21712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c37d5415c79c40ed9beffa8590202bd7', 'request_id': 'req-87a2a8d5-ec07-4c38-b11c-d94154c21712'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.925569 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-87a2a8d5-ec07-4c38-b11c-d94154c21712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c37d5415c79c40ed9beffa8590202bd7', 'request_id': 'req-87a2a8d5-ec07-4c38-b11c-d94154c21712'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.941739 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-87a2a8d5-ec07-4c38-b11c-d94154c21712 admin admin] The token cache is being invalidate because project c37d5415c79c40ed9beffa8590202bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:00.942515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-87a2a8d5-ec07-4c38-b11c-d94154c21712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.944011 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-87a2a8d5-ec07-4c38-b11c-d94154c21712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:00.949308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 932/1869] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:00 2022] DELETE /identity/v3/projects/c37d5415c79c40ed9beffa8590202bd7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:00.967203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2a8d5-ec07-4c38-b11c-d94154c21712 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:00.969297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-87a2a8d5-ec07-4c38-b11c-d94154c21712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:00.996142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6f49a-a1d5-46c6-a052-e69ed4116e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:00.996836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6f49a-a1d5-46c6-a052-e69ed4116e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:00.997123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6f49a-a1d5-46c6-a052-e69ed4116e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:00.997461 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6f49a-a1d5-46c6-a052-e69ed4116e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:00.998616 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6f49a-a1d5-46c6-a052-e69ed4116e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:01.000279 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6f49a-a1d5-46c6-a052-e69ed4116e22 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:01.016244 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 938/1870] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:01.020128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6f49a-a1d5-46c6-a052-e69ed4116e22 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:01.024614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-54d6f49a-a1d5-46c6-a052-e69ed4116e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:01.053955 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6f49a-a1d5-46c6-a052-e69ed4116e22 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:01.060885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2a8d5-ec07-4c38-b11c-d94154c21712 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:01.066903 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e43ad-6c3a-4588-9ad3-c87b99486dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:01.067134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b894b-7353-484c-b796-5173eb0b374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:01.068113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b894b-7353-484c-b796-5173eb0b374b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:01.068395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b894b-7353-484c-b796-5173eb0b374b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:01.068669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b894b-7353-484c-b796-5173eb0b374b admin admin] PATH_INFO: `/v3/users/82bdf6f2217b4a59878c83cef765c95a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:01.070711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e43ad-6c3a-4588-9ad3-c87b99486dda admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:01.071385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b894b-7353-484c-b796-5173eb0b374b admin admin] RBAC: Authorizing `identity:delete_user(user_id=82bdf6f2217b4a59878c83cef765c95a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:01.072238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e43ad-6c3a-4588-9ad3-c87b99486dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:01.074307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b894b-7353-484c-b796-5173eb0b374b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:01.074957 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e43ad-6c3a-4588-9ad3-c87b99486dda admin admin] PATH_INFO: `/v3/projects/6eda51d31c784c18a9801ae427b4af6d/users/de76bcaccd51432ab13eec9037ad459f/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:01.110473 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e43ad-6c3a-4588-9ad3-c87b99486dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eda51d31c784c18a9801ae427b4af6d, user_id=de76bcaccd51432ab13eec9037ad459f, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:01.113237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e43ad-6c3a-4588-9ad3-c87b99486dda admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:01.143379 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 939/1871] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:01 2022] PUT /identity/v3/projects/6eda51d31c784c18a9801ae427b4af6d/users/de76bcaccd51432ab13eec9037ad459f/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:01.160127 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27108822-cd2c-49bb-9d23-1a4c99595c61 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:01.160450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27108822-cd2c-49bb-9d23-1a4c99595c61 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:01.160693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27108822-cd2c-49bb-9d23-1a4c99595c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:01.192555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e99b894b-7353-484c-b796-5173eb0b374b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82bdf6f2217b4a59878c83cef765c95a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:01.212174 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e99b894b-7353-484c-b796-5173eb0b374b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82bdf6f2217b4a59878c83cef765c95a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:01.218020 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-27108822-cd2c-49bb-9d23-1a4c99595c61 None None] MFA Rules not processed for user `de76bcaccd51432ab13eec9037ad459f`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:01.219328 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-27108822-cd2c-49bb-9d23-1a4c99595c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:01.223650 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e99b894b-7353-484c-b796-5173eb0b374b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82bdf6f2217b4a59878c83cef765c95a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:01.224454 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e99b894b-7353-484c-b796-5173eb0b374b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82bdf6f2217b4a59878c83cef765c95a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:01.225185 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e99b894b-7353-484c-b796-5173eb0b374b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82bdf6f2217b4a59878c83cef765c95a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:01.251794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 933/1872] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:00 2022] DELETE /identity/v3/users/82bdf6f2217b4a59878c83cef765c95a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:01.335580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 940/1873] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:01.341381 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b894b-7353-484c-b796-5173eb0b374b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:01.342920 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e99b894b-7353-484c-b796-5173eb0b374b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:01.435430 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b894b-7353-484c-b796-5173eb0b374b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:01.442294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4075e71-1716-4b3a-932d-538391bcc4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:01.443209 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4075e71-1716-4b3a-932d-538391bcc4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:01.443336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4075e71-1716-4b3a-932d-538391bcc4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:01.443512 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4075e71-1716-4b3a-932d-538391bcc4c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:01.444252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4075e71-1716-4b3a-932d-538391bcc4c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:01.447037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4075e71-1716-4b3a-932d-538391bcc4c5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:01.481705 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 934/1874] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:01 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:11:01.482857 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27108822-cd2c-49bb-9d23-1a4c99595c61 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:01.574152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27108822-cd2c-49bb-9d23-1a4c99595c61 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:01.647048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6238612-18db-49ff-8938-16d373ef88c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:01.649547 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6238612-18db-49ff-8938-16d373ef88c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:01.649846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6238612-18db-49ff-8938-16d373ef88c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:01.650121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6238612-18db-49ff-8938-16d373ef88c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:01.651161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6238612-18db-49ff-8938-16d373ef88c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:01.654032 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6238612-18db-49ff-8938-16d373ef88c4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:01.710517 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 941/1875] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:01 2022] POST /identity/v3/users => generated 296 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:01.711647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4075e71-1716-4b3a-932d-538391bcc4c5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:01.724040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4075e71-1716-4b3a-932d-538391bcc4c5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:01.731913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520ba27-5c7b-40e5-99b1-e8817e4cd16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:01.732670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ba27-5c7b-40e5-99b1-e8817e4cd16c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:01.732950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ba27-5c7b-40e5-99b1-e8817e4cd16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:01.733367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ba27-5c7b-40e5-99b1-e8817e4cd16c admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:01.734414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520ba27-5c7b-40e5-99b1-e8817e4cd16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:01.736856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520ba27-5c7b-40e5-99b1-e8817e4cd16c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:01.752700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 935/1876] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:01.761048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6238612-18db-49ff-8938-16d373ef88c4 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:01.773224 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6238612-18db-49ff-8938-16d373ef88c4 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:01.781104 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098a5d2-d3e8-47d6-bc3f-613860708d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:01.782016 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098a5d2-d3e8-47d6-bc3f-613860708d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:01.782295 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098a5d2-d3e8-47d6-bc3f-613860708d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:01.782565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098a5d2-d3e8-47d6-bc3f-613860708d9c admin admin] PATH_INFO: `/v3/projects/e52754b2d6214a28ad1443bbecfe6cab/users/c3f16ee3d1d048bfbd41c57a807621eb/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:01.810596 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098a5d2-d3e8-47d6-bc3f-613860708d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52754b2d6214a28ad1443bbecfe6cab, user_id=c3f16ee3d1d048bfbd41c57a807621eb, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:01.813801 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098a5d2-d3e8-47d6-bc3f-613860708d9c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:01.837799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 942/1877] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:01 2022] PUT /identity/v3/projects/e52754b2d6214a28ad1443bbecfe6cab/users/c3f16ee3d1d048bfbd41c57a807621eb/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:01.841149 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520ba27-5c7b-40e5-99b1-e8817e4cd16c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:01.860649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520ba27-5c7b-40e5-99b1-e8817e4cd16c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:01.962322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1b229-f309-4b2e-9f68-8c94202e176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:01.965406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1b229-f309-4b2e-9f68-8c94202e176f admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:01.965406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1b229-f309-4b2e-9f68-8c94202e176f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:01.965406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1b229-f309-4b2e-9f68-8c94202e176f admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:01.965406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1b229-f309-4b2e-9f68-8c94202e176f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:01.967780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1b229-f309-4b2e-9f68-8c94202e176f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:01.987332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 936/1878] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:01.993125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098a5d2-d3e8-47d6-bc3f-613860708d9c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:01.993735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1b229-f309-4b2e-9f68-8c94202e176f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:01.999791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bba1b229-f309-4b2e-9f68-8c94202e176f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:02.009683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098a5d2-d3e8-47d6-bc3f-613860708d9c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:02.012383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1b229-f309-4b2e-9f68-8c94202e176f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:02.019810 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbecbdb-4fd4-4912-ac4e-df21ef651913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:02.021541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbecbdb-4fd4-4912-ac4e-df21ef651913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:02.021831 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbecbdb-4fd4-4912-ac4e-df21ef651913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:02.022107 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbecbdb-4fd4-4912-ac4e-df21ef651913 admin admin] PATH_INFO: `/v3/projects/586f0ff5217c4e1eb6819f1904cb8fd2` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:02.024338 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbecbdb-4fd4-4912-ac4e-df21ef651913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586f0ff5217c4e1eb6819f1904cb8fd2)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:02.026934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbecbdb-4fd4-4912-ac4e-df21ef651913 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:02.036472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faf361-4102-4f2a-a37e-458b5deaf7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:02.039179 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faf361-4102-4f2a-a37e-458b5deaf7a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:02.041296 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faf361-4102-4f2a-a37e-458b5deaf7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:02.042451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faf361-4102-4f2a-a37e-458b5deaf7a2 admin admin] PATH_INFO: `/v3/projects/e52754b2d6214a28ad1443bbecfe6cab/users/c3f16ee3d1d048bfbd41c57a807621eb/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:02.048708 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faf361-4102-4f2a-a37e-458b5deaf7a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52754b2d6214a28ad1443bbecfe6cab, user_id=c3f16ee3d1d048bfbd41c57a807621eb, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:02.052495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faf361-4102-4f2a-a37e-458b5deaf7a2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:02.066492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 943/1879] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:01 2022] PUT /identity/v3/projects/e52754b2d6214a28ad1443bbecfe6cab/users/c3f16ee3d1d048bfbd41c57a807621eb/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:02.078924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e9ea6-87e2-4f17-81ec-8b9ce650dda4 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:02.079477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e9ea6-87e2-4f17-81ec-8b9ce650dda4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:02.079891 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e9ea6-87e2-4f17-81ec-8b9ce650dda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:02.109658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1fbecbdb-4fd4-4912-ac4e-df21ef651913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586f0ff5217c4e1eb6819f1904cb8fd2', 'request_id': 'req-1fbecbdb-4fd4-4912-ac4e-df21ef651913'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:02.113825 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b19e9ea6-87e2-4f17-81ec-8b9ce650dda4 None None] MFA Rules not processed for user `c3f16ee3d1d048bfbd41c57a807621eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:02.115089 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b19e9ea6-87e2-4f17-81ec-8b9ce650dda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:02.118410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1fbecbdb-4fd4-4912-ac4e-df21ef651913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586f0ff5217c4e1eb6819f1904cb8fd2', 'request_id': 'req-1fbecbdb-4fd4-4912-ac4e-df21ef651913'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:02.131807 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1fbecbdb-4fd4-4912-ac4e-df21ef651913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586f0ff5217c4e1eb6819f1904cb8fd2', 'request_id': 'req-1fbecbdb-4fd4-4912-ac4e-df21ef651913'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:02.148005 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1fbecbdb-4fd4-4912-ac4e-df21ef651913 admin admin] The token cache is being invalidate because project 586f0ff5217c4e1eb6819f1904cb8fd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:02.148348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1fbecbdb-4fd4-4912-ac4e-df21ef651913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:02.149332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1fbecbdb-4fd4-4912-ac4e-df21ef651913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:02.150956 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 937/1880] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:01 2022] DELETE /identity/v3/projects/586f0ff5217c4e1eb6819f1904cb8fd2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:02.156490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ab31c-08fe-43aa-b8b1-e860a7321093 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:02.157085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ab31c-08fe-43aa-b8b1-e860a7321093 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:02.157968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ab31c-08fe-43aa-b8b1-e860a7321093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:02.181043 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9b2ab31c-08fe-43aa-b8b1-e860a7321093 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:02.182280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9b2ab31c-08fe-43aa-b8b1-e860a7321093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:02.200920 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 944/1881] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:11:02.259119 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 938/1882] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:11:02.267894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffa3a4-7743-4647-a87d-22e96dbb9f7c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:02.268185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffa3a4-7743-4647-a87d-22e96dbb9f7c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:02.268466 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffa3a4-7743-4647-a87d-22e96dbb9f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:02.287418 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c4ffa3a4-7743-4647-a87d-22e96dbb9f7c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:02.288684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c4ffa3a4-7743-4647-a87d-22e96dbb9f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:02.297071 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 945/1883] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:02.301348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ab31c-08fe-43aa-b8b1-e860a7321093 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:02.311838 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ab31c-08fe-43aa-b8b1-e860a7321093 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:02.317117 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ef57d-b355-4f5c-9f88-6d3c0aa52b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:02.317616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ef57d-b355-4f5c-9f88-6d3c0aa52b81 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:02.317951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ef57d-b355-4f5c-9f88-6d3c0aa52b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:02.318226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ef57d-b355-4f5c-9f88-6d3c0aa52b81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:02.318958 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ef57d-b355-4f5c-9f88-6d3c0aa52b81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:02.319287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ef57d-b355-4f5c-9f88-6d3c0aa52b81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:02.321607 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ef57d-b355-4f5c-9f88-6d3c0aa52b81 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:02.333615 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 939/1884] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:02.338014 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffa3a4-7743-4647-a87d-22e96dbb9f7c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:02.347069 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffa3a4-7743-4647-a87d-22e96dbb9f7c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:02.352293 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d0332-ba61-46a0-90b7-3e8c5a675cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:02.353081 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d0332-ba61-46a0-90b7-3e8c5a675cbe admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:02.353364 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d0332-ba61-46a0-90b7-3e8c5a675cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:02.353638 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d0332-ba61-46a0-90b7-3e8c5a675cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:02.354316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d0332-ba61-46a0-90b7-3e8c5a675cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:02.356237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d0332-ba61-46a0-90b7-3e8c5a675cbe admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:02.385469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 946/1885] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:02 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:02.386608 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ef57d-b355-4f5c-9f88-6d3c0aa52b81 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:02.398258 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ef57d-b355-4f5c-9f88-6d3c0aa52b81 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:02.462512 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2020e1-cab5-4dc1-b310-6adb9bb468c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:02.463104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2020e1-cab5-4dc1-b310-6adb9bb468c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:02.463382 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2020e1-cab5-4dc1-b310-6adb9bb468c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:02.463694 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2020e1-cab5-4dc1-b310-6adb9bb468c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:02.464390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2020e1-cab5-4dc1-b310-6adb9bb468c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:02.466301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2020e1-cab5-4dc1-b310-6adb9bb468c4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:02.490489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 940/1886] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:02 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:11:02.491721 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d0332-ba61-46a0-90b7-3e8c5a675cbe admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:02.503284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d0332-ba61-46a0-90b7-3e8c5a675cbe admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:02.509136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034c383-b5f2-418d-9d15-7cd8586800cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:02.509927 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c383-b5f2-418d-9d15-7cd8586800cb admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:02.510372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c383-b5f2-418d-9d15-7cd8586800cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:02.510636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c383-b5f2-418d-9d15-7cd8586800cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:02.511422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034c383-b5f2-418d-9d15-7cd8586800cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:02.513323 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034c383-b5f2-418d-9d15-7cd8586800cb admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:02.525314 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 947/1887] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:02.532391 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2020e1-cab5-4dc1-b310-6adb9bb468c4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:02.543913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2020e1-cab5-4dc1-b310-6adb9bb468c4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:02.549142 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aad3e9-e8ca-4b49-8b16-1d8fcfa1e182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:02.550164 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aad3e9-e8ca-4b49-8b16-1d8fcfa1e182 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:02.550286 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aad3e9-e8ca-4b49-8b16-1d8fcfa1e182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:02.550496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aad3e9-e8ca-4b49-8b16-1d8fcfa1e182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:02.552614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aad3e9-e8ca-4b49-8b16-1d8fcfa1e182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:02.553107 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aad3e9-e8ca-4b49-8b16-1d8fcfa1e182 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:02.565235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 941/1888] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:02.569237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034c383-b5f2-418d-9d15-7cd8586800cb admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:02.583812 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034c383-b5f2-418d-9d15-7cd8586800cb admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:02.610319 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912645a-c598-4f85-b829-880f198cdbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:02.612387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912645a-c598-4f85-b829-880f198cdbd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:02.612699 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912645a-c598-4f85-b829-880f198cdbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:02.614217 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912645a-c598-4f85-b829-880f198cdbd2 admin admin] PATH_INFO: `/v3/projects/28cbfdc92008431182a14cf4b067b503/users/ef3e9041b23942eb8677533ce33d9506/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:02.660993 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912645a-c598-4f85-b829-880f198cdbd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28cbfdc92008431182a14cf4b067b503, user_id=ef3e9041b23942eb8677533ce33d9506, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:02.660993 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912645a-c598-4f85-b829-880f198cdbd2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:02.694140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 948/1889] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:02 2022] PUT /identity/v3/projects/28cbfdc92008431182a14cf4b067b503/users/ef3e9041b23942eb8677533ce33d9506/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:02.700071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715eff-4e09-4e95-ba76-0276b141dc9a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:02.700071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715eff-4e09-4e95-ba76-0276b141dc9a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:02.700071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715eff-4e09-4e95-ba76-0276b141dc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:02.753774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b5715eff-4e09-4e95-ba76-0276b141dc9a None None] MFA Rules not processed for user `ef3e9041b23942eb8677533ce33d9506`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:02.756640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b5715eff-4e09-4e95-ba76-0276b141dc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:02.846210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 942/1890] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:02.850920 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912645a-c598-4f85-b829-880f198cdbd2 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:02.937664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912645a-c598-4f85-b829-880f198cdbd2 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:02.942332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7c6c9-c121-4a4d-b2ed-a456d00fd737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:02.942995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7c6c9-c121-4a4d-b2ed-a456d00fd737 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:02.943279 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7c6c9-c121-4a4d-b2ed-a456d00fd737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:02.943572 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7c6c9-c121-4a4d-b2ed-a456d00fd737 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:02.944291 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7c6c9-c121-4a4d-b2ed-a456d00fd737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:02.946528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7c6c9-c121-4a4d-b2ed-a456d00fd737 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:02.976370 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 949/1891] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:02 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:11:02.978082 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5715eff-4e09-4e95-ba76-0276b141dc9a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:02.988636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5715eff-4e09-4e95-ba76-0276b141dc9a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:03.056494 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec85b2-b2fd-48e0-b57d-37997e8161a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:03.057290 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec85b2-b2fd-48e0-b57d-37997e8161a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:03.057682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec85b2-b2fd-48e0-b57d-37997e8161a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:03.058030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec85b2-b2fd-48e0-b57d-37997e8161a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:03.058945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec85b2-b2fd-48e0-b57d-37997e8161a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:03.061147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec85b2-b2fd-48e0-b57d-37997e8161a3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:03.084765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 943/1892] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:02 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:11:03.088566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7c6c9-c121-4a4d-b2ed-a456d00fd737 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:03.110793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7c6c9-c121-4a4d-b2ed-a456d00fd737 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:03.135135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cec62-0066-43a1-9766-2662e480729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:03.135135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cec62-0066-43a1-9766-2662e480729e admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:03.135135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cec62-0066-43a1-9766-2662e480729e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:03.135135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cec62-0066-43a1-9766-2662e480729e admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:03.135722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cec62-0066-43a1-9766-2662e480729e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:03.135722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cec62-0066-43a1-9766-2662e480729e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:03.150742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 950/1893] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:03.155249 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec85b2-b2fd-48e0-b57d-37997e8161a3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:03.167130 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec85b2-b2fd-48e0-b57d-37997e8161a3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:03.172288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285a766-2a49-4fd4-9573-5fc52999ef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:03.173041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285a766-2a49-4fd4-9573-5fc52999ef37 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:03.173386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285a766-2a49-4fd4-9573-5fc52999ef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:03.173720 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285a766-2a49-4fd4-9573-5fc52999ef37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:03.174509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285a766-2a49-4fd4-9573-5fc52999ef37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:03.176515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285a766-2a49-4fd4-9573-5fc52999ef37 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:03.188591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 944/1894] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:03.192341 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cec62-0066-43a1-9766-2662e480729e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:03.202817 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cec62-0066-43a1-9766-2662e480729e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:03.208799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371f4ae-636b-441d-9efe-97feac929a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:03.209844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f4ae-636b-441d-9efe-97feac929a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:03.210372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f4ae-636b-441d-9efe-97feac929a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:03.210971 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f4ae-636b-441d-9efe-97feac929a7c admin admin] PATH_INFO: `/v3/projects/fcef5f77c3444106b7f620570539e15d/users/1082c169197f40038bc6fecaba153413/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:03.227276 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371f4ae-636b-441d-9efe-97feac929a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcef5f77c3444106b7f620570539e15d, user_id=1082c169197f40038bc6fecaba153413, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:03.230499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371f4ae-636b-441d-9efe-97feac929a7c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:03.256065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 951/1895] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:03 2022] PUT /identity/v3/projects/fcef5f77c3444106b7f620570539e15d/users/1082c169197f40038bc6fecaba153413/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:03.258627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbf9c1-985a-4256-8c59-461e28b11002 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:03.259156 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbf9c1-985a-4256-8c59-461e28b11002 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:03.259529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbf9c1-985a-4256-8c59-461e28b11002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:03.273273 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f7c92-7a44-4048-8439-678b822af0e7 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:03.273690 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f7c92-7a44-4048-8439-678b822af0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:03.274070 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f7c92-7a44-4048-8439-678b822af0e7 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:03.275819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 952/1896] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 17:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:11:03.283754 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f362c1-a384-4f06-9a14-b73d63b76a43 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:03.284242 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f362c1-a384-4f06-9a14-b73d63b76a43 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:03.284788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f362c1-a384-4f06-9a14-b73d63b76a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:03.309225 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-fdcbf9c1-985a-4256-8c59-461e28b11002 None None] MFA Rules not processed for user `1082c169197f40038bc6fecaba153413`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:03.311109 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fdcbf9c1-985a-4256-8c59-461e28b11002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:03.321547 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-96f362c1-a384-4f06-9a14-b73d63b76a43 None None] MFA Rules not processed for user `5becb135afbd43e9bc0b1347ba04e2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:03.323212 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-96f362c1-a384-4f06-9a14-b73d63b76a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:03.478590 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 953/1897] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 17:11:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:11:03.478694 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 945/1898] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:03.479121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f362c1-a384-4f06-9a14-b73d63b76a43 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:03.492945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbf9c1-985a-4256-8c59-461e28b11002 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:03.495555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fdcbf9c1-985a-4256-8c59-461e28b11002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:03.518388 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbf9c1-985a-4256-8c59-461e28b11002 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:03.530635 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ed10-5e3a-4547-8fef-5d1ea7b690c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:03.531477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ed10-5e3a-4547-8fef-5d1ea7b690c2 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:03.532615 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ed10-5e3a-4547-8fef-5d1ea7b690c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:03.532998 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ed10-5e3a-4547-8fef-5d1ea7b690c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:03.545458 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925ed10-5e3a-4547-8fef-5d1ea7b690c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:03.547124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925ed10-5e3a-4547-8fef-5d1ea7b690c2 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:03.558002 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f362c1-a384-4f06-9a14-b73d63b76a43 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:03.559323 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 946/1899] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:11:03.563158 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba055bc-4ff8-4eb5-a39c-5c1f86f629df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:03.563851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba055bc-4ff8-4eb5-a39c-5c1f86f629df admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:03.564131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba055bc-4ff8-4eb5-a39c-5c1f86f629df admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:03.564413 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba055bc-4ff8-4eb5-a39c-5c1f86f629df admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:03.565112 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba055bc-4ff8-4eb5-a39c-5c1f86f629df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:03.567017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba055bc-4ff8-4eb5-a39c-5c1f86f629df admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:03.597939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 954/1900] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:03 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:03.602853 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ed10-5e3a-4547-8fef-5d1ea7b690c2 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:03.613986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ed10-5e3a-4547-8fef-5d1ea7b690c2 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:03.677634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142efc7-01d8-4e05-b6ea-8437db4a5fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:03.678307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142efc7-01d8-4e05-b6ea-8437db4a5fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:03.678587 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142efc7-01d8-4e05-b6ea-8437db4a5fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:03.678859 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142efc7-01d8-4e05-b6ea-8437db4a5fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:03.679563 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142efc7-01d8-4e05-b6ea-8437db4a5fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:03.681509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142efc7-01d8-4e05-b6ea-8437db4a5fd6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:03.700588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 947/1901] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:03 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:03.704972 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba055bc-4ff8-4eb5-a39c-5c1f86f629df admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:03.716689 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba055bc-4ff8-4eb5-a39c-5c1f86f629df admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:03.722128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797697b9-5f10-4264-bbe0-002ea7411982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:03.722974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797697b9-5f10-4264-bbe0-002ea7411982 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:03.723422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797697b9-5f10-4264-bbe0-002ea7411982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:03.723839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797697b9-5f10-4264-bbe0-002ea7411982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:03.724606 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797697b9-5f10-4264-bbe0-002ea7411982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:03.727532 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797697b9-5f10-4264-bbe0-002ea7411982 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:03.738487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 955/1902] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:03.742877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142efc7-01d8-4e05-b6ea-8437db4a5fd6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:03.752712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142efc7-01d8-4e05-b6ea-8437db4a5fd6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:03.757986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81ea37-a340-4d58-9a04-772a6400fafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:03.758877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81ea37-a340-4d58-9a04-772a6400fafd admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:03.759152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81ea37-a340-4d58-9a04-772a6400fafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:03.759421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81ea37-a340-4d58-9a04-772a6400fafd admin admin] PATH_INFO: `/v3/projects/cef831fec8a044d1954c304a13c7af4b/users/ba260c305dee40f2ad50a878648628ee/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:03.776187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81ea37-a340-4d58-9a04-772a6400fafd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef831fec8a044d1954c304a13c7af4b, user_id=ba260c305dee40f2ad50a878648628ee, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:03.779342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81ea37-a340-4d58-9a04-772a6400fafd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:03.794216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 948/1903] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:03 2022] PUT /identity/v3/projects/cef831fec8a044d1954c304a13c7af4b/users/ba260c305dee40f2ad50a878648628ee/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:03.798270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797697b9-5f10-4264-bbe0-002ea7411982 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:03.809135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797697b9-5f10-4264-bbe0-002ea7411982 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:03.883648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81693ddb-e5a2-4156-a703-6e8cf3df7ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:03.884255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81693ddb-e5a2-4156-a703-6e8cf3df7ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:03.884539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81693ddb-e5a2-4156-a703-6e8cf3df7ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:03.884817 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81693ddb-e5a2-4156-a703-6e8cf3df7ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:03.887877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81693ddb-e5a2-4156-a703-6e8cf3df7ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:03.887877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81693ddb-e5a2-4156-a703-6e8cf3df7ae6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:03.899252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 956/1904] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:03.903533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81ea37-a340-4d58-9a04-772a6400fafd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:03.916164 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81ea37-a340-4d58-9a04-772a6400fafd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:03.925257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d88a5-834a-4ee8-8a02-cbe43f80ffb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:03.926506 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d88a5-834a-4ee8-8a02-cbe43f80ffb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:03.927987 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d88a5-834a-4ee8-8a02-cbe43f80ffb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:03.928617 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d88a5-834a-4ee8-8a02-cbe43f80ffb6 admin admin] PATH_INFO: `/v3/projects/cef831fec8a044d1954c304a13c7af4b/users/ba260c305dee40f2ad50a878648628ee/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:03.932961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d88a5-834a-4ee8-8a02-cbe43f80ffb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef831fec8a044d1954c304a13c7af4b, user_id=ba260c305dee40f2ad50a878648628ee, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:03.938614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d88a5-834a-4ee8-8a02-cbe43f80ffb6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:03.960241 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 949/1905] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:03 2022] PUT /identity/v3/projects/cef831fec8a044d1954c304a13c7af4b/users/ba260c305dee40f2ad50a878648628ee/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:03.971896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecdf7d-315d-4fe8-9b8e-ec5f45bf6b01 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:03.972700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecdf7d-315d-4fe8-9b8e-ec5f45bf6b01 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:03.972700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecdf7d-315d-4fe8-9b8e-ec5f45bf6b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:04.002427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c5ecdf7d-315d-4fe8-9b8e-ec5f45bf6b01 None None] MFA Rules not processed for user `ba260c305dee40f2ad50a878648628ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:04.003853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c5ecdf7d-315d-4fe8-9b8e-ec5f45bf6b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:04.040668 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d88a5-834a-4ee8-8a02-cbe43f80ffb6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:04.041895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-374d88a5-834a-4ee8-8a02-cbe43f80ffb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:04.094801 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 957/1906] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:11:04.107979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecdf7d-315d-4fe8-9b8e-ec5f45bf6b01 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:04.109530 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c5ecdf7d-315d-4fe8-9b8e-ec5f45bf6b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:04.125376 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d88a5-834a-4ee8-8a02-cbe43f80ffb6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:04.127410 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecdf7d-315d-4fe8-9b8e-ec5f45bf6b01 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:04.129042 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf9668-8dcc-4c30-96e3-9236f74b35dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:04.129696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf9668-8dcc-4c30-96e3-9236f74b35dd service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:04.129976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf9668-8dcc-4c30-96e3-9236f74b35dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:04.130249 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf9668-8dcc-4c30-96e3-9236f74b35dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:04.131705 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be897fc7-df2b-4aef-b215-ba3d649b3126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:04.132056 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e9bf9668-8dcc-4c30-96e3-9236f74b35dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:04.132655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be897fc7-df2b-4aef-b215-ba3d649b3126 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:04.133048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be897fc7-df2b-4aef-b215-ba3d649b3126 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:04.133393 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be897fc7-df2b-4aef-b215-ba3d649b3126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:04.195509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be897fc7-df2b-4aef-b215-ba3d649b3126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:04.196974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be897fc7-df2b-4aef-b215-ba3d649b3126 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:04.198288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf9668-8dcc-4c30-96e3-9236f74b35dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:04.199793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf9668-8dcc-4c30-96e3-9236f74b35dd service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:04.206679 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 958/1907] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:11:04.212172 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 950/1908] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:11:05.736596 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be897fc7-df2b-4aef-b215-ba3d649b3126 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:05.745583 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be897fc7-df2b-4aef-b215-ba3d649b3126 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:05.750004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c39358-18bd-4262-a3a0-b990aad3057a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:05.750767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39358-18bd-4262-a3a0-b990aad3057a service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:05.751294 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39358-18bd-4262-a3a0-b990aad3057a service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:05.751691 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39358-18bd-4262-a3a0-b990aad3057a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:05.819832 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c39358-18bd-4262-a3a0-b990aad3057a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:05.830032 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c39358-18bd-4262-a3a0-b990aad3057a service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:05.832483 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 959/1909] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:06.550817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf9668-8dcc-4c30-96e3-9236f74b35dd service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:06.560789 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf9668-8dcc-4c30-96e3-9236f74b35dd service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:06.565561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300eef1-3a25-49ea-9ee2-741ae12c6966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:06.566578 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300eef1-3a25-49ea-9ee2-741ae12c6966 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:06.566878 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300eef1-3a25-49ea-9ee2-741ae12c6966 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:06.567344 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300eef1-3a25-49ea-9ee2-741ae12c6966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:06.585622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300eef1-3a25-49ea-9ee2-741ae12c6966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:06.587204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300eef1-3a25-49ea-9ee2-741ae12c6966 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:06.598557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 951/1910] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:06.860895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c39358-18bd-4262-a3a0-b990aad3057a service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:06.862321 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-24c39358-18bd-4262-a3a0-b990aad3057a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:06.875677 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300eef1-3a25-49ea-9ee2-741ae12c6966 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:06.883896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300eef1-3a25-49ea-9ee2-741ae12c6966 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:06.887533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04fca1-f32c-4d6a-a5cc-bfaec26d522f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:06.888195 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04fca1-f32c-4d6a-a5cc-bfaec26d522f service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:06.888527 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04fca1-f32c-4d6a-a5cc-bfaec26d522f service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:06.888800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04fca1-f32c-4d6a-a5cc-bfaec26d522f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:06.932328 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c39358-18bd-4262-a3a0-b990aad3057a service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:06.936870 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56614d-b721-4843-892a-fea0602636d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:06.937734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56614d-b721-4843-892a-fea0602636d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:06.938017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56614d-b721-4843-892a-fea0602636d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:06.938279 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56614d-b721-4843-892a-fea0602636d3 admin admin] PATH_INFO: `/v3/users/e1f0e71e0a34494a876ad3318cb25d68` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:06.939648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56614d-b721-4843-892a-fea0602636d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f0e71e0a34494a876ad3318cb25d68)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:06.941733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56614d-b721-4843-892a-fea0602636d3 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:06.953685 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04fca1-f32c-4d6a-a5cc-bfaec26d522f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:06.955231 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04fca1-f32c-4d6a-a5cc-bfaec26d522f service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:06.965385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 952/1911] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:11:06.993258 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5c56614d-b721-4843-892a-fea0602636d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f0e71e0a34494a876ad3318cb25d68'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:06.993946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5c56614d-b721-4843-892a-fea0602636d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f0e71e0a34494a876ad3318cb25d68'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:07.008248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5c56614d-b721-4843-892a-fea0602636d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f0e71e0a34494a876ad3318cb25d68'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:07.016971 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5c56614d-b721-4843-892a-fea0602636d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f0e71e0a34494a876ad3318cb25d68'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:07.017905 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5c56614d-b721-4843-892a-fea0602636d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f0e71e0a34494a876ad3318cb25d68'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:07.036113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 960/1912] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:06 2022] DELETE /identity/v3/users/e1f0e71e0a34494a876ad3318cb25d68 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:07.042658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9b7a2-0039-4795-94fc-c339bd1278d0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:07.043518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9b7a2-0039-4795-94fc-c339bd1278d0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:07.043869 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9b7a2-0039-4795-94fc-c339bd1278d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:07.073103 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-57e9b7a2-0039-4795-94fc-c339bd1278d0 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:07.074321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-57e9b7a2-0039-4795-94fc-c339bd1278d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:07.146562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 953/1913] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:07.158821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56614d-b721-4843-892a-fea0602636d3 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:07.160966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5c56614d-b721-4843-892a-fea0602636d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:07.231109 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56614d-b721-4843-892a-fea0602636d3 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:07.237411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cdff1-d66f-4679-b524-33596c96391a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:07.238184 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cdff1-d66f-4679-b524-33596c96391a service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:07.238474 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cdff1-d66f-4679-b524-33596c96391a service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:07.238756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cdff1-d66f-4679-b524-33596c96391a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:07.250247 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cdff1-d66f-4679-b524-33596c96391a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:07.252209 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cdff1-d66f-4679-b524-33596c96391a service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:07.265773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 961/1914] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:07.384828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9b7a2-0039-4795-94fc-c339bd1278d0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:07.386627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-57e9b7a2-0039-4795-94fc-c339bd1278d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:07.489954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9b7a2-0039-4795-94fc-c339bd1278d0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:07.497452 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4483e5-d38d-471c-adb7-2fc1781f24ce tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f16ee3d1d048bfbd41c57a807621eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52754b2d6214a28ad1443bbecfe6cab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:07.497984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4483e5-d38d-471c-adb7-2fc1781f24ce tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:07.498269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4483e5-d38d-471c-adb7-2fc1781f24ce tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:07.498806 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4483e5-d38d-471c-adb7-2fc1781f24ce tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:07.499384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4483e5-d38d-471c-adb7-2fc1781f24ce tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:07.499658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4483e5-d38d-471c-adb7-2fc1781f24ce tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:07.501597 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4483e5-d38d-471c-adb7-2fc1781f24ce tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:07.526066 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 954/1915] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:07.526839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cdff1-d66f-4679-b524-33596c96391a service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:07.541215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cdff1-d66f-4679-b524-33596c96391a service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:07.549930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc91ee-7e06-4912-9b76-041212ff35ef tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f16ee3d1d048bfbd41c57a807621eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52754b2d6214a28ad1443bbecfe6cab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:07.551340 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc91ee-7e06-4912-9b76-041212ff35ef tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:07.551991 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc91ee-7e06-4912-9b76-041212ff35ef tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:07.552476 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc91ee-7e06-4912-9b76-041212ff35ef tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:07.553343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc91ee-7e06-4912-9b76-041212ff35ef tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:07.557469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc91ee-7e06-4912-9b76-041212ff35ef tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:07.643721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4483e5-d38d-471c-adb7-2fc1781f24ce tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:07.650497 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 962/1916] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:07 2022] POST /identity/v3/projects => generated 355 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:11:07.660442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc91ee-7e06-4912-9b76-041212ff35ef tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:07.661679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4483e5-d38d-471c-adb7-2fc1781f24ce tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:07.665014 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f7cc91ee-7e06-4912-9b76-041212ff35ef tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:07.797270 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095a920-3e7f-42eb-a2ac-a743f1443e47 tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f16ee3d1d048bfbd41c57a807621eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52754b2d6214a28ad1443bbecfe6cab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:07.798660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a920-3e7f-42eb-a2ac-a743f1443e47 tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:07.799183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a920-3e7f-42eb-a2ac-a743f1443e47 tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:07.800248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a920-3e7f-42eb-a2ac-a743f1443e47 tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:07.811488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095a920-3e7f-42eb-a2ac-a743f1443e47 tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:07.811488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095a920-3e7f-42eb-a2ac-a743f1443e47 tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:07.813346 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095a920-3e7f-42eb-a2ac-a743f1443e47 tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:07.839520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 955/1917] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:07.888189 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc91ee-7e06-4912-9b76-041212ff35ef tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:07.904347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:07.904347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:07.904347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:07.904347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d admin admin] PATH_INFO: `/v3/projects/0e4d6d3a006c486ca5f752c6f0c6f411` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:07.906938 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095a920-3e7f-42eb-a2ac-a743f1443e47 tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:07.912325 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4d6d3a006c486ca5f752c6f0c6f411)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:07.918543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:07.923658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095a920-3e7f-42eb-a2ac-a743f1443e47 tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:07.933131 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f16ee3d1d048bfbd41c57a807621eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52754b2d6214a28ad1443bbecfe6cab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:07.933671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:07.933963 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:07.934239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] PATH_INFO: `/v3/projects/552c35b177364ad1bfa94a718bc45c9f` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:07.936187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] RBAC: Authorizing `identity:delete_project(project_id=552c35b177364ad1bfa94a718bc45c9f)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:07.938409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:08.024612 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4d6d3a006c486ca5f752c6f0c6f411', 'request_id': 'req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.028527 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552c35b177364ad1bfa94a718bc45c9f', 'request_id': 'req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.032728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4d6d3a006c486ca5f752c6f0c6f411', 'request_id': 'req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.036491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552c35b177364ad1bfa94a718bc45c9f', 'request_id': 'req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.046082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4d6d3a006c486ca5f752c6f0c6f411', 'request_id': 'req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.065836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d admin admin] The token cache is being invalidate because project 0e4d6d3a006c486ca5f752c6f0c6f411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:08.066866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.067941 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.068671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552c35b177364ad1bfa94a718bc45c9f', 'request_id': 'req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.070734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 963/1918] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:07 2022] DELETE /identity/v3/projects/0e4d6d3a006c486ca5f752c6f0c6f411 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:08.075760 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:08.077444 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:08.097991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] The token cache is being invalidate because project 552c35b177364ad1bfa94a718bc45c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:08.098293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.099072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.104690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 956/1919] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:07 2022] DELETE /identity/v3/projects/552c35b177364ad1bfa94a718bc45c9f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:08.153054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2e66d-533f-4ec9-aeb9-13afaea1b35d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:08.160022 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452e1ac-aa7c-4f1b-b69d-41a122c7b9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:08.161477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e1ac-aa7c-4f1b-b69d-41a122c7b9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:08.161981 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e1ac-aa7c-4f1b-b69d-41a122c7b9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:08.162460 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e1ac-aa7c-4f1b-b69d-41a122c7b9b0 admin admin] PATH_INFO: `/v3/users/e0162614d5704b99a5ec40fee8d88030` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:08.165263 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452e1ac-aa7c-4f1b-b69d-41a122c7b9b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0162614d5704b99a5ec40fee8d88030)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:08.168412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452e1ac-aa7c-4f1b-b69d-41a122c7b9b0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:08.252021 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e452e1ac-aa7c-4f1b-b69d-41a122c7b9b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0162614d5704b99a5ec40fee8d88030'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.253188 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e452e1ac-aa7c-4f1b-b69d-41a122c7b9b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0162614d5704b99a5ec40fee8d88030'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.283363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e452e1ac-aa7c-4f1b-b69d-41a122c7b9b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0162614d5704b99a5ec40fee8d88030'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.300143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e452e1ac-aa7c-4f1b-b69d-41a122c7b9b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0162614d5704b99a5ec40fee8d88030'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.302652 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e452e1ac-aa7c-4f1b-b69d-41a122c7b9b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0162614d5704b99a5ec40fee8d88030'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.339470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 964/1920] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:08 2022] DELETE /identity/v3/users/e0162614d5704b99a5ec40fee8d88030 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:08.422021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:08.423524 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:08.500796 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fb1b0-a8ba-4ba9-9483-ee83e1da437b tempest-VolumeQuotaClassesTest-561711517 tempest-VolumeQuotaClassesTest-561711517-project-admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:08.578088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1afd0-16ca-4dc2-8be0-f7efb0887959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:08.579015 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1afd0-16ca-4dc2-8be0-f7efb0887959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:08.579257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1afd0-16ca-4dc2-8be0-f7efb0887959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:08.579525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1afd0-16ca-4dc2-8be0-f7efb0887959 admin admin] PATH_INFO: `/v3/users/de76bcaccd51432ab13eec9037ad459f` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:08.580884 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1afd0-16ca-4dc2-8be0-f7efb0887959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de76bcaccd51432ab13eec9037ad459f)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:08.582992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1afd0-16ca-4dc2-8be0-f7efb0887959 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:08.643711 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31b1afd0-16ca-4dc2-8be0-f7efb0887959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de76bcaccd51432ab13eec9037ad459f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.657860 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31b1afd0-16ca-4dc2-8be0-f7efb0887959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de76bcaccd51432ab13eec9037ad459f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.666785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31b1afd0-16ca-4dc2-8be0-f7efb0887959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de76bcaccd51432ab13eec9037ad459f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.669667 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31b1afd0-16ca-4dc2-8be0-f7efb0887959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de76bcaccd51432ab13eec9037ad459f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.670388 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-31b1afd0-16ca-4dc2-8be0-f7efb0887959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de76bcaccd51432ab13eec9037ad459f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.689529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 957/1921] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:08 2022] DELETE /identity/v3/users/de76bcaccd51432ab13eec9037ad459f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:08.694945 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84645b-b1b5-4c34-9cbc-9f49f7e6fbc8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:08.695998 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84645b-b1b5-4c34-9cbc-9f49f7e6fbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:08.696857 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84645b-b1b5-4c34-9cbc-9f49f7e6fbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:08.704965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1afd0-16ca-4dc2-8be0-f7efb0887959 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:08.709449 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-31b1afd0-16ca-4dc2-8be0-f7efb0887959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:08.727928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2d84645b-b1b5-4c34-9cbc-9f49f7e6fbc8 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:08.729652 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2d84645b-b1b5-4c34-9cbc-9f49f7e6fbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:08.800633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1afd0-16ca-4dc2-8be0-f7efb0887959 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:08.801207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 965/1922] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:08.805928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d41bc-6587-4347-a758-1eb1f84d73d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:08.806792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d41bc-6587-4347-a758-1eb1f84d73d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:08.807073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d41bc-6587-4347-a758-1eb1f84d73d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:08.807349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d41bc-6587-4347-a758-1eb1f84d73d2 admin admin] PATH_INFO: `/v3/projects/57f208a3e9764565a6f19307de23a8af` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:08.808545 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d41bc-6587-4347-a758-1eb1f84d73d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f208a3e9764565a6f19307de23a8af)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:08.810475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d41bc-6587-4347-a758-1eb1f84d73d2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:08.811270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84645b-b1b5-4c34-9cbc-9f49f7e6fbc8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:08.812978 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2d84645b-b1b5-4c34-9cbc-9f49f7e6fbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:08.855845 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-252d41bc-6587-4347-a758-1eb1f84d73d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f208a3e9764565a6f19307de23a8af', 'request_id': 'req-252d41bc-6587-4347-a758-1eb1f84d73d2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.861018 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-252d41bc-6587-4347-a758-1eb1f84d73d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f208a3e9764565a6f19307de23a8af', 'request_id': 'req-252d41bc-6587-4347-a758-1eb1f84d73d2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.868037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-252d41bc-6587-4347-a758-1eb1f84d73d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f208a3e9764565a6f19307de23a8af', 'request_id': 'req-252d41bc-6587-4347-a758-1eb1f84d73d2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.872122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84645b-b1b5-4c34-9cbc-9f49f7e6fbc8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:08.879066 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-252d41bc-6587-4347-a758-1eb1f84d73d2 admin admin] The token cache is being invalidate because project 57f208a3e9764565a6f19307de23a8af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:08.879351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-252d41bc-6587-4347-a758-1eb1f84d73d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.880017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-252d41bc-6587-4347-a758-1eb1f84d73d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:08.881576 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 958/1923] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:08 2022] DELETE /identity/v3/projects/57f208a3e9764565a6f19307de23a8af => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:08.885944 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d41bc-6587-4347-a758-1eb1f84d73d2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:08.887212 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-252d41bc-6587-4347-a758-1eb1f84d73d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:08.920555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183142b-bcc8-4736-ba5e-8098515fba2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:08.921117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183142b-bcc8-4736-ba5e-8098515fba2d service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:08.921576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183142b-bcc8-4736-ba5e-8098515fba2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:08.921848 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183142b-bcc8-4736-ba5e-8098515fba2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:08.923736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e183142b-bcc8-4736-ba5e-8098515fba2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:08.951939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d41bc-6587-4347-a758-1eb1f84d73d2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:08.956868 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1357a-1f7b-4455-9b44-fde969a06a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:08.957750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1357a-1f7b-4455-9b44-fde969a06a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:08.958034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1357a-1f7b-4455-9b44-fde969a06a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:08.958309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1357a-1f7b-4455-9b44-fde969a06a89 admin admin] PATH_INFO: `/v3/users/baa528f8b30c42919d0913adedae178e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:08.959502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1357a-1f7b-4455-9b44-fde969a06a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baa528f8b30c42919d0913adedae178e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:08.961883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1357a-1f7b-4455-9b44-fde969a06a89 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:08.987440 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183142b-bcc8-4736-ba5e-8098515fba2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:08.988930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183142b-bcc8-4736-ba5e-8098515fba2d service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:09.000803 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 966/1924] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:11:09.017325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-33c1357a-1f7b-4455-9b44-fde969a06a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baa528f8b30c42919d0913adedae178e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.040484 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-33c1357a-1f7b-4455-9b44-fde969a06a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baa528f8b30c42919d0913adedae178e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.050228 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-33c1357a-1f7b-4455-9b44-fde969a06a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baa528f8b30c42919d0913adedae178e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.050976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-33c1357a-1f7b-4455-9b44-fde969a06a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baa528f8b30c42919d0913adedae178e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.051591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-33c1357a-1f7b-4455-9b44-fde969a06a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baa528f8b30c42919d0913adedae178e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.071646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 959/1925] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:08 2022] DELETE /identity/v3/users/baa528f8b30c42919d0913adedae178e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:09.338436 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183142b-bcc8-4736-ba5e-8098515fba2d service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:09.339874 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e183142b-bcc8-4736-ba5e-8098515fba2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:09.360756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183142b-bcc8-4736-ba5e-8098515fba2d service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:09.424533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1357a-1f7b-4455-9b44-fde969a06a89 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:09.426153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-33c1357a-1f7b-4455-9b44-fde969a06a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:09.440666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5378d3f-471c-4453-bee5-caeb6e42f409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:09.441544 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5378d3f-471c-4453-bee5-caeb6e42f409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:09.441904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5378d3f-471c-4453-bee5-caeb6e42f409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:09.442092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5378d3f-471c-4453-bee5-caeb6e42f409 admin admin] PATH_INFO: `/v3/projects/6eda51d31c784c18a9801ae427b4af6d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:09.443468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5378d3f-471c-4453-bee5-caeb6e42f409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eda51d31c784c18a9801ae427b4af6d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:09.446391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5378d3f-471c-4453-bee5-caeb6e42f409 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:09.497912 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1357a-1f7b-4455-9b44-fde969a06a89 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:09.500959 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e5378d3f-471c-4453-bee5-caeb6e42f409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eda51d31c784c18a9801ae427b4af6d', 'request_id': 'req-e5378d3f-471c-4453-bee5-caeb6e42f409'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.506412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e5378d3f-471c-4453-bee5-caeb6e42f409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eda51d31c784c18a9801ae427b4af6d', 'request_id': 'req-e5378d3f-471c-4453-bee5-caeb6e42f409'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.517114 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e5378d3f-471c-4453-bee5-caeb6e42f409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eda51d31c784c18a9801ae427b4af6d', 'request_id': 'req-e5378d3f-471c-4453-bee5-caeb6e42f409'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.530216 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e5378d3f-471c-4453-bee5-caeb6e42f409 admin admin] The token cache is being invalidate because project 6eda51d31c784c18a9801ae427b4af6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:09.530601 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e5378d3f-471c-4453-bee5-caeb6e42f409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.531301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e5378d3f-471c-4453-bee5-caeb6e42f409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.535726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 967/1926] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:09 2022] DELETE /identity/v3/projects/6eda51d31c784c18a9801ae427b4af6d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:09.536681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5378d3f-471c-4453-bee5-caeb6e42f409 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:09.537921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e5378d3f-471c-4453-bee5-caeb6e42f409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:09.559574 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342d67e-849d-4521-9f79-04f8c3bfa933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:09.560573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342d67e-849d-4521-9f79-04f8c3bfa933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:09.560942 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342d67e-849d-4521-9f79-04f8c3bfa933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:09.561167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342d67e-849d-4521-9f79-04f8c3bfa933 admin admin] PATH_INFO: `/v3/projects/9576cf63a004497e80bbefc35c787c27` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:09.562655 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e342d67e-849d-4521-9f79-04f8c3bfa933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9576cf63a004497e80bbefc35c787c27)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:09.564789 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e342d67e-849d-4521-9f79-04f8c3bfa933 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:09.604079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5378d3f-471c-4453-bee5-caeb6e42f409 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:09.609208 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6bf12-1fe5-4c30-93db-cdbdff1076ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:09.610083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6bf12-1fe5-4c30-93db-cdbdff1076ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:09.610366 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6bf12-1fe5-4c30-93db-cdbdff1076ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:09.610643 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6bf12-1fe5-4c30-93db-cdbdff1076ba admin admin] PATH_INFO: `/v3/users/c3f16ee3d1d048bfbd41c57a807621eb` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:09.611874 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6bf12-1fe5-4c30-93db-cdbdff1076ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f16ee3d1d048bfbd41c57a807621eb)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:09.613802 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6bf12-1fe5-4c30-93db-cdbdff1076ba admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:09.623340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e342d67e-849d-4521-9f79-04f8c3bfa933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9576cf63a004497e80bbefc35c787c27', 'request_id': 'req-e342d67e-849d-4521-9f79-04f8c3bfa933'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.628748 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e342d67e-849d-4521-9f79-04f8c3bfa933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9576cf63a004497e80bbefc35c787c27', 'request_id': 'req-e342d67e-849d-4521-9f79-04f8c3bfa933'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.636472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e342d67e-849d-4521-9f79-04f8c3bfa933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9576cf63a004497e80bbefc35c787c27', 'request_id': 'req-e342d67e-849d-4521-9f79-04f8c3bfa933'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.648263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e342d67e-849d-4521-9f79-04f8c3bfa933 admin admin] The token cache is being invalidate because project 9576cf63a004497e80bbefc35c787c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:09.648569 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e342d67e-849d-4521-9f79-04f8c3bfa933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.649355 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e342d67e-849d-4521-9f79-04f8c3bfa933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.651367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 960/1927] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:09 2022] DELETE /identity/v3/projects/9576cf63a004497e80bbefc35c787c27 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:09.657314 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfac1a-5d14-4938-a5e0-5b1fcbadf37c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:09.657715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfac1a-5d14-4938-a5e0-5b1fcbadf37c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:09.657997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfac1a-5d14-4938-a5e0-5b1fcbadf37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:09.661025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-05f6bf12-1fe5-4c30-93db-cdbdff1076ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f16ee3d1d048bfbd41c57a807621eb'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.661713 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-05f6bf12-1fe5-4c30-93db-cdbdff1076ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f16ee3d1d048bfbd41c57a807621eb'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.676682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6cdfac1a-5d14-4938-a5e0-5b1fcbadf37c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:09.677804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6cdfac1a-5d14-4938-a5e0-5b1fcbadf37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:09.678199 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-05f6bf12-1fe5-4c30-93db-cdbdff1076ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f16ee3d1d048bfbd41c57a807621eb'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.689236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-05f6bf12-1fe5-4c30-93db-cdbdff1076ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f16ee3d1d048bfbd41c57a807621eb'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.691033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-05f6bf12-1fe5-4c30-93db-cdbdff1076ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f16ee3d1d048bfbd41c57a807621eb'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:09.703451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 968/1928] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:09 2022] DELETE /identity/v3/users/c3f16ee3d1d048bfbd41c57a807621eb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:09.740563 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 961/1929] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:09.751273 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f40a20-fd23-4807-811d-a0e7beae1e70 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:09.751509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f40a20-fd23-4807-811d-a0e7beae1e70 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:09.751787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f40a20-fd23-4807-811d-a0e7beae1e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:09.772089 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b1f40a20-fd23-4807-811d-a0e7beae1e70 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:09.774234 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b1f40a20-fd23-4807-811d-a0e7beae1e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:09.846949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 969/1930] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:09.851817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfac1a-5d14-4938-a5e0-5b1fcbadf37c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:09.862488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfac1a-5d14-4938-a5e0-5b1fcbadf37c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:09.869441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716707ce-e5ce-4b4a-89d8-bbaf6b33995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:09.870376 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716707ce-e5ce-4b4a-89d8-bbaf6b33995b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:09.870660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716707ce-e5ce-4b4a-89d8-bbaf6b33995b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:09.870936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716707ce-e5ce-4b4a-89d8-bbaf6b33995b admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:09.871702 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716707ce-e5ce-4b4a-89d8-bbaf6b33995b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:09.872009 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716707ce-e5ce-4b4a-89d8-bbaf6b33995b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:09.873631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716707ce-e5ce-4b4a-89d8-bbaf6b33995b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:09.890074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 962/1931] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:11:09.891262 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f40a20-fd23-4807-811d-a0e7beae1e70 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:09.901169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f40a20-fd23-4807-811d-a0e7beae1e70 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:09.905953 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13849c62-9b94-420b-b845-df77fd953fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:09.906617 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13849c62-9b94-420b-b845-df77fd953fde admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:09.906904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13849c62-9b94-420b-b845-df77fd953fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:09.907185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13849c62-9b94-420b-b845-df77fd953fde admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:09.907932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13849c62-9b94-420b-b845-df77fd953fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:09.909910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13849c62-9b94-420b-b845-df77fd953fde admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:09.940374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 970/1932] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:09 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:09.941569 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716707ce-e5ce-4b4a-89d8-bbaf6b33995b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:09.952597 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716707ce-e5ce-4b4a-89d8-bbaf6b33995b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:10.005692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13849c62-9b94-420b-b845-df77fd953fde admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:10.008130 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-13849c62-9b94-420b-b845-df77fd953fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:10.015982 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c668c3-347f-4de8-8ece-5c3df59efe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:10.017102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c668c3-347f-4de8-8ece-5c3df59efe38 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.017329 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c668c3-347f-4de8-8ece-5c3df59efe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.017694 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c668c3-347f-4de8-8ece-5c3df59efe38 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.018330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c668c3-347f-4de8-8ece-5c3df59efe38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:10.020496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c668c3-347f-4de8-8ece-5c3df59efe38 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:10.047759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 963/1933] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:09 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:11:10.049117 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c668c3-347f-4de8-8ece-5c3df59efe38 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:10.060373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c668c3-347f-4de8-8ece-5c3df59efe38 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:10.065138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26033804-2e12-4751-abe5-1a7c1105bfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:10.065814 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26033804-2e12-4751-abe5-1a7c1105bfbc admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.066097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26033804-2e12-4751-abe5-1a7c1105bfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.066401 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26033804-2e12-4751-abe5-1a7c1105bfbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.067420 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26033804-2e12-4751-abe5-1a7c1105bfbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:10.069066 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26033804-2e12-4751-abe5-1a7c1105bfbc admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:10.081989 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 964/1934] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:11:10.085976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26033804-2e12-4751-abe5-1a7c1105bfbc admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:10.086262 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13849c62-9b94-420b-b845-df77fd953fde admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:10.095180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab437a-5a1a-41c3-96e6-3b4b75d36982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:10.096132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab437a-5a1a-41c3-96e6-3b4b75d36982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.096412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab437a-5a1a-41c3-96e6-3b4b75d36982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.096713 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab437a-5a1a-41c3-96e6-3b4b75d36982 admin admin] PATH_INFO: `/v3/projects/e52754b2d6214a28ad1443bbecfe6cab` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.097945 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab437a-5a1a-41c3-96e6-3b4b75d36982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e52754b2d6214a28ad1443bbecfe6cab)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:10.099890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab437a-5a1a-41c3-96e6-3b4b75d36982 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:10.101517 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26033804-2e12-4751-abe5-1a7c1105bfbc admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:10.107072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423cfc8-b812-4a92-b742-e11c7afc7cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:10.107804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423cfc8-b812-4a92-b742-e11c7afc7cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.108120 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423cfc8-b812-4a92-b742-e11c7afc7cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.108395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423cfc8-b812-4a92-b742-e11c7afc7cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.109180 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423cfc8-b812-4a92-b742-e11c7afc7cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:10.110829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423cfc8-b812-4a92-b742-e11c7afc7cd2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:10.122430 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 965/1935] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:11:10.126656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423cfc8-b812-4a92-b742-e11c7afc7cd2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:10.137474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423cfc8-b812-4a92-b742-e11c7afc7cd2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:10.142229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecc26e-d80f-4d88-9b55-35a766eb925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:10.143112 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecc26e-d80f-4d88-9b55-35a766eb925a admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.144829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecc26e-d80f-4d88-9b55-35a766eb925a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.144829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecc26e-d80f-4d88-9b55-35a766eb925a admin admin] PATH_INFO: `/v3/projects/72936282bde6473a88e2a82f03ed708b/users/df825d5cc57e45a89b0c4d3476906e5c/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.153600 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-20ab437a-5a1a-41c3-96e6-3b4b75d36982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e52754b2d6214a28ad1443bbecfe6cab', 'request_id': 'req-20ab437a-5a1a-41c3-96e6-3b4b75d36982'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:10.159362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-20ab437a-5a1a-41c3-96e6-3b4b75d36982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e52754b2d6214a28ad1443bbecfe6cab', 'request_id': 'req-20ab437a-5a1a-41c3-96e6-3b4b75d36982'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:10.168280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-20ab437a-5a1a-41c3-96e6-3b4b75d36982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e52754b2d6214a28ad1443bbecfe6cab', 'request_id': 'req-20ab437a-5a1a-41c3-96e6-3b4b75d36982'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:10.168941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cecc26e-d80f-4d88-9b55-35a766eb925a admin admin] RBAC: Authorizing `identity:create_grant(project_id=72936282bde6473a88e2a82f03ed708b, user_id=df825d5cc57e45a89b0c4d3476906e5c, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:10.171733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cecc26e-d80f-4d88-9b55-35a766eb925a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:10.180794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-20ab437a-5a1a-41c3-96e6-3b4b75d36982 admin admin] The token cache is being invalidate because project e52754b2d6214a28ad1443bbecfe6cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:10.181090 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-20ab437a-5a1a-41c3-96e6-3b4b75d36982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:10.181841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-20ab437a-5a1a-41c3-96e6-3b4b75d36982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:10.186969 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 971/1936] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:10 2022] DELETE /identity/v3/projects/e52754b2d6214a28ad1443bbecfe6cab => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:10.187152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 966/1937] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:10 2022] PUT /identity/v3/projects/72936282bde6473a88e2a82f03ed708b/users/df825d5cc57e45a89b0c4d3476906e5c/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:10.188708 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293f943-a12c-45b5-89e2-c869f46b2fce None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.188999 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293f943-a12c-45b5-89e2-c869f46b2fce None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.189277 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293f943-a12c-45b5-89e2-c869f46b2fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.201302 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00221e60-32c5-4ca6-8649-c7c28a52aebd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.201599 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00221e60-32c5-4ca6-8649-c7c28a52aebd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.201871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00221e60-32c5-4ca6-8649-c7c28a52aebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.215406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-8293f943-a12c-45b5-89e2-c869f46b2fce None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:10.216961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8293f943-a12c-45b5-89e2-c869f46b2fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:10.230679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-00221e60-32c5-4ca6-8649-c7c28a52aebd None None] MFA Rules not processed for user `df825d5cc57e45a89b0c4d3476906e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:10.231941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-00221e60-32c5-4ca6-8649-c7c28a52aebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:10.298185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 972/1938] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:10.307749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22812833-26c9-4414-a063-d2e192514d74 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.308105 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22812833-26c9-4414-a063-d2e192514d74 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.308329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22812833-26c9-4414-a063-d2e192514d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.330310 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 967/1939] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:10.330416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-22812833-26c9-4414-a063-d2e192514d74 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:10.334713 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-22812833-26c9-4414-a063-d2e192514d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:10.340357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00221e60-32c5-4ca6-8649-c7c28a52aebd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:10.342774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-00221e60-32c5-4ca6-8649-c7c28a52aebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:10.344924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 973/1940] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:10.348726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22812833-26c9-4414-a063-d2e192514d74 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:10.358882 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22812833-26c9-4414-a063-d2e192514d74 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:10.364840 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac15c30-52ad-4ff4-8a05-b54728bed26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:10.365666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac15c30-52ad-4ff4-8a05-b54728bed26a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.366109 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac15c30-52ad-4ff4-8a05-b54728bed26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.367136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac15c30-52ad-4ff4-8a05-b54728bed26a admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.368045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac15c30-52ad-4ff4-8a05-b54728bed26a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:10.368492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac15c30-52ad-4ff4-8a05-b54728bed26a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:10.370552 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac15c30-52ad-4ff4-8a05-b54728bed26a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:10.389124 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 974/1941] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:10.390061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac15c30-52ad-4ff4-8a05-b54728bed26a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:10.400881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac15c30-52ad-4ff4-8a05-b54728bed26a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:10.405800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aeb7f6-a739-4a2c-8afe-663413ebf337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:10.406455 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeb7f6-a739-4a2c-8afe-663413ebf337 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.406734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeb7f6-a739-4a2c-8afe-663413ebf337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.407006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeb7f6-a739-4a2c-8afe-663413ebf337 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.407733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aeb7f6-a739-4a2c-8afe-663413ebf337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:10.409616 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aeb7f6-a739-4a2c-8afe-663413ebf337 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:10.431736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00221e60-32c5-4ca6-8649-c7c28a52aebd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:10.436367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93238779-974e-4090-8508-9cb83b54f88d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:10.437045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93238779-974e-4090-8508-9cb83b54f88d service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.437322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93238779-974e-4090-8508-9cb83b54f88d service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.437599 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93238779-974e-4090-8508-9cb83b54f88d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.460913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93238779-974e-4090-8508-9cb83b54f88d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:10.460913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93238779-974e-4090-8508-9cb83b54f88d service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:10.461192 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 975/1942] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:10 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:10.462830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aeb7f6-a739-4a2c-8afe-663413ebf337 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:10.468439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 968/1943] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:10.488113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93238779-974e-4090-8508-9cb83b54f88d service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:10.489673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-93238779-974e-4090-8508-9cb83b54f88d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:10.507053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93238779-974e-4090-8508-9cb83b54f88d service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:10.536944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aeb7f6-a739-4a2c-8afe-663413ebf337 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:10.542450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194162eb-c03e-4321-96ae-cb2cb626ad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:10.543269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194162eb-c03e-4321-96ae-cb2cb626ad33 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.543690 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194162eb-c03e-4321-96ae-cb2cb626ad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.544072 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194162eb-c03e-4321-96ae-cb2cb626ad33 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.545422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194162eb-c03e-4321-96ae-cb2cb626ad33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:10.547543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194162eb-c03e-4321-96ae-cb2cb626ad33 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:10.571193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 976/1944] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:10 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:10.572626 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea17c93-aad1-4c73-b91d-9ca005eec3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:10.573723 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17c93-aad1-4c73-b91d-9ca005eec3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.574214 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17c93-aad1-4c73-b91d-9ca005eec3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.574500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17c93-aad1-4c73-b91d-9ca005eec3af admin admin] PATH_INFO: `/v3/users/df825d5cc57e45a89b0c4d3476906e5c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.575579 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194162eb-c03e-4321-96ae-cb2cb626ad33 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:10.576429 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea17c93-aad1-4c73-b91d-9ca005eec3af admin admin] RBAC: Authorizing `identity:delete_user(user_id=df825d5cc57e45a89b0c4d3476906e5c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:10.578664 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea17c93-aad1-4c73-b91d-9ca005eec3af admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:10.588613 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194162eb-c03e-4321-96ae-cb2cb626ad33 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:10.594817 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc223979-55b9-4f38-b144-f87eb0f1fb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:10.596189 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc223979-55b9-4f38-b144-f87eb0f1fb9f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.596189 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc223979-55b9-4f38-b144-f87eb0f1fb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.596189 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc223979-55b9-4f38-b144-f87eb0f1fb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.596938 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc223979-55b9-4f38-b144-f87eb0f1fb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:10.598534 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc223979-55b9-4f38-b144-f87eb0f1fb9f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:10.623719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 977/1945] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:11:10.626381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc223979-55b9-4f38-b144-f87eb0f1fb9f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:10.636722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc223979-55b9-4f38-b144-f87eb0f1fb9f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:10.644802 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dc4e1-fbf2-48d6-8330-53ea032c9c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:10.645628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dc4e1-fbf2-48d6-8330-53ea032c9c14 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.646263 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dc4e1-fbf2-48d6-8330-53ea032c9c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.646490 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dc4e1-fbf2-48d6-8330-53ea032c9c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.647274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dc4e1-fbf2-48d6-8330-53ea032c9c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:10.648819 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eea17c93-aad1-4c73-b91d-9ca005eec3af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df825d5cc57e45a89b0c4d3476906e5c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:10.650085 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dc4e1-fbf2-48d6-8330-53ea032c9c14 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:10.665112 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eea17c93-aad1-4c73-b91d-9ca005eec3af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df825d5cc57e45a89b0c4d3476906e5c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:10.674259 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 978/1946] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:11:10.675550 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eea17c93-aad1-4c73-b91d-9ca005eec3af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df825d5cc57e45a89b0c4d3476906e5c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:10.676342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eea17c93-aad1-4c73-b91d-9ca005eec3af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df825d5cc57e45a89b0c4d3476906e5c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:10.677010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eea17c93-aad1-4c73-b91d-9ca005eec3af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df825d5cc57e45a89b0c4d3476906e5c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:10.678284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dc4e1-fbf2-48d6-8330-53ea032c9c14 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:10.681058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-de8dc4e1-fbf2-48d6-8330-53ea032c9c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:10.693649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 969/1947] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:10 2022] DELETE /identity/v3/users/df825d5cc57e45a89b0c4d3476906e5c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:10.695686 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dc4e1-fbf2-48d6-8330-53ea032c9c14 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:10.698080 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c180a64-160f-4c86-af77-531a641d51bf None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.698474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c180a64-160f-4c86-af77-531a641d51bf None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.698817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c180a64-160f-4c86-af77-531a641d51bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.720837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4c180a64-160f-4c86-af77-531a641d51bf None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:10.722098 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4c180a64-160f-4c86-af77-531a641d51bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:10.769814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83065d17-bba1-45e0-92d8-623472b8cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:10.770826 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065d17-bba1-45e0-92d8-623472b8cac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.771231 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065d17-bba1-45e0-92d8-623472b8cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.771527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065d17-bba1-45e0-92d8-623472b8cac6 admin admin] PATH_INFO: `/v3/projects/432adb1236bc486a9b765ff8a6b046ae/users/4c87ac90da4e496b917bf70f204d501b/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.792695 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83065d17-bba1-45e0-92d8-623472b8cac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432adb1236bc486a9b765ff8a6b046ae, user_id=4c87ac90da4e496b917bf70f204d501b, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:10.796741 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83065d17-bba1-45e0-92d8-623472b8cac6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:10.803305 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 970/1948] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:10.813361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 979/1949] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:10 2022] PUT /identity/v3/projects/432adb1236bc486a9b765ff8a6b046ae/users/4c87ac90da4e496b917bf70f204d501b/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:10.814588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c180a64-160f-4c86-af77-531a641d51bf None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:10.823385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4c180a64-160f-4c86-af77-531a641d51bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:10.828285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29788f5-f453-4e5a-99a1-7c9b5bbb3d48 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:10.828767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29788f5-f453-4e5a-99a1-7c9b5bbb3d48 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:10.829297 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29788f5-f453-4e5a-99a1-7c9b5bbb3d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:10.870409 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a29788f5-f453-4e5a-99a1-7c9b5bbb3d48 None None] MFA Rules not processed for user `4c87ac90da4e496b917bf70f204d501b`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:10.872844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a29788f5-f453-4e5a-99a1-7c9b5bbb3d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:10.934596 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c180a64-160f-4c86-af77-531a641d51bf None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:10.967646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 980/1950] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:10.969902 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29788f5-f453-4e5a-99a1-7c9b5bbb3d48 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:11.017499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57452dd8-d90b-4454-8de8-ea517b333cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:11.018591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57452dd8-d90b-4454-8de8-ea517b333cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:11.019075 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57452dd8-d90b-4454-8de8-ea517b333cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:11.019573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57452dd8-d90b-4454-8de8-ea517b333cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:11.045248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29788f5-f453-4e5a-99a1-7c9b5bbb3d48 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:11.050520 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6be619-0e73-4a60-aab8-750f743a10f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:11.051277 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6be619-0e73-4a60-aab8-750f743a10f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:11.051488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6be619-0e73-4a60-aab8-750f743a10f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:11.051774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6be619-0e73-4a60-aab8-750f743a10f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:11.052638 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6be619-0e73-4a60-aab8-750f743a10f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:11.055008 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6be619-0e73-4a60-aab8-750f743a10f3 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:11.102308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 981/1951] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:10 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:11:11.106584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6be619-0e73-4a60-aab8-750f743a10f3 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:11.120064 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57452dd8-d90b-4454-8de8-ea517b333cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:11.122202 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57452dd8-d90b-4454-8de8-ea517b333cc5 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:11.135024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 971/1952] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:11.193199 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6be619-0e73-4a60-aab8-750f743a10f3 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:11.199464 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b075b43-8ae8-4d6c-806f-a2ee0f5803c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:11.200178 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b075b43-8ae8-4d6c-806f-a2ee0f5803c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:11.200496 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b075b43-8ae8-4d6c-806f-a2ee0f5803c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:11.200774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b075b43-8ae8-4d6c-806f-a2ee0f5803c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:11.201537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b075b43-8ae8-4d6c-806f-a2ee0f5803c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:11.203509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b075b43-8ae8-4d6c-806f-a2ee0f5803c2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:11.228457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 982/1953] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:11 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:11.233225 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57452dd8-d90b-4454-8de8-ea517b333cc5 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:11.246070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57452dd8-d90b-4454-8de8-ea517b333cc5 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:11.251000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519f0f1-7f45-4233-a1a8-0f7609a25712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:11.251696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519f0f1-7f45-4233-a1a8-0f7609a25712 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:11.251971 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519f0f1-7f45-4233-a1a8-0f7609a25712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:11.252240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519f0f1-7f45-4233-a1a8-0f7609a25712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:11.253009 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519f0f1-7f45-4233-a1a8-0f7609a25712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:11.254773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519f0f1-7f45-4233-a1a8-0f7609a25712 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:11.266947 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 972/1954] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:11.271040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b075b43-8ae8-4d6c-806f-a2ee0f5803c2 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:11.281957 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b075b43-8ae8-4d6c-806f-a2ee0f5803c2 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:11.293140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88861118-66d2-48d0-9403-09f5af4ff60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:11.294598 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88861118-66d2-48d0-9403-09f5af4ff60c admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:11.294598 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88861118-66d2-48d0-9403-09f5af4ff60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:11.294875 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88861118-66d2-48d0-9403-09f5af4ff60c admin admin] PATH_INFO: `/v3/projects/4fdf883c969b4b53b478c2faa9c81ff1/users/04fb5d41a0874ce4bf6a56186a00e09f/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:11.314449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88861118-66d2-48d0-9403-09f5af4ff60c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fdf883c969b4b53b478c2faa9c81ff1, user_id=04fb5d41a0874ce4bf6a56186a00e09f, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:11.317207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88861118-66d2-48d0-9403-09f5af4ff60c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:11.332987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 983/1955] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:11 2022] PUT /identity/v3/projects/4fdf883c969b4b53b478c2faa9c81ff1/users/04fb5d41a0874ce4bf6a56186a00e09f/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:11.337664 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519f0f1-7f45-4233-a1a8-0f7609a25712 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:11.347754 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519f0f1-7f45-4233-a1a8-0f7609a25712 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:11.423100 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f39d5-72e9-42e8-80e1-0657ac18a161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:11.423838 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f39d5-72e9-42e8-80e1-0657ac18a161 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:11.424135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f39d5-72e9-42e8-80e1-0657ac18a161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:11.424414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f39d5-72e9-42e8-80e1-0657ac18a161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:11.425140 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f39d5-72e9-42e8-80e1-0657ac18a161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:11.426762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f39d5-72e9-42e8-80e1-0657ac18a161 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:11.439662 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 973/1956] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:11:11.443789 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88861118-66d2-48d0-9403-09f5af4ff60c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:11.456385 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88861118-66d2-48d0-9403-09f5af4ff60c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:11.467783 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62821d8d-ea16-410b-8c5a-3cd82550cb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:11.468814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821d8d-ea16-410b-8c5a-3cd82550cb83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:11.469226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821d8d-ea16-410b-8c5a-3cd82550cb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:11.469404 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821d8d-ea16-410b-8c5a-3cd82550cb83 admin admin] PATH_INFO: `/v3/projects/4fdf883c969b4b53b478c2faa9c81ff1/users/04fb5d41a0874ce4bf6a56186a00e09f/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:11.471656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62821d8d-ea16-410b-8c5a-3cd82550cb83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fdf883c969b4b53b478c2faa9c81ff1, user_id=04fb5d41a0874ce4bf6a56186a00e09f, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:11.475871 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62821d8d-ea16-410b-8c5a-3cd82550cb83 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:11.487545 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 984/1957] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:11 2022] PUT /identity/v3/projects/4fdf883c969b4b53b478c2faa9c81ff1/users/04fb5d41a0874ce4bf6a56186a00e09f/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:11.498720 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c1c32-421e-4a64-8f6e-851c67b1fd44 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:11.499031 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c1c32-421e-4a64-8f6e-851c67b1fd44 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:11.499318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c1c32-421e-4a64-8f6e-851c67b1fd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:11.509852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62821d8d-ea16-410b-8c5a-3cd82550cb83 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:11.512427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-62821d8d-ea16-410b-8c5a-3cd82550cb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:11.547505 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3c6c1c32-421e-4a64-8f6e-851c67b1fd44 None None] MFA Rules not processed for user `04fb5d41a0874ce4bf6a56186a00e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:11.548745 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3c6c1c32-421e-4a64-8f6e-851c67b1fd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:11.636895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62821d8d-ea16-410b-8c5a-3cd82550cb83 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:11.640860 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 974/1958] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:11.650242 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1d150-097a-4ae7-8602-30fb67e3c988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:11.650904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1d150-097a-4ae7-8602-30fb67e3c988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:11.651186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1d150-097a-4ae7-8602-30fb67e3c988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:11.651280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c1c32-421e-4a64-8f6e-851c67b1fd44 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:11.651462 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1d150-097a-4ae7-8602-30fb67e3c988 admin admin] PATH_INFO: `/v3/projects/72936282bde6473a88e2a82f03ed708b` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:11.652715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3c6c1c32-421e-4a64-8f6e-851c67b1fd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:11.652819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1d150-097a-4ae7-8602-30fb67e3c988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72936282bde6473a88e2a82f03ed708b)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:11.654625 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1d150-097a-4ae7-8602-30fb67e3c988 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:11.723889 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6da1d150-097a-4ae7-8602-30fb67e3c988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72936282bde6473a88e2a82f03ed708b', 'request_id': 'req-6da1d150-097a-4ae7-8602-30fb67e3c988'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:11.730011 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6da1d150-097a-4ae7-8602-30fb67e3c988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72936282bde6473a88e2a82f03ed708b', 'request_id': 'req-6da1d150-097a-4ae7-8602-30fb67e3c988'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:11.737709 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c1c32-421e-4a64-8f6e-851c67b1fd44 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:11.739483 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6da1d150-097a-4ae7-8602-30fb67e3c988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72936282bde6473a88e2a82f03ed708b', 'request_id': 'req-6da1d150-097a-4ae7-8602-30fb67e3c988'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:11.753617 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6da1d150-097a-4ae7-8602-30fb67e3c988 admin admin] The token cache is being invalidate because project 72936282bde6473a88e2a82f03ed708b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:11.753909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6da1d150-097a-4ae7-8602-30fb67e3c988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:11.754584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6da1d150-097a-4ae7-8602-30fb67e3c988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:11.756207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 985/1959] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:11 2022] DELETE /identity/v3/projects/72936282bde6473a88e2a82f03ed708b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:11.762177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dd7b6-4dae-4b86-98ae-adab2e6024db None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:11.762494 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dd7b6-4dae-4b86-98ae-adab2e6024db None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:11.762772 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dd7b6-4dae-4b86-98ae-adab2e6024db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:11.781734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b43dd7b6-4dae-4b86-98ae-adab2e6024db None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:11.782983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b43dd7b6-4dae-4b86-98ae-adab2e6024db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:11.814631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a9066-879e-42f5-9ebf-d752a80e0c21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:11.815314 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9066-879e-42f5-9ebf-d752a80e0c21 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:11.815574 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9066-879e-42f5-9ebf-d752a80e0c21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:11.815885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9066-879e-42f5-9ebf-d752a80e0c21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:11.818672 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8c9a9066-879e-42f5-9ebf-d752a80e0c21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:11.859980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 986/1960] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:11.868403 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b270c-7acd-4629-9f8a-c911edf60e15 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:11.868701 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b270c-7acd-4629-9f8a-c911edf60e15 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:11.868983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b270c-7acd-4629-9f8a-c911edf60e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:11.890197 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-db0b270c-7acd-4629-9f8a-c911edf60e15 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:11.891437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-db0b270c-7acd-4629-9f8a-c911edf60e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:11.903676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 987/1961] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:11:11.906919 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b270c-7acd-4629-9f8a-c911edf60e15 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:11.908358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a9066-879e-42f5-9ebf-d752a80e0c21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:11.910187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a9066-879e-42f5-9ebf-d752a80e0c21 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:11.919441 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b270c-7acd-4629-9f8a-c911edf60e15 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:11.923472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 975/1962] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:11:11.925282 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b8393-b012-4c5a-a4b5-ec3e7da600d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:11.926084 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b8393-b012-4c5a-a4b5-ec3e7da600d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:11.926481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b8393-b012-4c5a-a4b5-ec3e7da600d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:11.927777 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b8393-b012-4c5a-a4b5-ec3e7da600d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:11.927777 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b8393-b012-4c5a-a4b5-ec3e7da600d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:11.928120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b8393-b012-4c5a-a4b5-ec3e7da600d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:11.931239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b8393-b012-4c5a-a4b5-ec3e7da600d0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:11.947057 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 988/1963] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:11.947855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a9066-879e-42f5-9ebf-d752a80e0c21 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:11.966775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a9066-879e-42f5-9ebf-d752a80e0c21 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:11.972700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ba951-6c95-4cd6-bc26-5c9b57572373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:11.973822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ba951-6c95-4cd6-bc26-5c9b57572373 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:11.974344 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ba951-6c95-4cd6-bc26-5c9b57572373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:11.975567 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ba951-6c95-4cd6-bc26-5c9b57572373 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:11.979804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ba951-6c95-4cd6-bc26-5c9b57572373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:11.982520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ba951-6c95-4cd6-bc26-5c9b57572373 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:12.046631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 976/1964] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:11 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:11:12.054781 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b8393-b012-4c5a-a4b5-ec3e7da600d0 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:12.077039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b8393-b012-4c5a-a4b5-ec3e7da600d0 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:12.187513 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d969355-0ae1-4218-b454-17a6184c4573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:12.188224 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d969355-0ae1-4218-b454-17a6184c4573 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:12.188507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d969355-0ae1-4218-b454-17a6184c4573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:12.188779 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d969355-0ae1-4218-b454-17a6184c4573 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:12.189491 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d969355-0ae1-4218-b454-17a6184c4573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:12.191407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d969355-0ae1-4218-b454-17a6184c4573 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:12.230018 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 989/1965] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:12 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:11:12.231278 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ba951-6c95-4cd6-bc26-5c9b57572373 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:12.243709 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ba951-6c95-4cd6-bc26-5c9b57572373 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:12.249382 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efaaabd-b4bd-4186-8785-da0b0044c7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:12.250411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efaaabd-b4bd-4186-8785-da0b0044c7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:12.250744 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efaaabd-b4bd-4186-8785-da0b0044c7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:12.251099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efaaabd-b4bd-4186-8785-da0b0044c7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:12.252252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efaaabd-b4bd-4186-8785-da0b0044c7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:12.254004 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efaaabd-b4bd-4186-8785-da0b0044c7e4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:12.271856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 977/1966] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:12.277264 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d969355-0ae1-4218-b454-17a6184c4573 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:12.299753 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d969355-0ae1-4218-b454-17a6184c4573 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:12.305822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40b7db-2266-4252-8e4d-66fe45c2cd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:12.306644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40b7db-2266-4252-8e4d-66fe45c2cd96 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:12.306848 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40b7db-2266-4252-8e4d-66fe45c2cd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:12.307293 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40b7db-2266-4252-8e4d-66fe45c2cd96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:12.308067 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40b7db-2266-4252-8e4d-66fe45c2cd96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:12.310004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40b7db-2266-4252-8e4d-66fe45c2cd96 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:12.330868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 990/1967] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:11:12.337853 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efaaabd-b4bd-4186-8785-da0b0044c7e4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:12.353379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efaaabd-b4bd-4186-8785-da0b0044c7e4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:12.360446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde895c-7a05-488e-8e9f-b66ce86e75b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:12.361490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde895c-7a05-488e-8e9f-b66ce86e75b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:12.361897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde895c-7a05-488e-8e9f-b66ce86e75b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:12.362674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde895c-7a05-488e-8e9f-b66ce86e75b7 admin admin] PATH_INFO: `/v3/projects/462276f5740f4543ba3777427acf3bb4/users/8c0314730ddf467b973b3d0e26d7a971/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:12.383259 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde895c-7a05-488e-8e9f-b66ce86e75b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=462276f5740f4543ba3777427acf3bb4, user_id=8c0314730ddf467b973b3d0e26d7a971, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:12.386166 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde895c-7a05-488e-8e9f-b66ce86e75b7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:12.402047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 978/1968] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:12 2022] PUT /identity/v3/projects/462276f5740f4543ba3777427acf3bb4/users/8c0314730ddf467b973b3d0e26d7a971/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:12.419082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbb7e1-f555-4eed-b45b-01b41a068cf4 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:12.419892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbb7e1-f555-4eed-b45b-01b41a068cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:12.421032 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbb7e1-f555-4eed-b45b-01b41a068cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:12.463555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3bcbb7e1-f555-4eed-b45b-01b41a068cf4 None None] MFA Rules not processed for user `8c0314730ddf467b973b3d0e26d7a971`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:12.465054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3bcbb7e1-f555-4eed-b45b-01b41a068cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:12.667778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 991/1969] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:12.744950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde895c-7a05-488e-8e9f-b66ce86e75b7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:12.747147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8fde895c-7a05-488e-8e9f-b66ce86e75b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:12.855429 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde895c-7a05-488e-8e9f-b66ce86e75b7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:12.860715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8d0e8-0687-4271-9db3-ef2b19ce82a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:12.861236 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8d0e8-0687-4271-9db3-ef2b19ce82a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:12.863509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8d0e8-0687-4271-9db3-ef2b19ce82a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:12.863509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8d0e8-0687-4271-9db3-ef2b19ce82a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:12.874193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8d0e8-0687-4271-9db3-ef2b19ce82a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:12.875823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8d0e8-0687-4271-9db3-ef2b19ce82a7 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:12.889260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 979/1970] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:13.489272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbb7e1-f555-4eed-b45b-01b41a068cf4 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:13.490786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3bcbb7e1-f555-4eed-b45b-01b41a068cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:13.555515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbb7e1-f555-4eed-b45b-01b41a068cf4 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:13.560529 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1e8ec-ed8f-4a3d-94be-93da39162e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:13.561416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1e8ec-ed8f-4a3d-94be-93da39162e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:13.561697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1e8ec-ed8f-4a3d-94be-93da39162e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:13.561971 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1e8ec-ed8f-4a3d-94be-93da39162e3a admin admin] PATH_INFO: `/v3/users/ef3e9041b23942eb8677533ce33d9506` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:13.563193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1e8ec-ed8f-4a3d-94be-93da39162e3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3e9041b23942eb8677533ce33d9506)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:13.565160 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1e8ec-ed8f-4a3d-94be-93da39162e3a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:13.610771 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-89f1e8ec-ed8f-4a3d-94be-93da39162e3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3e9041b23942eb8677533ce33d9506'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:13.611422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-89f1e8ec-ed8f-4a3d-94be-93da39162e3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3e9041b23942eb8677533ce33d9506'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:13.624425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-89f1e8ec-ed8f-4a3d-94be-93da39162e3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3e9041b23942eb8677533ce33d9506'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:13.631120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-89f1e8ec-ed8f-4a3d-94be-93da39162e3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3e9041b23942eb8677533ce33d9506'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:13.631856 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-89f1e8ec-ed8f-4a3d-94be-93da39162e3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3e9041b23942eb8677533ce33d9506'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:13.646550 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 992/1971] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:13 2022] DELETE /identity/v3/users/ef3e9041b23942eb8677533ce33d9506 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:13.651780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215b12a-13d9-43ec-ae6d-cea68bcc90e9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:13.652078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215b12a-13d9-43ec-ae6d-cea68bcc90e9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:13.652378 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215b12a-13d9-43ec-ae6d-cea68bcc90e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:13.678036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e215b12a-13d9-43ec-ae6d-cea68bcc90e9 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:13.679706 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e215b12a-13d9-43ec-ae6d-cea68bcc90e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:13.758970 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 980/1972] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:13.771708 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1e8ec-ed8f-4a3d-94be-93da39162e3a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:13.773287 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-89f1e8ec-ed8f-4a3d-94be-93da39162e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:13.838846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1e8ec-ed8f-4a3d-94be-93da39162e3a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:13.842888 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52927df-0a89-44d8-baf7-29fbc5faf1af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:13.843541 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52927df-0a89-44d8-baf7-29fbc5faf1af service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:13.843852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52927df-0a89-44d8-baf7-29fbc5faf1af service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:13.844127 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52927df-0a89-44d8-baf7-29fbc5faf1af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:13.854610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52927df-0a89-44d8-baf7-29fbc5faf1af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:13.856659 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52927df-0a89-44d8-baf7-29fbc5faf1af service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:13.868166 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 993/1973] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:11:14.314783 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215b12a-13d9-43ec-ae6d-cea68bcc90e9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:14.322587 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e215b12a-13d9-43ec-ae6d-cea68bcc90e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:14.359301 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215b12a-13d9-43ec-ae6d-cea68bcc90e9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:14.368915 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823aac7-96a9-48f2-abcc-ee81da764c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:14.370445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823aac7-96a9-48f2-abcc-ee81da764c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:14.370877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823aac7-96a9-48f2-abcc-ee81da764c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:14.371423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823aac7-96a9-48f2-abcc-ee81da764c57 admin admin] PATH_INFO: `/v3/projects/28cbfdc92008431182a14cf4b067b503` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:14.374243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823aac7-96a9-48f2-abcc-ee81da764c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28cbfdc92008431182a14cf4b067b503)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:14.380139 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823aac7-96a9-48f2-abcc-ee81da764c57 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:14.499491 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52927df-0a89-44d8-baf7-29fbc5faf1af service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:14.499995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b823aac7-96a9-48f2-abcc-ee81da764c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28cbfdc92008431182a14cf4b067b503', 'request_id': 'req-b823aac7-96a9-48f2-abcc-ee81da764c57'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:14.501641 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a52927df-0a89-44d8-baf7-29fbc5faf1af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:14.516375 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52927df-0a89-44d8-baf7-29fbc5faf1af service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:14.522076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b823aac7-96a9-48f2-abcc-ee81da764c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28cbfdc92008431182a14cf4b067b503', 'request_id': 'req-b823aac7-96a9-48f2-abcc-ee81da764c57'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:14.537642 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b823aac7-96a9-48f2-abcc-ee81da764c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28cbfdc92008431182a14cf4b067b503', 'request_id': 'req-b823aac7-96a9-48f2-abcc-ee81da764c57'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:14.557091 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b823aac7-96a9-48f2-abcc-ee81da764c57 admin admin] The token cache is being invalidate because project 28cbfdc92008431182a14cf4b067b503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:14.557416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b823aac7-96a9-48f2-abcc-ee81da764c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:14.558078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b823aac7-96a9-48f2-abcc-ee81da764c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:14.560014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 981/1974] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:14 2022] DELETE /identity/v3/projects/28cbfdc92008431182a14cf4b067b503 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:14.563572 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823aac7-96a9-48f2-abcc-ee81da764c57 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:14.565697 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b823aac7-96a9-48f2-abcc-ee81da764c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:14.591246 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a625d0-0858-4b45-9d37-8e47779982e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:14.592880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a625d0-0858-4b45-9d37-8e47779982e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:14.593224 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a625d0-0858-4b45-9d37-8e47779982e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:14.593507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a625d0-0858-4b45-9d37-8e47779982e8 admin admin] PATH_INFO: `/v3/users/73b78355cbcb43cfabd8759cba0816bc` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:14.595371 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a625d0-0858-4b45-9d37-8e47779982e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b78355cbcb43cfabd8759cba0816bc)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:14.598835 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a625d0-0858-4b45-9d37-8e47779982e8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:14.664626 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823aac7-96a9-48f2-abcc-ee81da764c57 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:14.666608 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-36a625d0-0858-4b45-9d37-8e47779982e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b78355cbcb43cfabd8759cba0816bc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:14.668531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-36a625d0-0858-4b45-9d37-8e47779982e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b78355cbcb43cfabd8759cba0816bc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:14.671531 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4067b0-26eb-400b-9e56-00b07184a494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:14.672803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4067b0-26eb-400b-9e56-00b07184a494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:14.673404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4067b0-26eb-400b-9e56-00b07184a494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:14.673726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4067b0-26eb-400b-9e56-00b07184a494 admin admin] PATH_INFO: `/v3/users/1082c169197f40038bc6fecaba153413` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:14.675313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4067b0-26eb-400b-9e56-00b07184a494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1082c169197f40038bc6fecaba153413)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:14.677456 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4067b0-26eb-400b-9e56-00b07184a494 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:14.690592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-36a625d0-0858-4b45-9d37-8e47779982e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b78355cbcb43cfabd8759cba0816bc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:14.700400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-36a625d0-0858-4b45-9d37-8e47779982e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b78355cbcb43cfabd8759cba0816bc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:14.701170 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-36a625d0-0858-4b45-9d37-8e47779982e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b78355cbcb43cfabd8759cba0816bc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:14.738039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 994/1975] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:14 2022] DELETE /identity/v3/users/73b78355cbcb43cfabd8759cba0816bc => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:14.743970 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-be4067b0-26eb-400b-9e56-00b07184a494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1082c169197f40038bc6fecaba153413'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:14.744100 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0653927-11e4-4ec6-b4ef-9620e34be341 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:14.744278 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0653927-11e4-4ec6-b4ef-9620e34be341 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:14.744600 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0653927-11e4-4ec6-b4ef-9620e34be341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:14.773073 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c0653927-11e4-4ec6-b4ef-9620e34be341 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:14.777831 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c0653927-11e4-4ec6-b4ef-9620e34be341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:14.795904 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-be4067b0-26eb-400b-9e56-00b07184a494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1082c169197f40038bc6fecaba153413'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:14.822953 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-be4067b0-26eb-400b-9e56-00b07184a494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1082c169197f40038bc6fecaba153413'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:14.823787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-be4067b0-26eb-400b-9e56-00b07184a494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1082c169197f40038bc6fecaba153413'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:14.824469 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-be4067b0-26eb-400b-9e56-00b07184a494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1082c169197f40038bc6fecaba153413'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:14.856716 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 982/1976] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:14 2022] DELETE /identity/v3/users/1082c169197f40038bc6fecaba153413 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:14.891173 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 995/1977] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:11:14.908998 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4067b0-26eb-400b-9e56-00b07184a494 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:14.910458 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-be4067b0-26eb-400b-9e56-00b07184a494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:15.017370 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4067b0-26eb-400b-9e56-00b07184a494 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:15.022055 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b4dd3-f7b3-4b6e-ba01-f780506001ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:15.023362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b4dd3-f7b3-4b6e-ba01-f780506001ef service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:15.023968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b4dd3-f7b3-4b6e-ba01-f780506001ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:15.024803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b4dd3-f7b3-4b6e-ba01-f780506001ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:15.111157 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b4dd3-f7b3-4b6e-ba01-f780506001ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:15.112675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b4dd3-f7b3-4b6e-ba01-f780506001ef service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:15.126418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 983/1978] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:15.518999 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0653927-11e4-4ec6-b4ef-9620e34be341 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:15.521118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c0653927-11e4-4ec6-b4ef-9620e34be341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:15.545593 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0653927-11e4-4ec6-b4ef-9620e34be341 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:15.552086 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:15.553154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:15.553524 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:15.554492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0 admin admin] PATH_INFO: `/v3/projects/fcef5f77c3444106b7f620570539e15d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:15.556240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcef5f77c3444106b7f620570539e15d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:15.558161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:15.684045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcef5f77c3444106b7f620570539e15d', 'request_id': 'req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:15.699110 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcef5f77c3444106b7f620570539e15d', 'request_id': 'req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:15.713642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcef5f77c3444106b7f620570539e15d', 'request_id': 'req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:15.730037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0 admin admin] The token cache is being invalidate because project fcef5f77c3444106b7f620570539e15d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:15.730588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:15.731649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:15.733751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 996/1979] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:15 2022] DELETE /identity/v3/projects/fcef5f77c3444106b7f620570539e15d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:15.738969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b4dd3-f7b3-4b6e-ba01-f780506001ef service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:15.755488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b4dd3-f7b3-4b6e-ba01-f780506001ef service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:15.876221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e6808-ecf3-47e9-bc2c-2abfb48169f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:15.877046 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e6808-ecf3-47e9-bc2c-2abfb48169f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:15.877246 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e6808-ecf3-47e9-bc2c-2abfb48169f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:15.877744 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e6808-ecf3-47e9-bc2c-2abfb48169f9 admin admin] PATH_INFO: `/v3/users/ba260c305dee40f2ad50a878648628ee` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:15.880844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e6808-ecf3-47e9-bc2c-2abfb48169f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba260c305dee40f2ad50a878648628ee)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:15.887115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e6808-ecf3-47e9-bc2c-2abfb48169f9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:15.925196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:15.927774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:15.948194 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8e4e6808-ecf3-47e9-bc2c-2abfb48169f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba260c305dee40f2ad50a878648628ee'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:15.953456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45a8d0-0041-46b7-aa82-4809bed0d6a0 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:15.963921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e926cc-1982-467d-bc25-f5bb8baa16ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:15.965486 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e926cc-1982-467d-bc25-f5bb8baa16ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:15.966189 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e926cc-1982-467d-bc25-f5bb8baa16ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:15.966679 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e926cc-1982-467d-bc25-f5bb8baa16ea admin admin] PATH_INFO: `/v3/projects/f45b7384a3f142bd9295c38565e6372d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:15.968178 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e926cc-1982-467d-bc25-f5bb8baa16ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45b7384a3f142bd9295c38565e6372d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:15.970800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e926cc-1982-467d-bc25-f5bb8baa16ea admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:15.984963 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8e4e6808-ecf3-47e9-bc2c-2abfb48169f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba260c305dee40f2ad50a878648628ee'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:15.992677 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8e4e6808-ecf3-47e9-bc2c-2abfb48169f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba260c305dee40f2ad50a878648628ee'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:15.994133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8e4e6808-ecf3-47e9-bc2c-2abfb48169f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba260c305dee40f2ad50a878648628ee'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:15.994916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8e4e6808-ecf3-47e9-bc2c-2abfb48169f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba260c305dee40f2ad50a878648628ee'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.012706 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 984/1980] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:15 2022] DELETE /identity/v3/users/ba260c305dee40f2ad50a878648628ee => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:16.040752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-36e926cc-1982-467d-bc25-f5bb8baa16ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45b7384a3f142bd9295c38565e6372d', 'request_id': 'req-36e926cc-1982-467d-bc25-f5bb8baa16ea'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.047809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-36e926cc-1982-467d-bc25-f5bb8baa16ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45b7384a3f142bd9295c38565e6372d', 'request_id': 'req-36e926cc-1982-467d-bc25-f5bb8baa16ea'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.062562 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-36e926cc-1982-467d-bc25-f5bb8baa16ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45b7384a3f142bd9295c38565e6372d', 'request_id': 'req-36e926cc-1982-467d-bc25-f5bb8baa16ea'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.080135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-36e926cc-1982-467d-bc25-f5bb8baa16ea admin admin] The token cache is being invalidate because project f45b7384a3f142bd9295c38565e6372d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:16.081317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-36e926cc-1982-467d-bc25-f5bb8baa16ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.082164 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-36e926cc-1982-467d-bc25-f5bb8baa16ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.084467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 997/1981] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:15 2022] DELETE /identity/v3/projects/f45b7384a3f142bd9295c38565e6372d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:16.089027 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e6808-ecf3-47e9-bc2c-2abfb48169f9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:16.093138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8e4e6808-ecf3-47e9-bc2c-2abfb48169f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:16.203070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e6808-ecf3-47e9-bc2c-2abfb48169f9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:16.269242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c91571-fc34-4439-9004-0f720c3cf17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:16.270213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c91571-fc34-4439-9004-0f720c3cf17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:16.270633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c91571-fc34-4439-9004-0f720c3cf17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:16.270980 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c91571-fc34-4439-9004-0f720c3cf17d admin admin] PATH_INFO: `/v3/users/a22350b11bcb4bce81c91adb0c2532fe` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:16.286114 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c91571-fc34-4439-9004-0f720c3cf17d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a22350b11bcb4bce81c91adb0c2532fe)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:16.289083 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c91571-fc34-4439-9004-0f720c3cf17d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:16.348931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-72c91571-fc34-4439-9004-0f720c3cf17d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a22350b11bcb4bce81c91adb0c2532fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.364847 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-72c91571-fc34-4439-9004-0f720c3cf17d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a22350b11bcb4bce81c91adb0c2532fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.378593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-72c91571-fc34-4439-9004-0f720c3cf17d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a22350b11bcb4bce81c91adb0c2532fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.380134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-72c91571-fc34-4439-9004-0f720c3cf17d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a22350b11bcb4bce81c91adb0c2532fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.381109 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-72c91571-fc34-4439-9004-0f720c3cf17d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a22350b11bcb4bce81c91adb0c2532fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.399771 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e926cc-1982-467d-bc25-f5bb8baa16ea admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:16.401330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-36e926cc-1982-467d-bc25-f5bb8baa16ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:16.405022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 985/1982] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:16 2022] DELETE /identity/v3/users/a22350b11bcb4bce81c91adb0c2532fe => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:16.424716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e926cc-1982-467d-bc25-f5bb8baa16ea admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:16.462559 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c91571-fc34-4439-9004-0f720c3cf17d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:16.464954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-72c91571-fc34-4439-9004-0f720c3cf17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:16.530849 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb7414-ca88-474e-93aa-0a578224394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:16.531782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb7414-ca88-474e-93aa-0a578224394f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:16.532065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb7414-ca88-474e-93aa-0a578224394f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:16.533061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb7414-ca88-474e-93aa-0a578224394f admin admin] PATH_INFO: `/v3/users/8c0314730ddf467b973b3d0e26d7a971` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:16.544261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb7414-ca88-474e-93aa-0a578224394f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0314730ddf467b973b3d0e26d7a971)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:16.546514 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb7414-ca88-474e-93aa-0a578224394f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:16.624663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-65cb7414-ca88-474e-93aa-0a578224394f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0314730ddf467b973b3d0e26d7a971'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.625876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-65cb7414-ca88-474e-93aa-0a578224394f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0314730ddf467b973b3d0e26d7a971'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.647305 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-65cb7414-ca88-474e-93aa-0a578224394f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0314730ddf467b973b3d0e26d7a971'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.659769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c91571-fc34-4439-9004-0f720c3cf17d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:16.674532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cd796-1c95-458f-b639-dec1492ed805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:16.679867 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cd796-1c95-458f-b639-dec1492ed805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:16.680168 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cd796-1c95-458f-b639-dec1492ed805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:16.680430 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cd796-1c95-458f-b639-dec1492ed805 admin admin] PATH_INFO: `/v3/projects/cef831fec8a044d1954c304a13c7af4b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:16.682252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4cd796-1c95-458f-b639-dec1492ed805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef831fec8a044d1954c304a13c7af4b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:16.686410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4cd796-1c95-458f-b639-dec1492ed805 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:16.696475 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-65cb7414-ca88-474e-93aa-0a578224394f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0314730ddf467b973b3d0e26d7a971'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.699187 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-65cb7414-ca88-474e-93aa-0a578224394f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0314730ddf467b973b3d0e26d7a971'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.724968 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 998/1983] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:16 2022] DELETE /identity/v3/users/8c0314730ddf467b973b3d0e26d7a971 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:16.733334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec4bd6-08ad-4b31-af85-d9a74eb2ce1e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:16.733766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec4bd6-08ad-4b31-af85-d9a74eb2ce1e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:16.734300 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec4bd6-08ad-4b31-af85-d9a74eb2ce1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:16.769147 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b7ec4bd6-08ad-4b31-af85-d9a74eb2ce1e None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:16.769840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eb4cd796-1c95-458f-b639-dec1492ed805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef831fec8a044d1954c304a13c7af4b', 'request_id': 'req-eb4cd796-1c95-458f-b639-dec1492ed805'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.770595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b7ec4bd6-08ad-4b31-af85-d9a74eb2ce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:16.779294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eb4cd796-1c95-458f-b639-dec1492ed805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef831fec8a044d1954c304a13c7af4b', 'request_id': 'req-eb4cd796-1c95-458f-b639-dec1492ed805'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.791485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eb4cd796-1c95-458f-b639-dec1492ed805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef831fec8a044d1954c304a13c7af4b', 'request_id': 'req-eb4cd796-1c95-458f-b639-dec1492ed805'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.808916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eb4cd796-1c95-458f-b639-dec1492ed805 admin admin] The token cache is being invalidate because project cef831fec8a044d1954c304a13c7af4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:16.809972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eb4cd796-1c95-458f-b639-dec1492ed805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.811023 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-eb4cd796-1c95-458f-b639-dec1492ed805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:16.813966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 986/1984] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:16 2022] DELETE /identity/v3/projects/cef831fec8a044d1954c304a13c7af4b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:16.818891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80528295-7e67-4303-8e79-548c77a030e5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:16.820051 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80528295-7e67-4303-8e79-548c77a030e5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:16.820824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80528295-7e67-4303-8e79-548c77a030e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:16.846719 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-80528295-7e67-4303-8e79-548c77a030e5 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:16.848752 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-80528295-7e67-4303-8e79-548c77a030e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:16.878774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 999/1985] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:16.891456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec4bd6-08ad-4b31-af85-d9a74eb2ce1e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:16.893571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b7ec4bd6-08ad-4b31-af85-d9a74eb2ce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:16.962334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 987/1986] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:11:16.964787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80528295-7e67-4303-8e79-548c77a030e5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:16.966305 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-80528295-7e67-4303-8e79-548c77a030e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:16.981027 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec4bd6-08ad-4b31-af85-d9a74eb2ce1e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:16.983366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80528295-7e67-4303-8e79-548c77a030e5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:16.985165 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f3e40-14be-4328-81f4-7e3b11a16f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:16.985833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f3e40-14be-4328-81f4-7e3b11a16f9b service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:16.986142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f3e40-14be-4328-81f4-7e3b11a16f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:16.987897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f3e40-14be-4328-81f4-7e3b11a16f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:16.996331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43635e-3c9b-4349-81e6-df374dcf9606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:16.997250 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43635e-3c9b-4349-81e6-df374dcf9606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:16.997556 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43635e-3c9b-4349-81e6-df374dcf9606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:16.997835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43635e-3c9b-4349-81e6-df374dcf9606 admin admin] PATH_INFO: `/v3/projects/7425b81a3c6f4634a5246e84d8b57004` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.000178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43635e-3c9b-4349-81e6-df374dcf9606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7425b81a3c6f4634a5246e84d8b57004)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:17.002109 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43635e-3c9b-4349-81e6-df374dcf9606 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:17.007185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f3e40-14be-4328-81f4-7e3b11a16f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:17.008835 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f3e40-14be-4328-81f4-7e3b11a16f9b service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:17.021137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1000/1987] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:17.021998 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f3e40-14be-4328-81f4-7e3b11a16f9b service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:17.024228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4c1f3e40-14be-4328-81f4-7e3b11a16f9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:17.068939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ee43635e-3c9b-4349-81e6-df374dcf9606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7425b81a3c6f4634a5246e84d8b57004', 'request_id': 'req-ee43635e-3c9b-4349-81e6-df374dcf9606'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:17.080201 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ee43635e-3c9b-4349-81e6-df374dcf9606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7425b81a3c6f4634a5246e84d8b57004', 'request_id': 'req-ee43635e-3c9b-4349-81e6-df374dcf9606'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:17.097896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ee43635e-3c9b-4349-81e6-df374dcf9606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7425b81a3c6f4634a5246e84d8b57004', 'request_id': 'req-ee43635e-3c9b-4349-81e6-df374dcf9606'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:17.111217 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f3e40-14be-4328-81f4-7e3b11a16f9b service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:17.117730 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ee43635e-3c9b-4349-81e6-df374dcf9606 admin admin] The token cache is being invalidate because project 7425b81a3c6f4634a5246e84d8b57004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:17.118630 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ee43635e-3c9b-4349-81e6-df374dcf9606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:17.119824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ee43635e-3c9b-4349-81e6-df374dcf9606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:17.121506 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 988/1988] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:16 2022] DELETE /identity/v3/projects/7425b81a3c6f4634a5246e84d8b57004 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:17.122784 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f631ee8-34b9-4e65-b448-2d7ca579720d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.123066 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f631ee8-34b9-4e65-b448-2d7ca579720d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.123540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f631ee8-34b9-4e65-b448-2d7ca579720d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.175827 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4f631ee8-34b9-4e65-b448-2d7ca579720d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:17.177351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4f631ee8-34b9-4e65-b448-2d7ca579720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:17.203255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6182a4a-e515-4dc4-99d0-674b127c933a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:17.203961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6182a4a-e515-4dc4-99d0-674b127c933a service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.204250 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6182a4a-e515-4dc4-99d0-674b127c933a service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.204526 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6182a4a-e515-4dc4-99d0-674b127c933a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.207130 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d6182a4a-e515-4dc4-99d0-674b127c933a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:17.271629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 989/1989] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:17.275015 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbf809-65f7-4372-a1c7-6c8974b59c34 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.275478 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbf809-65f7-4372-a1c7-6c8974b59c34 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.275879 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbf809-65f7-4372-a1c7-6c8974b59c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.296856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cddbf809-65f7-4372-a1c7-6c8974b59c34 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:17.298226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cddbf809-65f7-4372-a1c7-6c8974b59c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:17.303286 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6182a4a-e515-4dc4-99d0-674b127c933a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:17.305590 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6182a4a-e515-4dc4-99d0-674b127c933a service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:17.315008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 990/1990] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:17.315008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbf809-65f7-4372-a1c7-6c8974b59c34 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:17.326459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1001/1991] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:17.327849 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6f3d6-832e-459f-b0e4-d57afddd8701 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.330690 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6f3d6-832e-459f-b0e4-d57afddd8701 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.331017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6f3d6-832e-459f-b0e4-d57afddd8701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.336236 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbf809-65f7-4372-a1c7-6c8974b59c34 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:17.345055 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510458c-b3ad-4ac0-a22c-a19a3fac0b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:17.345953 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510458c-b3ad-4ac0-a22c-a19a3fac0b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.346197 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510458c-b3ad-4ac0-a22c-a19a3fac0b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.346441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510458c-b3ad-4ac0-a22c-a19a3fac0b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.347187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510458c-b3ad-4ac0-a22c-a19a3fac0b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:17.347487 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510458c-b3ad-4ac0-a22c-a19a3fac0b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:17.349905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510458c-b3ad-4ac0-a22c-a19a3fac0b45 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:17.353991 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-9ed6f3d6-832e-459f-b0e4-d57afddd8701 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:17.356031 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9ed6f3d6-832e-459f-b0e4-d57afddd8701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:17.368805 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1002/1992] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:17.371644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 991/1993] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:17.374177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6f3d6-832e-459f-b0e4-d57afddd8701 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:17.374872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510458c-b3ad-4ac0-a22c-a19a3fac0b45 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:17.385579 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6f3d6-832e-459f-b0e4-d57afddd8701 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:17.388318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510458c-b3ad-4ac0-a22c-a19a3fac0b45 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:17.391796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964575d-371b-4a03-b250-aef2a4b5e82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:17.392830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964575d-371b-4a03-b250-aef2a4b5e82d admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.393133 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964575d-371b-4a03-b250-aef2a4b5e82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.394416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964575d-371b-4a03-b250-aef2a4b5e82d admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.394529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c3d12-07a9-4c7e-9f04-991bf7ac4cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:17.394622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964575d-371b-4a03-b250-aef2a4b5e82d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:17.394735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c3d12-07a9-4c7e-9f04-991bf7ac4cfe admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.394811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964575d-371b-4a03-b250-aef2a4b5e82d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:17.394898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c3d12-07a9-4c7e-9f04-991bf7ac4cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.394898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c3d12-07a9-4c7e-9f04-991bf7ac4cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.395401 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c3d12-07a9-4c7e-9f04-991bf7ac4cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:17.396298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964575d-371b-4a03-b250-aef2a4b5e82d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:17.398296 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c3d12-07a9-4c7e-9f04-991bf7ac4cfe admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:17.411652 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1003/1994] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:17.417375 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964575d-371b-4a03-b250-aef2a4b5e82d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:17.430649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964575d-371b-4a03-b250-aef2a4b5e82d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:17.434513 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 992/1995] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:17 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:17.438535 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c3d12-07a9-4c7e-9f04-991bf7ac4cfe admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:17.443366 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e3ff7-0a65-469a-998c-b98b70baa48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:17.443535 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e3ff7-0a65-469a-998c-b98b70baa48e admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.443752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e3ff7-0a65-469a-998c-b98b70baa48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.444032 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e3ff7-0a65-469a-998c-b98b70baa48e admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.446081 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e3ff7-0a65-469a-998c-b98b70baa48e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:17.448070 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e3ff7-0a65-469a-998c-b98b70baa48e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:17.482930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1004/1996] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:17 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:17.487162 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e3ff7-0a65-469a-998c-b98b70baa48e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:17.548880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c3d12-07a9-4c7e-9f04-991bf7ac4cfe admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:17.580033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e3ff7-0a65-469a-998c-b98b70baa48e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:17.584210 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad739ac-0ef0-4bb2-ba32-f9690bce4833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:17.584941 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad739ac-0ef0-4bb2-ba32-f9690bce4833 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.585693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad739ac-0ef0-4bb2-ba32-f9690bce4833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.585969 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad739ac-0ef0-4bb2-ba32-f9690bce4833 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.586732 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad739ac-0ef0-4bb2-ba32-f9690bce4833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:17.588614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad739ac-0ef0-4bb2-ba32-f9690bce4833 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:17.610897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1005/1997] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:17 2022] POST /identity/v3/users => generated 283 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:17.611558 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad739ac-0ef0-4bb2-ba32-f9690bce4833 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:17.613270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0ad739ac-0ef0-4bb2-ba32-f9690bce4833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:17.620597 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19d3df-8bdc-4b38-a55b-b1157f98ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:17.621745 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19d3df-8bdc-4b38-a55b-b1157f98ea29 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.622032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19d3df-8bdc-4b38-a55b-b1157f98ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.622442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19d3df-8bdc-4b38-a55b-b1157f98ea29 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.623136 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19d3df-8bdc-4b38-a55b-b1157f98ea29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:17.625108 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19d3df-8bdc-4b38-a55b-b1157f98ea29 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:17.626459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad739ac-0ef0-4bb2-ba32-f9690bce4833 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:17.632470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdb820-506e-4245-8a81-22ffe5ebdf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:17.633873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdb820-506e-4245-8a81-22ffe5ebdf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.634211 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdb820-506e-4245-8a81-22ffe5ebdf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.634594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdb820-506e-4245-8a81-22ffe5ebdf73 admin admin] PATH_INFO: `/v3/projects/462276f5740f4543ba3777427acf3bb4` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.635897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdb820-506e-4245-8a81-22ffe5ebdf73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=462276f5740f4543ba3777427acf3bb4)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:17.638410 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdb820-506e-4245-8a81-22ffe5ebdf73 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:17.651372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 993/1998] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:17 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:17.652490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19d3df-8bdc-4b38-a55b-b1157f98ea29 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:17.687617 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19d3df-8bdc-4b38-a55b-b1157f98ea29 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:17.714692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d5bdb820-506e-4245-8a81-22ffe5ebdf73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '462276f5740f4543ba3777427acf3bb4', 'request_id': 'req-d5bdb820-506e-4245-8a81-22ffe5ebdf73'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:17.729983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d5bdb820-506e-4245-8a81-22ffe5ebdf73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '462276f5740f4543ba3777427acf3bb4', 'request_id': 'req-d5bdb820-506e-4245-8a81-22ffe5ebdf73'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:17.750715 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d5bdb820-506e-4245-8a81-22ffe5ebdf73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '462276f5740f4543ba3777427acf3bb4', 'request_id': 'req-d5bdb820-506e-4245-8a81-22ffe5ebdf73'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:17.778823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d5bdb820-506e-4245-8a81-22ffe5ebdf73 admin admin] The token cache is being invalidate because project 462276f5740f4543ba3777427acf3bb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:17.779117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d5bdb820-506e-4245-8a81-22ffe5ebdf73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:17.780604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d5bdb820-506e-4245-8a81-22ffe5ebdf73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:17.783007 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1006/1999] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:17 2022] DELETE /identity/v3/projects/462276f5740f4543ba3777427acf3bb4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:17.788821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdb820-506e-4245-8a81-22ffe5ebdf73 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:17.788821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d5bdb820-506e-4245-8a81-22ffe5ebdf73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:17.810617 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7e7b1-87e3-4b15-8102-6a505045021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:17.811307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7e7b1-87e3-4b15-8102-6a505045021a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.811590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7e7b1-87e3-4b15-8102-6a505045021a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.811899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7e7b1-87e3-4b15-8102-6a505045021a admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.812780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7e7b1-87e3-4b15-8102-6a505045021a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:17.815282 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7e7b1-87e3-4b15-8102-6a505045021a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:17.839958 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 994/2000] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:17.841172 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c3dc4-6f1e-4c49-8f37-4da32f1e804a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.841954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c3dc4-6f1e-4c49-8f37-4da32f1e804a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.841954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c3dc4-6f1e-4c49-8f37-4da32f1e804a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.890966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a97c3dc4-6f1e-4c49-8f37-4da32f1e804a None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:17.893462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a97c3dc4-6f1e-4c49-8f37-4da32f1e804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:17.907385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 995/2001] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:17.908229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c3dc4-6f1e-4c49-8f37-4da32f1e804a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:17.910457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdb820-506e-4245-8a81-22ffe5ebdf73 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:17.914085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a97c3dc4-6f1e-4c49-8f37-4da32f1e804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:17.926616 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa5097-5356-4593-ad23-0dbced00483a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:17.927372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa5097-5356-4593-ad23-0dbced00483a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.927693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa5097-5356-4593-ad23-0dbced00483a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.927980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa5097-5356-4593-ad23-0dbced00483a admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.929395 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa5097-5356-4593-ad23-0dbced00483a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:17.931474 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa5097-5356-4593-ad23-0dbced00483a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:17.931974 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c3dc4-6f1e-4c49-8f37-4da32f1e804a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:17.937849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3b2cf-01a3-4577-bad9-1c5bad84c287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:17.939113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b2cf-01a3-4577-bad9-1c5bad84c287 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.939767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b2cf-01a3-4577-bad9-1c5bad84c287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.940544 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b2cf-01a3-4577-bad9-1c5bad84c287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.941648 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3b2cf-01a3-4577-bad9-1c5bad84c287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:17.945198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3b2cf-01a3-4577-bad9-1c5bad84c287 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:17.945319 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1007/2002] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:17.956880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 996/2003] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:17.958073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3b2cf-01a3-4577-bad9-1c5bad84c287 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:17.960931 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe9e74-9384-47f2-b63e-6cac7a23e94b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.961401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe9e74-9384-47f2-b63e-6cac7a23e94b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.961693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe9e74-9384-47f2-b63e-6cac7a23e94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.982956 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-fdbe9e74-9384-47f2-b63e-6cac7a23e94b None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:17.983498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3b2cf-01a3-4577-bad9-1c5bad84c287 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:17.984312 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-fdbe9e74-9384-47f2-b63e-6cac7a23e94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:17.995303 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1008/2004] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:17.995762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2182376-c4a5-4e93-bb6a-1715f3699044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:17.996707 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2182376-c4a5-4e93-bb6a-1715f3699044 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:17.997001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2182376-c4a5-4e93-bb6a-1715f3699044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:17.997295 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2182376-c4a5-4e93-bb6a-1715f3699044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:17.998016 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2182376-c4a5-4e93-bb6a-1715f3699044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:17.999798 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2182376-c4a5-4e93-bb6a-1715f3699044 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:17.999990 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe9e74-9384-47f2-b63e-6cac7a23e94b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:18.012979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe9e74-9384-47f2-b63e-6cac7a23e94b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:18.018193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7245aa8-182f-422f-a346-ad771b269b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:18.021897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 997/2005] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:18.022066 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7245aa8-182f-422f-a346-ad771b269b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.022890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7245aa8-182f-422f-a346-ad771b269b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.023219 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7245aa8-182f-422f-a346-ad771b269b53 admin admin] PATH_INFO: `/v3/projects/aed81bb4bad1446c832db0899d482aaa/users/9ae349d5d25f4f64806caa76ea2179d5/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:18.023328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2182376-c4a5-4e93-bb6a-1715f3699044 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:18.042211 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7245aa8-182f-422f-a346-ad771b269b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed81bb4bad1446c832db0899d482aaa, user_id=9ae349d5d25f4f64806caa76ea2179d5, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:18.043619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2182376-c4a5-4e93-bb6a-1715f3699044 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:18.045152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7245aa8-182f-422f-a346-ad771b269b53 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:18.063260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2c4ec-c178-4a5e-beb0-402f3bfd97f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:18.064176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2c4ec-c178-4a5e-beb0-402f3bfd97f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.064465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2c4ec-c178-4a5e-beb0-402f3bfd97f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.064741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2c4ec-c178-4a5e-beb0-402f3bfd97f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:18.070282 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2c4ec-c178-4a5e-beb0-402f3bfd97f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:18.070966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2c4ec-c178-4a5e-beb0-402f3bfd97f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:18.073191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1009/2006] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:17 2022] PUT /identity/v3/projects/aed81bb4bad1446c832db0899d482aaa/users/9ae349d5d25f4f64806caa76ea2179d5/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:18.074308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7245aa8-182f-422f-a346-ad771b269b53 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:18.075918 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2c4ec-c178-4a5e-beb0-402f3bfd97f6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:18.104823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 998/2007] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:18.106386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd2d81-3a79-481d-a8f6-8e05c92f9196 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.106680 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd2d81-3a79-481d-a8f6-8e05c92f9196 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.106962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd2d81-3a79-481d-a8f6-8e05c92f9196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:18.157071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-85fd2d81-3a79-481d-a8f6-8e05c92f9196 None None] MFA Rules not processed for user `9ae349d5d25f4f64806caa76ea2179d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:18.159997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-85fd2d81-3a79-481d-a8f6-8e05c92f9196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:18.211479 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7245aa8-182f-422f-a346-ad771b269b53 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:18.228405 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b03c45-2dce-412f-b783-53ee69be54e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:18.229761 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b03c45-2dce-412f-b783-53ee69be54e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.230309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b03c45-2dce-412f-b783-53ee69be54e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.230806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b03c45-2dce-412f-b783-53ee69be54e8 admin admin] PATH_INFO: `/v3/projects/ac1c2f9254984d3aab4ba96ed6c28f38/users/8da343f74eb54e318b3a57764490362a/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:18.254251 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b03c45-2dce-412f-b783-53ee69be54e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1c2f9254984d3aab4ba96ed6c28f38, user_id=8da343f74eb54e318b3a57764490362a, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:18.258353 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b03c45-2dce-412f-b783-53ee69be54e8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:18.277881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1010/2008] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:18 2022] PUT /identity/v3/projects/ac1c2f9254984d3aab4ba96ed6c28f38/users/8da343f74eb54e318b3a57764490362a/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:18.279427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b03c45-2dce-412f-b783-53ee69be54e8 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:18.285204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 999/2009] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:18.289419 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29f311-43db-4455-8201-5958f475ec89 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.289891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29f311-43db-4455-8201-5958f475ec89 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.290268 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29f311-43db-4455-8201-5958f475ec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:18.329239 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1a29f311-43db-4455-8201-5958f475ec89 None None] MFA Rules not processed for user `8da343f74eb54e318b3a57764490362a`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:18.331787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1a29f311-43db-4455-8201-5958f475ec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:18.371352 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b03c45-2dce-412f-b783-53ee69be54e8 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:18.376721 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cac065-e347-4b29-b540-37763964d2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:18.377537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cac065-e347-4b29-b540-37763964d2fa admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.377822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cac065-e347-4b29-b540-37763964d2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.378098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cac065-e347-4b29-b540-37763964d2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:18.378796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cac065-e347-4b29-b540-37763964d2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:18.380901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cac065-e347-4b29-b540-37763964d2fa admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:18.413673 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1011/2010] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:18 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:18.415377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cac065-e347-4b29-b540-37763964d2fa admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:18.424834 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1000/2011] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:18.425960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29f311-43db-4455-8201-5958f475ec89 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:18.446716 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29f311-43db-4455-8201-5958f475ec89 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:18.490060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cac065-e347-4b29-b540-37763964d2fa admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:18.496495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbefb38-729f-4dea-a0c9-298a2db69538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:18.497281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbefb38-729f-4dea-a0c9-298a2db69538 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.497629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbefb38-729f-4dea-a0c9-298a2db69538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.497913 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbefb38-729f-4dea-a0c9-298a2db69538 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:18.498609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbefb38-729f-4dea-a0c9-298a2db69538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:18.501188 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbefb38-729f-4dea-a0c9-298a2db69538 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:18.520580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e0cbd-0563-4dd3-a251-a5efa7ae4551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:18.521231 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e0cbd-0563-4dd3-a251-a5efa7ae4551 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.521514 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e0cbd-0563-4dd3-a251-a5efa7ae4551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.521784 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e0cbd-0563-4dd3-a251-a5efa7ae4551 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:18.523973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e0cbd-0563-4dd3-a251-a5efa7ae4551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:18.525949 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e0cbd-0563-4dd3-a251-a5efa7ae4551 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:18.541946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1012/2012] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:18 2022] POST /identity/v3/projects => generated 363 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:18.546227 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbefb38-729f-4dea-a0c9-298a2db69538 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:18.550050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8fbefb38-729f-4dea-a0c9-298a2db69538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:18.572147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1001/2013] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:18 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:18.574968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e0cbd-0563-4dd3-a251-a5efa7ae4551 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:18.595082 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e0cbd-0563-4dd3-a251-a5efa7ae4551 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:18.619896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbefb38-729f-4dea-a0c9-298a2db69538 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:18.629272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94f646-240b-4b5a-9c42-b7dbd1c31751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:18.630683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94f646-240b-4b5a-9c42-b7dbd1c31751 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.630842 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94f646-240b-4b5a-9c42-b7dbd1c31751 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.631320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94f646-240b-4b5a-9c42-b7dbd1c31751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:18.678058 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86161f7-7009-4863-a14f-26873b662922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:18.679808 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86161f7-7009-4863-a14f-26873b662922 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.680088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86161f7-7009-4863-a14f-26873b662922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.680408 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86161f7-7009-4863-a14f-26873b662922 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:18.686543 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86161f7-7009-4863-a14f-26873b662922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:18.688307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86161f7-7009-4863-a14f-26873b662922 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:18.711971 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94f646-240b-4b5a-9c42-b7dbd1c31751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:18.713432 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94f646-240b-4b5a-9c42-b7dbd1c31751 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:18.721889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1002/2014] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:18 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:18.721889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86161f7-7009-4863-a14f-26873b662922 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:18.726387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1013/2015] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:18.727347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94f646-240b-4b5a-9c42-b7dbd1c31751 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:18.739873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94f646-240b-4b5a-9c42-b7dbd1c31751 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:18.751673 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f0591-70f5-4da4-aafa-396d3b3a40c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:18.752617 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f0591-70f5-4da4-aafa-396d3b3a40c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.753448 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f0591-70f5-4da4-aafa-396d3b3a40c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.753448 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f0591-70f5-4da4-aafa-396d3b3a40c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:18.754200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f0591-70f5-4da4-aafa-396d3b3a40c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:18.755964 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86161f7-7009-4863-a14f-26873b662922 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:18.763041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b83142-41c8-4f93-ab32-9b90ced69b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:18.764108 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b83142-41c8-4f93-ab32-9b90ced69b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.764646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b83142-41c8-4f93-ab32-9b90ced69b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.765124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b83142-41c8-4f93-ab32-9b90ced69b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:18.766173 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b83142-41c8-4f93-ab32-9b90ced69b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:18.768103 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b83142-41c8-4f93-ab32-9b90ced69b32 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:18.768914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f0591-70f5-4da4-aafa-396d3b3a40c3 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:18.785074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1003/2016] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:18.786823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1014/2017] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:18.804747 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b83142-41c8-4f93-ab32-9b90ced69b32 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:18.804952 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f0591-70f5-4da4-aafa-396d3b3a40c3 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:18.817576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f0591-70f5-4da4-aafa-396d3b3a40c3 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:18.826878 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b83142-41c8-4f93-ab32-9b90ced69b32 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:18.827482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa894a44-a7e1-4277-b83b-e0930a0a4983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:18.828465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa894a44-a7e1-4277-b83b-e0930a0a4983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.828991 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa894a44-a7e1-4277-b83b-e0930a0a4983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.829284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa894a44-a7e1-4277-b83b-e0930a0a4983 admin admin] PATH_INFO: `/v3/projects/a36784c2378b41969025db182f225ed2/users/31ce42dd77de4d46b24d160b9f6cefd5/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:18.835545 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac33b87-43a9-4eab-8a65-a3e4270abfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:18.836890 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac33b87-43a9-4eab-8a65-a3e4270abfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.837381 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac33b87-43a9-4eab-8a65-a3e4270abfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.837883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac33b87-43a9-4eab-8a65-a3e4270abfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:18.838964 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac33b87-43a9-4eab-8a65-a3e4270abfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:18.840882 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac33b87-43a9-4eab-8a65-a3e4270abfa9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:18.859909 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1004/2018] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:18.867725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac33b87-43a9-4eab-8a65-a3e4270abfa9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:18.889749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa894a44-a7e1-4277-b83b-e0930a0a4983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36784c2378b41969025db182f225ed2, user_id=31ce42dd77de4d46b24d160b9f6cefd5, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:18.893081 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa894a44-a7e1-4277-b83b-e0930a0a4983 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:18.900759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac33b87-43a9-4eab-8a65-a3e4270abfa9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:18.909972 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1015/2019] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:18 2022] PUT /identity/v3/projects/a36784c2378b41969025db182f225ed2/users/31ce42dd77de4d46b24d160b9f6cefd5/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:18.915552 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa894a44-a7e1-4277-b83b-e0930a0a4983 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:18.919278 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e5193-63a7-4724-baaf-a2e31ab0d354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:18.920400 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e5193-63a7-4724-baaf-a2e31ab0d354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.920833 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e5193-63a7-4724-baaf-a2e31ab0d354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.921347 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e5193-63a7-4724-baaf-a2e31ab0d354 admin admin] PATH_INFO: `/v3/projects/b5858756d2b74673a765c1d2e6adf280/users/c3feefbd066d49148171c392838b4e15/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:18.952855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e5193-63a7-4724-baaf-a2e31ab0d354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5858756d2b74673a765c1d2e6adf280, user_id=c3feefbd066d49148171c392838b4e15, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:18.955592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e5193-63a7-4724-baaf-a2e31ab0d354 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:18.982590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1005/2020] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:18 2022] PUT /identity/v3/projects/b5858756d2b74673a765c1d2e6adf280/users/c3feefbd066d49148171c392838b4e15/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:18.987625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b01065-ebc7-4265-ac6c-36632839fad1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:18.988281 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b01065-ebc7-4265-ac6c-36632839fad1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:18.988281 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b01065-ebc7-4265-ac6c-36632839fad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:19.024777 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-98b01065-ebc7-4265-ac6c-36632839fad1 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:19.028766 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-98b01065-ebc7-4265-ac6c-36632839fad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:19.039423 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa894a44-a7e1-4277-b83b-e0930a0a4983 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:19.121828 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c00b44-25ab-48c2-bc7c-b4af101f90ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:19.122645 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c00b44-25ab-48c2-bc7c-b4af101f90ac admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:19.122927 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c00b44-25ab-48c2-bc7c-b4af101f90ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:19.123284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c00b44-25ab-48c2-bc7c-b4af101f90ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:19.124444 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c00b44-25ab-48c2-bc7c-b4af101f90ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:19.126563 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c00b44-25ab-48c2-bc7c-b4af101f90ac admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:19.136081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1006/2021] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:11:19.149906 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1016/2022] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:19.155342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b01065-ebc7-4265-ac6c-36632839fad1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:19.169894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b01065-ebc7-4265-ac6c-36632839fad1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:19.188946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52209f45-53f8-4907-a03f-534840b1a0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:19.188946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52209f45-53f8-4907-a03f-534840b1a0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:19.188946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52209f45-53f8-4907-a03f-534840b1a0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:19.188946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52209f45-53f8-4907-a03f-534840b1a0bc admin admin] PATH_INFO: `/v3/projects/a36784c2378b41969025db182f225ed2/users/31ce42dd77de4d46b24d160b9f6cefd5/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:19.189231 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52209f45-53f8-4907-a03f-534840b1a0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36784c2378b41969025db182f225ed2, user_id=31ce42dd77de4d46b24d160b9f6cefd5, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:19.195693 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52209f45-53f8-4907-a03f-534840b1a0bc admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:19.217934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1007/2023] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:19 2022] PUT /identity/v3/projects/a36784c2378b41969025db182f225ed2/users/31ce42dd77de4d46b24d160b9f6cefd5/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:19.219848 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c00b44-25ab-48c2-bc7c-b4af101f90ac admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:19.222189 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b5c00b44-25ab-48c2-bc7c-b4af101f90ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:19.229953 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2165b-f79a-458d-ba18-b092dc598ba7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:19.230905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2165b-f79a-458d-ba18-b092dc598ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:19.231749 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2165b-f79a-458d-ba18-b092dc598ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:19.303573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2aa2165b-f79a-458d-ba18-b092dc598ba7 None None] MFA Rules not processed for user `31ce42dd77de4d46b24d160b9f6cefd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:19.305429 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2aa2165b-f79a-458d-ba18-b092dc598ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:19.334383 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c00b44-25ab-48c2-bc7c-b4af101f90ac admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:19.403766 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1008/2024] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:19 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:19.413789 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2165b-f79a-458d-ba18-b092dc598ba7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:19.415520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2aa2165b-f79a-458d-ba18-b092dc598ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:19.418352 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326ba11-173a-46be-ad24-874e06b2de3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:19.418914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326ba11-173a-46be-ad24-874e06b2de3a service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:19.419501 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326ba11-173a-46be-ad24-874e06b2de3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:19.420143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326ba11-173a-46be-ad24-874e06b2de3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:19.485718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2165b-f79a-458d-ba18-b092dc598ba7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:19.489496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a86fbe-d720-4e53-90b5-eea5c52225d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:19.490150 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a86fbe-d720-4e53-90b5-eea5c52225d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:19.490433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a86fbe-d720-4e53-90b5-eea5c52225d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:19.490710 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a86fbe-d720-4e53-90b5-eea5c52225d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:19.503469 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a86fbe-d720-4e53-90b5-eea5c52225d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:19.505041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326ba11-173a-46be-ad24-874e06b2de3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:19.505165 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a86fbe-d720-4e53-90b5-eea5c52225d0 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:19.506596 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326ba11-173a-46be-ad24-874e06b2de3a service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:19.520452 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1009/2025] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:19 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:19.524033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1017/2026] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:19.621242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a86fbe-d720-4e53-90b5-eea5c52225d0 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:19.640443 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a86fbe-d720-4e53-90b5-eea5c52225d0 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:19.651074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d290a-65fa-4174-8f01-2a119beb1104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:19.652465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d290a-65fa-4174-8f01-2a119beb1104 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:19.653105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d290a-65fa-4174-8f01-2a119beb1104 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:19.653653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d290a-65fa-4174-8f01-2a119beb1104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:19.755398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d290a-65fa-4174-8f01-2a119beb1104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:19.757920 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d290a-65fa-4174-8f01-2a119beb1104 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:19.785800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1010/2027] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:20.576202 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf8b00-8cc8-4c52-b7f3-72dc4a4c93e3 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:20.576202 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf8b00-8cc8-4c52-b7f3-72dc4a4c93e3 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:20.576202 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf8b00-8cc8-4c52-b7f3-72dc4a4c93e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:20.623633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-aacf8b00-8cc8-4c52-b7f3-72dc4a4c93e3 None None] MFA Rules not processed for user `c3feefbd066d49148171c392838b4e15`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:20.625900 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-aacf8b00-8cc8-4c52-b7f3-72dc4a4c93e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:20.726886 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1018/2028] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:20.735540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d290a-65fa-4174-8f01-2a119beb1104 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:20.746416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d290a-65fa-4174-8f01-2a119beb1104 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:20.751907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ba5a5-838a-4b44-8171-c14bb4e6c533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:20.752814 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ba5a5-838a-4b44-8171-c14bb4e6c533 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:20.753367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ba5a5-838a-4b44-8171-c14bb4e6c533 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:20.753647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ba5a5-838a-4b44-8171-c14bb4e6c533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:20.768947 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ba5a5-838a-4b44-8171-c14bb4e6c533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:20.774976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ba5a5-838a-4b44-8171-c14bb4e6c533 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:20.799824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1011/2029] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:22.340178 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eccb1-5ec3-4a8b-a33c-27f1d43cbefc None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:22.340854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eccb1-5ec3-4a8b-a33c-27f1d43cbefc None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:22.340854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eccb1-5ec3-4a8b-a33c-27f1d43cbefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:22.357981 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6a5eccb1-5ec3-4a8b-a33c-27f1d43cbefc None None] MFA Rules not processed for user `c3feefbd066d49148171c392838b4e15`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:22.359162 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6a5eccb1-5ec3-4a8b-a33c-27f1d43cbefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:22.368424 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1019/2030] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:22.759495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ba5a5-838a-4b44-8171-c14bb4e6c533 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:22.761058 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-184ba5a5-838a-4b44-8171-c14bb4e6c533 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:22.780010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ba5a5-838a-4b44-8171-c14bb4e6c533 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:22.789379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef2f75-36ae-40f7-ba40-653af493aac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:22.791014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef2f75-36ae-40f7-ba40-653af493aac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:22.791349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef2f75-36ae-40f7-ba40-653af493aac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:22.792013 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef2f75-36ae-40f7-ba40-653af493aac3 admin admin] PATH_INFO: `/v3/users/4c87ac90da4e496b917bf70f204d501b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:22.794696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef2f75-36ae-40f7-ba40-653af493aac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c87ac90da4e496b917bf70f204d501b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:22.798451 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef2f75-36ae-40f7-ba40-653af493aac3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:22.883386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-33ef2f75-36ae-40f7-ba40-653af493aac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c87ac90da4e496b917bf70f204d501b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:22.903803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-33ef2f75-36ae-40f7-ba40-653af493aac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c87ac90da4e496b917bf70f204d501b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:22.914181 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-33ef2f75-36ae-40f7-ba40-653af493aac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c87ac90da4e496b917bf70f204d501b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:22.915224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-33ef2f75-36ae-40f7-ba40-653af493aac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c87ac90da4e496b917bf70f204d501b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:22.916339 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-33ef2f75-36ae-40f7-ba40-653af493aac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c87ac90da4e496b917bf70f204d501b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:22.936742 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1012/2031] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:22 2022] DELETE /identity/v3/users/4c87ac90da4e496b917bf70f204d501b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:22.943477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bab99f-1b41-42b4-91b3-2e94dcac5b24 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:22.944606 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bab99f-1b41-42b4-91b3-2e94dcac5b24 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:22.945557 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bab99f-1b41-42b4-91b3-2e94dcac5b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:22.996744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-14bab99f-1b41-42b4-91b3-2e94dcac5b24 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:22.998019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-14bab99f-1b41-42b4-91b3-2e94dcac5b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:23.111179 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1020/2032] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:23.119342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef2f75-36ae-40f7-ba40-653af493aac3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:23.128549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-33ef2f75-36ae-40f7-ba40-653af493aac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:23.229543 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef2f75-36ae-40f7-ba40-653af493aac3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:23.234117 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefacad0-ac20-4a88-a785-1c065151c77e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:23.234936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefacad0-ac20-4a88-a785-1c065151c77e service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:23.235222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefacad0-ac20-4a88-a785-1c065151c77e service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:23.235499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefacad0-ac20-4a88-a785-1c065151c77e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:23.267954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefacad0-ac20-4a88-a785-1c065151c77e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:23.269838 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefacad0-ac20-4a88-a785-1c065151c77e service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:23.294704 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1013/2033] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:11:23.683139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bab99f-1b41-42b4-91b3-2e94dcac5b24 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:23.685364 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-14bab99f-1b41-42b4-91b3-2e94dcac5b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:23.701179 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bab99f-1b41-42b4-91b3-2e94dcac5b24 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:23.716974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:23.717882 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:23.718400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:23.718681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07 admin admin] PATH_INFO: `/v3/projects/432adb1236bc486a9b765ff8a6b046ae` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:23.720268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432adb1236bc486a9b765ff8a6b046ae)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:23.722191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:23.771535 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432adb1236bc486a9b765ff8a6b046ae', 'request_id': 'req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:23.777510 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432adb1236bc486a9b765ff8a6b046ae', 'request_id': 'req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:23.784289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432adb1236bc486a9b765ff8a6b046ae', 'request_id': 'req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:23.795762 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07 admin admin] The token cache is being invalidate because project 432adb1236bc486a9b765ff8a6b046ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:23.796049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:23.796707 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:23.798272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1021/2034] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:23 2022] DELETE /identity/v3/projects/432adb1236bc486a9b765ff8a6b046ae => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:23.802256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefacad0-ac20-4a88-a785-1c065151c77e service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:23.813801 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefacad0-ac20-4a88-a785-1c065151c77e service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:23.869456 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d124e-f6d3-47b7-9f38-84bd6ab351ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:23.870241 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d124e-f6d3-47b7-9f38-84bd6ab351ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:23.870522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d124e-f6d3-47b7-9f38-84bd6ab351ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:23.870793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d124e-f6d3-47b7-9f38-84bd6ab351ad admin admin] PATH_INFO: `/v3/users/04fb5d41a0874ce4bf6a56186a00e09f` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:23.871998 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d124e-f6d3-47b7-9f38-84bd6ab351ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=04fb5d41a0874ce4bf6a56186a00e09f)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:23.873916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d124e-f6d3-47b7-9f38-84bd6ab351ad admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:23.927793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c36d124e-f6d3-47b7-9f38-84bd6ab351ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04fb5d41a0874ce4bf6a56186a00e09f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:23.940095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c36d124e-f6d3-47b7-9f38-84bd6ab351ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04fb5d41a0874ce4bf6a56186a00e09f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:23.948515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c36d124e-f6d3-47b7-9f38-84bd6ab351ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04fb5d41a0874ce4bf6a56186a00e09f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:23.949291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c36d124e-f6d3-47b7-9f38-84bd6ab351ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04fb5d41a0874ce4bf6a56186a00e09f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:23.949935 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c36d124e-f6d3-47b7-9f38-84bd6ab351ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04fb5d41a0874ce4bf6a56186a00e09f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:23.964722 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1014/2035] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:23 2022] DELETE /identity/v3/users/04fb5d41a0874ce4bf6a56186a00e09f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:24.243329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:24.244843 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:24.259560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef19c4-570b-410d-b3bd-ab0bb33dae07 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:24.315574 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead6a7c-a5ea-4ec5-b5fb-a4aeb8181d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:24.316461 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead6a7c-a5ea-4ec5-b5fb-a4aeb8181d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:24.316737 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead6a7c-a5ea-4ec5-b5fb-a4aeb8181d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:24.317009 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead6a7c-a5ea-4ec5-b5fb-a4aeb8181d6f admin admin] PATH_INFO: `/v3/projects/4fdf883c969b4b53b478c2faa9c81ff1` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:24.318177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead6a7c-a5ea-4ec5-b5fb-a4aeb8181d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fdf883c969b4b53b478c2faa9c81ff1)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:24.320734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead6a7c-a5ea-4ec5-b5fb-a4aeb8181d6f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:24.364897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ead6a7c-a5ea-4ec5-b5fb-a4aeb8181d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fdf883c969b4b53b478c2faa9c81ff1', 'request_id': 'req-8ead6a7c-a5ea-4ec5-b5fb-a4aeb8181d6f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:24.370773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ead6a7c-a5ea-4ec5-b5fb-a4aeb8181d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fdf883c969b4b53b478c2faa9c81ff1', 'request_id': 'req-8ead6a7c-a5ea-4ec5-b5fb-a4aeb8181d6f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:24.377514 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ead6a7c-a5ea-4ec5-b5fb-a4aeb8181d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fdf883c969b4b53b478c2faa9c81ff1', 'request_id': 'req-8ead6a7c-a5ea-4ec5-b5fb-a4aeb8181d6f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:24.388634 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ead6a7c-a5ea-4ec5-b5fb-a4aeb8181d6f admin admin] The token cache is being invalidate because project 4fdf883c969b4b53b478c2faa9c81ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:24.388921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ead6a7c-a5ea-4ec5-b5fb-a4aeb8181d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:24.389576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8ead6a7c-a5ea-4ec5-b5fb-a4aeb8181d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:24.391077 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1022/2036] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:24 2022] DELETE /identity/v3/projects/4fdf883c969b4b53b478c2faa9c81ff1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:24.396992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35312dd4-aefc-442d-b5ed-621de3c23dd2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:24.397443 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35312dd4-aefc-442d-b5ed-621de3c23dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:24.397720 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35312dd4-aefc-442d-b5ed-621de3c23dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:24.416389 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-35312dd4-aefc-442d-b5ed-621de3c23dd2 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:24.417577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-35312dd4-aefc-442d-b5ed-621de3c23dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:24.479659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1015/2037] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:24.484863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa53bd-e177-426b-9b58-b742fd024a71 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:24.485289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa53bd-e177-426b-9b58-b742fd024a71 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:24.485575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa53bd-e177-426b-9b58-b742fd024a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:24.504567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0aaa53bd-e177-426b-9b58-b742fd024a71 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:24.505756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0aaa53bd-e177-426b-9b58-b742fd024a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:24.519290 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1023/2038] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:24.520297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35312dd4-aefc-442d-b5ed-621de3c23dd2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:24.530347 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35312dd4-aefc-442d-b5ed-621de3c23dd2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:24.534967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc6d7b-330d-454f-8e85-24081a2c5a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:24.535708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc6d7b-330d-454f-8e85-24081a2c5a70 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:24.535999 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc6d7b-330d-454f-8e85-24081a2c5a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:24.536275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc6d7b-330d-454f-8e85-24081a2c5a70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:24.537027 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc6d7b-330d-454f-8e85-24081a2c5a70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:24.537334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc6d7b-330d-454f-8e85-24081a2c5a70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:24.539801 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc6d7b-330d-454f-8e85-24081a2c5a70 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:24.551463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1016/2039] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:24.555763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa53bd-e177-426b-9b58-b742fd024a71 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:24.565065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa53bd-e177-426b-9b58-b742fd024a71 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:24.569833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2003b9-94c8-4cd3-b7df-854b31f23e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:24.570581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2003b9-94c8-4cd3-b7df-854b31f23e71 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:24.570867 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2003b9-94c8-4cd3-b7df-854b31f23e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:24.571140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2003b9-94c8-4cd3-b7df-854b31f23e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:24.571869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2003b9-94c8-4cd3-b7df-854b31f23e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:24.573755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2003b9-94c8-4cd3-b7df-854b31f23e71 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:24.602243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1024/2040] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:24 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:24.605949 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc6d7b-330d-454f-8e85-24081a2c5a70 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:24.617259 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc6d7b-330d-454f-8e85-24081a2c5a70 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:24.677292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a70b6-0993-4204-9b7b-64e2e097e1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:24.678061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a70b6-0993-4204-9b7b-64e2e097e1fd admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:24.678584 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a70b6-0993-4204-9b7b-64e2e097e1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:24.678924 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a70b6-0993-4204-9b7b-64e2e097e1fd admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:24.679689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a70b6-0993-4204-9b7b-64e2e097e1fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:24.681609 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a70b6-0993-4204-9b7b-64e2e097e1fd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:24.704187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1017/2041] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:24 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:24.705464 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2003b9-94c8-4cd3-b7df-854b31f23e71 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:24.716488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2003b9-94c8-4cd3-b7df-854b31f23e71 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:24.721132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3534f00-049c-49dc-9f32-ea67a4ef04f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:24.721803 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3534f00-049c-49dc-9f32-ea67a4ef04f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:24.722048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3534f00-049c-49dc-9f32-ea67a4ef04f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:24.722332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3534f00-049c-49dc-9f32-ea67a4ef04f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:24.723039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3534f00-049c-49dc-9f32-ea67a4ef04f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:24.724642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3534f00-049c-49dc-9f32-ea67a4ef04f4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:24.735991 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1025/2042] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:24.740241 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a70b6-0993-4204-9b7b-64e2e097e1fd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:24.750655 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a70b6-0993-4204-9b7b-64e2e097e1fd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:24.755195 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ff940-51f4-4a56-9ab3-c43460cafe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:24.755907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ff940-51f4-4a56-9ab3-c43460cafe42 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:24.756194 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ff940-51f4-4a56-9ab3-c43460cafe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:24.757146 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ff940-51f4-4a56-9ab3-c43460cafe42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:24.757862 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ff940-51f4-4a56-9ab3-c43460cafe42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:24.759460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ff940-51f4-4a56-9ab3-c43460cafe42 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:24.769039 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1018/2043] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:24.773567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3534f00-049c-49dc-9f32-ea67a4ef04f4 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:24.783404 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3534f00-049c-49dc-9f32-ea67a4ef04f4 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:24.788402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012910f5-ef00-43e1-9d65-744963ee1f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:24.789290 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012910f5-ef00-43e1-9d65-744963ee1f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:24.789571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012910f5-ef00-43e1-9d65-744963ee1f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:24.789846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012910f5-ef00-43e1-9d65-744963ee1f7d admin admin] PATH_INFO: `/v3/projects/49179ae52ac4414da8a7342133929859/users/b1335e9ff964442ab75b799b8264bd72/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:24.806289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012910f5-ef00-43e1-9d65-744963ee1f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=49179ae52ac4414da8a7342133929859, user_id=b1335e9ff964442ab75b799b8264bd72, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:24.809003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012910f5-ef00-43e1-9d65-744963ee1f7d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:24.824332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1026/2044] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:24 2022] PUT /identity/v3/projects/49179ae52ac4414da8a7342133929859/users/b1335e9ff964442ab75b799b8264bd72/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:24.835687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2e76e-cec4-440d-bc49-78199e119078 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:24.836183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2e76e-cec4-440d-bc49-78199e119078 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:24.836278 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2e76e-cec4-440d-bc49-78199e119078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:24.863220 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2be2e76e-cec4-440d-bc49-78199e119078 None None] MFA Rules not processed for user `b1335e9ff964442ab75b799b8264bd72`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:24.864458 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2be2e76e-cec4-440d-bc49-78199e119078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:24.929932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1019/2045] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:24.934559 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012910f5-ef00-43e1-9d65-744963ee1f7d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:24.996054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012910f5-ef00-43e1-9d65-744963ee1f7d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:25.000718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe45bb-e7f5-44c2-943e-a5221d2fdf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:25.001374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe45bb-e7f5-44c2-943e-a5221d2fdf34 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:25.001655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe45bb-e7f5-44c2-943e-a5221d2fdf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:25.001929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe45bb-e7f5-44c2-943e-a5221d2fdf34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:25.002624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe45bb-e7f5-44c2-943e-a5221d2fdf34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:25.004558 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe45bb-e7f5-44c2-943e-a5221d2fdf34 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:25.033463 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1027/2046] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:24 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:25.035475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2e76e-cec4-440d-bc49-78199e119078 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:25.047183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2e76e-cec4-440d-bc49-78199e119078 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:25.106790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bbfa6-7640-4bc9-a901-282a78b9b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:25.107464 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bbfa6-7640-4bc9-a901-282a78b9b2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:25.107776 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bbfa6-7640-4bc9-a901-282a78b9b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:25.108050 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bbfa6-7640-4bc9-a901-282a78b9b2a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:25.108743 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bbfa6-7640-4bc9-a901-282a78b9b2a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:25.110640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bbfa6-7640-4bc9-a901-282a78b9b2a4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:25.140048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1020/2047] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:25 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:25.145980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe45bb-e7f5-44c2-943e-a5221d2fdf34 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:25.163475 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe45bb-e7f5-44c2-943e-a5221d2fdf34 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:25.181207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a531e1-90b1-419a-8c75-cede418b2291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:25.181817 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a531e1-90b1-419a-8c75-cede418b2291 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:25.182160 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a531e1-90b1-419a-8c75-cede418b2291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:25.182449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a531e1-90b1-419a-8c75-cede418b2291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:25.183190 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a531e1-90b1-419a-8c75-cede418b2291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:25.185098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a531e1-90b1-419a-8c75-cede418b2291 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:25.197161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1028/2048] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:25.201281 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bbfa6-7640-4bc9-a901-282a78b9b2a4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:25.213342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bbfa6-7640-4bc9-a901-282a78b9b2a4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:25.218050 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b26261-489e-43c2-9d93-e9049463776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:25.218740 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b26261-489e-43c2-9d93-e9049463776c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:25.219039 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b26261-489e-43c2-9d93-e9049463776c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:25.219318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b26261-489e-43c2-9d93-e9049463776c admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:25.220163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b26261-489e-43c2-9d93-e9049463776c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:25.221873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b26261-489e-43c2-9d93-e9049463776c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:25.234502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1021/2049] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:25.239317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a531e1-90b1-419a-8c75-cede418b2291 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:25.258471 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a531e1-90b1-419a-8c75-cede418b2291 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:25.266035 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292910d4-bdef-467d-ae65-9269cf39ccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:25.267566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292910d4-bdef-467d-ae65-9269cf39ccb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:25.268106 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292910d4-bdef-467d-ae65-9269cf39ccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:25.268604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292910d4-bdef-467d-ae65-9269cf39ccb7 admin admin] PATH_INFO: `/v3/projects/9a05945d71044cbeb474b0dfaa0dd7aa/users/6475d79fef5e4f47a2178e23b03223d0/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:25.291917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292910d4-bdef-467d-ae65-9269cf39ccb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a05945d71044cbeb474b0dfaa0dd7aa, user_id=6475d79fef5e4f47a2178e23b03223d0, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:25.294633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292910d4-bdef-467d-ae65-9269cf39ccb7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:25.310122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1029/2050] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:25 2022] PUT /identity/v3/projects/9a05945d71044cbeb474b0dfaa0dd7aa/users/6475d79fef5e4f47a2178e23b03223d0/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:25.322129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a76c69-72e8-450e-9351-a037c772e20a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:25.322499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a76c69-72e8-450e-9351-a037c772e20a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:25.322805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a76c69-72e8-450e-9351-a037c772e20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:25.350929 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c6a76c69-72e8-450e-9351-a037c772e20a None None] MFA Rules not processed for user `6475d79fef5e4f47a2178e23b03223d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:25.352298 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c6a76c69-72e8-450e-9351-a037c772e20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:25.415180 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1022/2051] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:25.419679 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292910d4-bdef-467d-ae65-9269cf39ccb7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:25.480801 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292910d4-bdef-467d-ae65-9269cf39ccb7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:25.485355 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e9d8d-4349-4a4e-9d5e-8ff397e4b61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:25.486009 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e9d8d-4349-4a4e-9d5e-8ff397e4b61f admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:25.486293 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e9d8d-4349-4a4e-9d5e-8ff397e4b61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:25.486572 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e9d8d-4349-4a4e-9d5e-8ff397e4b61f admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:25.487276 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e9d8d-4349-4a4e-9d5e-8ff397e4b61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:25.489214 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e9d8d-4349-4a4e-9d5e-8ff397e4b61f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:25.513621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1030/2052] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:25 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:25.517625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a76c69-72e8-450e-9351-a037c772e20a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:25.529584 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a76c69-72e8-450e-9351-a037c772e20a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:25.587988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fda12d-c5cf-4f9d-868c-1a43cbbdb4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:25.588665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fda12d-c5cf-4f9d-868c-1a43cbbdb4dd admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:25.588946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fda12d-c5cf-4f9d-868c-1a43cbbdb4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:25.589217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fda12d-c5cf-4f9d-868c-1a43cbbdb4dd admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:25.590045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fda12d-c5cf-4f9d-868c-1a43cbbdb4dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:25.591877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fda12d-c5cf-4f9d-868c-1a43cbbdb4dd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:25.621118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1023/2053] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:25 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:25.630421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e9d8d-4349-4a4e-9d5e-8ff397e4b61f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:25.641386 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e9d8d-4349-4a4e-9d5e-8ff397e4b61f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:25.645975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b9fb1-bedf-4e78-8924-d61c31b53d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:25.646622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b9fb1-bedf-4e78-8924-d61c31b53d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:25.646954 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b9fb1-bedf-4e78-8924-d61c31b53d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:25.647765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b9fb1-bedf-4e78-8924-d61c31b53d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:25.648484 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b9fb1-bedf-4e78-8924-d61c31b53d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:25.650058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b9fb1-bedf-4e78-8924-d61c31b53d0c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:25.660301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1031/2054] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:25.664859 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fda12d-c5cf-4f9d-868c-1a43cbbdb4dd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:25.674829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fda12d-c5cf-4f9d-868c-1a43cbbdb4dd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:25.679558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec829b4-4323-4f28-8ad9-2e5bc8afb1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:25.680479 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec829b4-4323-4f28-8ad9-2e5bc8afb1e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:25.680766 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec829b4-4323-4f28-8ad9-2e5bc8afb1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:25.681040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec829b4-4323-4f28-8ad9-2e5bc8afb1e6 admin admin] PATH_INFO: `/v3/projects/f61bb679e37145a29a792179600fc15b/users/685ffa74007d4369a3a5e0204c3bb2af/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:25.696222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec829b4-4323-4f28-8ad9-2e5bc8afb1e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61bb679e37145a29a792179600fc15b, user_id=685ffa74007d4369a3a5e0204c3bb2af, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:25.698875 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec829b4-4323-4f28-8ad9-2e5bc8afb1e6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:25.713530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1024/2055] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:25 2022] PUT /identity/v3/projects/f61bb679e37145a29a792179600fc15b/users/685ffa74007d4369a3a5e0204c3bb2af/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:25.717693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b9fb1-bedf-4e78-8924-d61c31b53d0c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:25.727856 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b9fb1-bedf-4e78-8924-d61c31b53d0c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:25.785183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04495497-90b8-4abf-a878-58d46040872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:25.785849 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04495497-90b8-4abf-a878-58d46040872e admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:25.786138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04495497-90b8-4abf-a878-58d46040872e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:25.786418 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04495497-90b8-4abf-a878-58d46040872e admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:25.787141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04495497-90b8-4abf-a878-58d46040872e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:25.790141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04495497-90b8-4abf-a878-58d46040872e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:25.803994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1032/2056] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:25.805561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec829b4-4323-4f28-8ad9-2e5bc8afb1e6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:25.815628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec829b4-4323-4f28-8ad9-2e5bc8afb1e6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:25.820978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247b2b1-566f-46cf-b4fe-330725dc70ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:25.821859 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247b2b1-566f-46cf-b4fe-330725dc70ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:25.822142 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247b2b1-566f-46cf-b4fe-330725dc70ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:25.822419 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247b2b1-566f-46cf-b4fe-330725dc70ec admin admin] PATH_INFO: `/v3/projects/f61bb679e37145a29a792179600fc15b/users/685ffa74007d4369a3a5e0204c3bb2af/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:25.824403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247b2b1-566f-46cf-b4fe-330725dc70ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61bb679e37145a29a792179600fc15b, user_id=685ffa74007d4369a3a5e0204c3bb2af, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:25.827138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247b2b1-566f-46cf-b4fe-330725dc70ec admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:25.847570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1025/2057] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:25 2022] PUT /identity/v3/projects/f61bb679e37145a29a792179600fc15b/users/685ffa74007d4369a3a5e0204c3bb2af/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:25.858509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d35f1-327a-4860-bc54-6cb8865dd717 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:25.858791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d35f1-327a-4860-bc54-6cb8865dd717 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:25.859067 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d35f1-327a-4860-bc54-6cb8865dd717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:25.888410 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-896d35f1-327a-4860-bc54-6cb8865dd717 None None] MFA Rules not processed for user `685ffa74007d4369a3a5e0204c3bb2af`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:25.889630 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-896d35f1-327a-4860-bc54-6cb8865dd717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:25.956042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1033/2058] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:25.968443 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247b2b1-566f-46cf-b4fe-330725dc70ec admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:25.970157 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2247b2b1-566f-46cf-b4fe-330725dc70ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:26.026863 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247b2b1-566f-46cf-b4fe-330725dc70ec admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:26.030528 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d3131-0b4f-4e49-9b1a-ef7f6c8d2ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:26.031196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d3131-0b4f-4e49-9b1a-ef7f6c8d2ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:26.031500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d3131-0b4f-4e49-9b1a-ef7f6c8d2ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:26.031802 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d3131-0b4f-4e49-9b1a-ef7f6c8d2ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:26.086386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d3131-0b4f-4e49-9b1a-ef7f6c8d2ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:26.087895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d3131-0b4f-4e49-9b1a-ef7f6c8d2ff7 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:26.096689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1026/2059] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:27.603326 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d35f1-327a-4860-bc54-6cb8865dd717 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:27.604999 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-896d35f1-327a-4860-bc54-6cb8865dd717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:27.618273 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d35f1-327a-4860-bc54-6cb8865dd717 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:27.626082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d822c9-e9b5-41d3-857b-7fb3dc4ec391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:27.627723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d822c9-e9b5-41d3-857b-7fb3dc4ec391 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:27.627998 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d822c9-e9b5-41d3-857b-7fb3dc4ec391 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:27.628279 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d822c9-e9b5-41d3-857b-7fb3dc4ec391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:27.697749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d822c9-e9b5-41d3-857b-7fb3dc4ec391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:27.699406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d822c9-e9b5-41d3-857b-7fb3dc4ec391 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:27.719794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1034/2060] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:28.431131 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d3131-0b4f-4e49-9b1a-ef7f6c8d2ff7 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:28.444532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d3131-0b4f-4e49-9b1a-ef7f6c8d2ff7 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:28.449881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01e23f-112e-4367-ad63-436f2e3f1a4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:28.450777 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01e23f-112e-4367-ad63-436f2e3f1a4b service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:28.451238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01e23f-112e-4367-ad63-436f2e3f1a4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:28.451696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01e23f-112e-4367-ad63-436f2e3f1a4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:28.474669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01e23f-112e-4367-ad63-436f2e3f1a4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:28.477732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01e23f-112e-4367-ad63-436f2e3f1a4b service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:28.501545 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1027/2061] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:34.278958 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d822c9-e9b5-41d3-857b-7fb3dc4ec391 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:34.280604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-06d822c9-e9b5-41d3-857b-7fb3dc4ec391 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:34.367781 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d822c9-e9b5-41d3-857b-7fb3dc4ec391 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:34.375972 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a1767-c8b0-4539-9cc3-a954e6110d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:34.377147 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a1767-c8b0-4539-9cc3-a954e6110d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:34.377495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a1767-c8b0-4539-9cc3-a954e6110d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:34.378124 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a1767-c8b0-4539-9cc3-a954e6110d74 admin admin] PATH_INFO: `/v3/users/9ae349d5d25f4f64806caa76ea2179d5` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:34.379404 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a1767-c8b0-4539-9cc3-a954e6110d74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae349d5d25f4f64806caa76ea2179d5)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:34.382130 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a1767-c8b0-4539-9cc3-a954e6110d74 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:34.441195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a32a1767-c8b0-4539-9cc3-a954e6110d74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae349d5d25f4f64806caa76ea2179d5'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:34.442009 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a32a1767-c8b0-4539-9cc3-a954e6110d74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae349d5d25f4f64806caa76ea2179d5'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:34.456752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a32a1767-c8b0-4539-9cc3-a954e6110d74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae349d5d25f4f64806caa76ea2179d5'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:34.464791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a32a1767-c8b0-4539-9cc3-a954e6110d74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae349d5d25f4f64806caa76ea2179d5'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:34.465499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a32a1767-c8b0-4539-9cc3-a954e6110d74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae349d5d25f4f64806caa76ea2179d5'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:34.486309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1035/2062] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:34 2022] DELETE /identity/v3/users/9ae349d5d25f4f64806caa76ea2179d5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:34.492100 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e19ca-9125-4824-a4b9-68fc54956a5d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:34.492669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e19ca-9125-4824-a4b9-68fc54956a5d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:34.492669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e19ca-9125-4824-a4b9-68fc54956a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:34.513358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a89e19ca-9125-4824-a4b9-68fc54956a5d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:34.514566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a89e19ca-9125-4824-a4b9-68fc54956a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:34.592436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1028/2063] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:34.604180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a1767-c8b0-4539-9cc3-a954e6110d74 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:34.606180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a32a1767-c8b0-4539-9cc3-a954e6110d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:34.672514 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a1767-c8b0-4539-9cc3-a954e6110d74 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:34.676210 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4038ad3-e609-40e0-bf5f-fd34d49367ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:34.676959 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4038ad3-e609-40e0-bf5f-fd34d49367ba service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:34.677309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4038ad3-e609-40e0-bf5f-fd34d49367ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:34.678213 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4038ad3-e609-40e0-bf5f-fd34d49367ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:34.688722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4038ad3-e609-40e0-bf5f-fd34d49367ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:34.690454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4038ad3-e609-40e0-bf5f-fd34d49367ba service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:34.703253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1036/2064] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:34.930038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e19ca-9125-4824-a4b9-68fc54956a5d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:34.931557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a89e19ca-9125-4824-a4b9-68fc54956a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:34.948446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e19ca-9125-4824-a4b9-68fc54956a5d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:34.956148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31fdb6-6f9c-4d0a-ad61-57830648b0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:34.957329 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31fdb6-6f9c-4d0a-ad61-57830648b0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:34.957811 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31fdb6-6f9c-4d0a-ad61-57830648b0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:34.958280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31fdb6-6f9c-4d0a-ad61-57830648b0d0 admin admin] PATH_INFO: `/v3/users/58e161159bbc4339b6ac52213cc7b7d1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:34.961067 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31fdb6-6f9c-4d0a-ad61-57830648b0d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e161159bbc4339b6ac52213cc7b7d1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:34.963104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31fdb6-6f9c-4d0a-ad61-57830648b0d0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:35.024688 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4038ad3-e609-40e0-bf5f-fd34d49367ba service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:35.026083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f4038ad3-e609-40e0-bf5f-fd34d49367ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:35.040093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0f31fdb6-6f9c-4d0a-ad61-57830648b0d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e161159bbc4339b6ac52213cc7b7d1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.041389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4038ad3-e609-40e0-bf5f-fd34d49367ba service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:35.046979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28a23f-bb5e-46be-a433-1b78d291d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:35.048010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28a23f-bb5e-46be-a433-1b78d291d2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:35.048132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28a23f-bb5e-46be-a433-1b78d291d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:35.048387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28a23f-bb5e-46be-a433-1b78d291d2c1 admin admin] PATH_INFO: `/v3/projects/aed81bb4bad1446c832db0899d482aaa` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:35.049567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28a23f-bb5e-46be-a433-1b78d291d2c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed81bb4bad1446c832db0899d482aaa)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:35.051473 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28a23f-bb5e-46be-a433-1b78d291d2c1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:35.053169 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0f31fdb6-6f9c-4d0a-ad61-57830648b0d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e161159bbc4339b6ac52213cc7b7d1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.061377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0f31fdb6-6f9c-4d0a-ad61-57830648b0d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e161159bbc4339b6ac52213cc7b7d1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.062292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0f31fdb6-6f9c-4d0a-ad61-57830648b0d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e161159bbc4339b6ac52213cc7b7d1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.063138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0f31fdb6-6f9c-4d0a-ad61-57830648b0d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e161159bbc4339b6ac52213cc7b7d1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.080794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1029/2065] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:34 2022] DELETE /identity/v3/users/58e161159bbc4339b6ac52213cc7b7d1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:35.112066 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1b28a23f-bb5e-46be-a433-1b78d291d2c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed81bb4bad1446c832db0899d482aaa', 'request_id': 'req-1b28a23f-bb5e-46be-a433-1b78d291d2c1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.119789 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1b28a23f-bb5e-46be-a433-1b78d291d2c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed81bb4bad1446c832db0899d482aaa', 'request_id': 'req-1b28a23f-bb5e-46be-a433-1b78d291d2c1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.134872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1b28a23f-bb5e-46be-a433-1b78d291d2c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed81bb4bad1446c832db0899d482aaa', 'request_id': 'req-1b28a23f-bb5e-46be-a433-1b78d291d2c1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.152511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1b28a23f-bb5e-46be-a433-1b78d291d2c1 admin admin] The token cache is being invalidate because project aed81bb4bad1446c832db0899d482aaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:35.152918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1b28a23f-bb5e-46be-a433-1b78d291d2c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.153584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1b28a23f-bb5e-46be-a433-1b78d291d2c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.155298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1037/2066] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:35 2022] DELETE /identity/v3/projects/aed81bb4bad1446c832db0899d482aaa => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:35.159203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31fdb6-6f9c-4d0a-ad61-57830648b0d0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:35.160745 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0f31fdb6-6f9c-4d0a-ad61-57830648b0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:35.227880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31fdb6-6f9c-4d0a-ad61-57830648b0d0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:35.263046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28a23f-bb5e-46be-a433-1b78d291d2c1 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:35.265174 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1b28a23f-bb5e-46be-a433-1b78d291d2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:35.292716 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd837a-ff9a-4f97-980c-b9ffe0f1b26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:35.293885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd837a-ff9a-4f97-980c-b9ffe0f1b26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:35.294335 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd837a-ff9a-4f97-980c-b9ffe0f1b26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:35.294863 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd837a-ff9a-4f97-980c-b9ffe0f1b26b admin admin] PATH_INFO: `/v3/users/31ce42dd77de4d46b24d160b9f6cefd5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:35.296526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd837a-ff9a-4f97-980c-b9ffe0f1b26b admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ce42dd77de4d46b24d160b9f6cefd5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:35.298422 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd837a-ff9a-4f97-980c-b9ffe0f1b26b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:35.359097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32fd837a-ff9a-4f97-980c-b9ffe0f1b26b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ce42dd77de4d46b24d160b9f6cefd5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.370524 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28a23f-bb5e-46be-a433-1b78d291d2c1 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:35.371667 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32fd837a-ff9a-4f97-980c-b9ffe0f1b26b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ce42dd77de4d46b24d160b9f6cefd5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.375568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a699f2-80f2-4422-88b4-d55f17a8f813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:35.376678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a699f2-80f2-4422-88b4-d55f17a8f813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:35.376963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a699f2-80f2-4422-88b4-d55f17a8f813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:35.377343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a699f2-80f2-4422-88b4-d55f17a8f813 admin admin] PATH_INFO: `/v3/projects/b4111fd040fc4a4d823b5e38204286f7` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:35.378674 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a699f2-80f2-4422-88b4-d55f17a8f813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4111fd040fc4a4d823b5e38204286f7)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:35.379373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32fd837a-ff9a-4f97-980c-b9ffe0f1b26b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ce42dd77de4d46b24d160b9f6cefd5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.380141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32fd837a-ff9a-4f97-980c-b9ffe0f1b26b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ce42dd77de4d46b24d160b9f6cefd5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.381154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a699f2-80f2-4422-88b4-d55f17a8f813 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:35.381478 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32fd837a-ff9a-4f97-980c-b9ffe0f1b26b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ce42dd77de4d46b24d160b9f6cefd5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.397231 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1030/2067] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:35 2022] DELETE /identity/v3/users/31ce42dd77de4d46b24d160b9f6cefd5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:35.443775 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-66a699f2-80f2-4422-88b4-d55f17a8f813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4111fd040fc4a4d823b5e38204286f7', 'request_id': 'req-66a699f2-80f2-4422-88b4-d55f17a8f813'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.449865 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-66a699f2-80f2-4422-88b4-d55f17a8f813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4111fd040fc4a4d823b5e38204286f7', 'request_id': 'req-66a699f2-80f2-4422-88b4-d55f17a8f813'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.461938 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-66a699f2-80f2-4422-88b4-d55f17a8f813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4111fd040fc4a4d823b5e38204286f7', 'request_id': 'req-66a699f2-80f2-4422-88b4-d55f17a8f813'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.476022 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-66a699f2-80f2-4422-88b4-d55f17a8f813 admin admin] The token cache is being invalidate because project b4111fd040fc4a4d823b5e38204286f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:35.476134 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-66a699f2-80f2-4422-88b4-d55f17a8f813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.476940 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-66a699f2-80f2-4422-88b4-d55f17a8f813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.478757 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1038/2068] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:35 2022] DELETE /identity/v3/projects/b4111fd040fc4a4d823b5e38204286f7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:35.484565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcfdf9-ac6d-4764-b9ed-4ceacdf5f662 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:35.485025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcfdf9-ac6d-4764-b9ed-4ceacdf5f662 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:35.485567 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcfdf9-ac6d-4764-b9ed-4ceacdf5f662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:35.504360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-39bcfdf9-ac6d-4764-b9ed-4ceacdf5f662 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:35.506230 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-39bcfdf9-ac6d-4764-b9ed-4ceacdf5f662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:35.565068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1031/2069] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:35.575695 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aad356-3c80-40f9-98f1-57e7813d3a11 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:35.576215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aad356-3c80-40f9-98f1-57e7813d3a11 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:35.576531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aad356-3c80-40f9-98f1-57e7813d3a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:35.596714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-78aad356-3c80-40f9-98f1-57e7813d3a11 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:35.597835 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-78aad356-3c80-40f9-98f1-57e7813d3a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:35.606627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1039/2070] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:35.610934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcfdf9-ac6d-4764-b9ed-4ceacdf5f662 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:35.623268 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcfdf9-ac6d-4764-b9ed-4ceacdf5f662 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:35.629718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cec87-f6de-4225-9baa-cdcab7f24ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:35.631204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cec87-f6de-4225-9baa-cdcab7f24ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:35.631480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cec87-f6de-4225-9baa-cdcab7f24ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:35.631656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cec87-f6de-4225-9baa-cdcab7f24ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:35.632407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cec87-f6de-4225-9baa-cdcab7f24ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:35.632721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cec87-f6de-4225-9baa-cdcab7f24ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:35.634847 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cec87-f6de-4225-9baa-cdcab7f24ac8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:35.650254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aad356-3c80-40f9-98f1-57e7813d3a11 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:35.653530 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-78aad356-3c80-40f9-98f1-57e7813d3a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:35.653621 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1032/2071] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:11:35.654876 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cec87-f6de-4225-9baa-cdcab7f24ac8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:35.664909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aad356-3c80-40f9-98f1-57e7813d3a11 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:35.666589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cec87-f6de-4225-9baa-cdcab7f24ac8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:35.670106 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ac6c8-ce2b-4bcc-9d65-2d793c82f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:35.671351 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ac6c8-ce2b-4bcc-9d65-2d793c82f921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:35.671676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ac6c8-ce2b-4bcc-9d65-2d793c82f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:35.671961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ac6c8-ce2b-4bcc-9d65-2d793c82f921 admin admin] PATH_INFO: `/v3/users/b1335e9ff964442ab75b799b8264bd72` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:35.672363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af42e8-e0c4-4bf1-9a00-3708371daff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:35.673273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af42e8-e0c4-4bf1-9a00-3708371daff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:35.673438 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ac6c8-ce2b-4bcc-9d65-2d793c82f921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1335e9ff964442ab75b799b8264bd72)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:35.673556 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af42e8-e0c4-4bf1-9a00-3708371daff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:35.673828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af42e8-e0c4-4bf1-9a00-3708371daff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:35.674543 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af42e8-e0c4-4bf1-9a00-3708371daff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:35.675633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ac6c8-ce2b-4bcc-9d65-2d793c82f921 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:35.676500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af42e8-e0c4-4bf1-9a00-3708371daff4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:35.714778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1033/2072] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:35 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:35.719432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af42e8-e0c4-4bf1-9a00-3708371daff4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:35.733260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-444ac6c8-ce2b-4bcc-9d65-2d793c82f921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1335e9ff964442ab75b799b8264bd72'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.734275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-444ac6c8-ce2b-4bcc-9d65-2d793c82f921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1335e9ff964442ab75b799b8264bd72'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.749270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-444ac6c8-ce2b-4bcc-9d65-2d793c82f921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1335e9ff964442ab75b799b8264bd72'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.757749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-444ac6c8-ce2b-4bcc-9d65-2d793c82f921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1335e9ff964442ab75b799b8264bd72'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.758553 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-444ac6c8-ce2b-4bcc-9d65-2d793c82f921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1335e9ff964442ab75b799b8264bd72'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.774606 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1040/2073] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:35 2022] DELETE /identity/v3/users/b1335e9ff964442ab75b799b8264bd72 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:35.778315 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ac6c8-ce2b-4bcc-9d65-2d793c82f921 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:35.779785 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-444ac6c8-ce2b-4bcc-9d65-2d793c82f921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:35.791985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af42e8-e0c4-4bf1-9a00-3708371daff4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:35.846080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ac6c8-ce2b-4bcc-9d65-2d793c82f921 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:35.851423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b57bd-90ea-4a5a-b689-759168c50d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:35.851595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1ed16-7ef6-4089-a378-8f541ca68d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:35.852175 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b57bd-90ea-4a5a-b689-759168c50d2a admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:35.852396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1ed16-7ef6-4089-a378-8f541ca68d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:35.852504 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b57bd-90ea-4a5a-b689-759168c50d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:35.852681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1ed16-7ef6-4089-a378-8f541ca68d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:35.852841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b57bd-90ea-4a5a-b689-759168c50d2a admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:35.852953 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1ed16-7ef6-4089-a378-8f541ca68d61 admin admin] PATH_INFO: `/v3/projects/a36784c2378b41969025db182f225ed2` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:35.853380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b57bd-90ea-4a5a-b689-759168c50d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:35.854132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1ed16-7ef6-4089-a378-8f541ca68d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a36784c2378b41969025db182f225ed2)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:35.855414 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b57bd-90ea-4a5a-b689-759168c50d2a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:35.856064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1ed16-7ef6-4089-a378-8f541ca68d61 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:35.876304 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1034/2074] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:35 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:35.877758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175295e-b736-4f90-b516-95c5144cfb14 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:35.878051 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175295e-b736-4f90-b516-95c5144cfb14 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:35.878327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175295e-b736-4f90-b516-95c5144cfb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:35.896106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4175295e-b736-4f90-b516-95c5144cfb14 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:35.899019 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4175295e-b736-4f90-b516-95c5144cfb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:35.908881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-96f1ed16-7ef6-4089-a378-8f541ca68d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a36784c2378b41969025db182f225ed2', 'request_id': 'req-96f1ed16-7ef6-4089-a378-8f541ca68d61'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.915267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-96f1ed16-7ef6-4089-a378-8f541ca68d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a36784c2378b41969025db182f225ed2', 'request_id': 'req-96f1ed16-7ef6-4089-a378-8f541ca68d61'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.923060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-96f1ed16-7ef6-4089-a378-8f541ca68d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a36784c2378b41969025db182f225ed2', 'request_id': 'req-96f1ed16-7ef6-4089-a378-8f541ca68d61'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.942297 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-96f1ed16-7ef6-4089-a378-8f541ca68d61 admin admin] The token cache is being invalidate because project a36784c2378b41969025db182f225ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:35.942297 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-96f1ed16-7ef6-4089-a378-8f541ca68d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.942297 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-96f1ed16-7ef6-4089-a378-8f541ca68d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:35.942297 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1041/2075] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:35 2022] DELETE /identity/v3/projects/a36784c2378b41969025db182f225ed2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:35.943085 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1ed16-7ef6-4089-a378-8f541ca68d61 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:35.944888 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-96f1ed16-7ef6-4089-a378-8f541ca68d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:35.960953 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1035/2076] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:35.962578 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d73c5-6cab-441c-b0cd-6c355c14b886 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:35.962872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d73c5-6cab-441c-b0cd-6c355c14b886 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:35.963147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d73c5-6cab-441c-b0cd-6c355c14b886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:35.983393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-334d73c5-6cab-441c-b0cd-6c355c14b886 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:35.984580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-334d73c5-6cab-441c-b0cd-6c355c14b886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:35.994506 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1036/2077] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:35.995262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d73c5-6cab-441c-b0cd-6c355c14b886 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:35.996657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-334d73c5-6cab-441c-b0cd-6c355c14b886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:36.027265 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1ed16-7ef6-4089-a378-8f541ca68d61 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:36.039635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb117f0-c2fd-42cb-8c6c-4373e99cd68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:36.040957 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb117f0-c2fd-42cb-8c6c-4373e99cd68f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.041343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb117f0-c2fd-42cb-8c6c-4373e99cd68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.041808 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb117f0-c2fd-42cb-8c6c-4373e99cd68f admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.043731 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb117f0-c2fd-42cb-8c6c-4373e99cd68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:36.045582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb117f0-c2fd-42cb-8c6c-4373e99cd68f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:36.058248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1042/2078] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:36.059810 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b44df-e91c-40aa-a2a3-3cc8d7be6963 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.060157 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b44df-e91c-40aa-a2a3-3cc8d7be6963 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.060494 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b44df-e91c-40aa-a2a3-3cc8d7be6963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.072331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d73c5-6cab-441c-b0cd-6c355c14b886 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:36.076126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff576024-34f8-44f3-8711-0544a99846a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:36.076852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff576024-34f8-44f3-8711-0544a99846a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.077207 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff576024-34f8-44f3-8711-0544a99846a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.077555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff576024-34f8-44f3-8711-0544a99846a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.080091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d90b44df-e91c-40aa-a2a3-3cc8d7be6963 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:36.081341 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d90b44df-e91c-40aa-a2a3-3cc8d7be6963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:36.093349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff576024-34f8-44f3-8711-0544a99846a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:36.095242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff576024-34f8-44f3-8711-0544a99846a7 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:36.096859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1043/2079] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:36.097569 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b44df-e91c-40aa-a2a3-3cc8d7be6963 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:36.108822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b44df-e91c-40aa-a2a3-3cc8d7be6963 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:36.109264 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1037/2080] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:36.110112 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff576024-34f8-44f3-8711-0544a99846a7 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:36.113894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a87ce-8776-4b35-8fc0-8be31dc4a6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:36.114617 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a87ce-8776-4b35-8fc0-8be31dc4a6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.115047 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a87ce-8776-4b35-8fc0-8be31dc4a6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.115943 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a87ce-8776-4b35-8fc0-8be31dc4a6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.116629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a87ce-8776-4b35-8fc0-8be31dc4a6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:36.118224 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a87ce-8776-4b35-8fc0-8be31dc4a6a1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:36.121137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff576024-34f8-44f3-8711-0544a99846a7 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:36.125781 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f8c7-b69e-408f-9219-2a2b50002ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:36.126427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f8c7-b69e-408f-9219-2a2b50002ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.126762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f8c7-b69e-408f-9219-2a2b50002ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.126968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f8c7-b69e-408f-9219-2a2b50002ef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.127721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6f8c7-b69e-408f-9219-2a2b50002ef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:36.131719 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6f8c7-b69e-408f-9219-2a2b50002ef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:36.131719 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6f8c7-b69e-408f-9219-2a2b50002ef0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:36.131968 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1044/2081] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:36.133097 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a87ce-8776-4b35-8fc0-8be31dc4a6a1 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:36.142817 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a87ce-8776-4b35-8fc0-8be31dc4a6a1 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:36.146720 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1038/2082] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:36.148512 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357f5f1-cfb9-48c0-9054-10d3fdef9e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:36.149406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357f5f1-cfb9-48c0-9054-10d3fdef9e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.149683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357f5f1-cfb9-48c0-9054-10d3fdef9e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.149957 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357f5f1-cfb9-48c0-9054-10d3fdef9e59 admin admin] PATH_INFO: `/v3/projects/54981d1c7fe64f5cb6a846496ad4f776/users/61daaf70d25c4e1592fcb2f4feafff86/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.151425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f8c7-b69e-408f-9219-2a2b50002ef0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:36.161314 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f8c7-b69e-408f-9219-2a2b50002ef0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:36.165696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357f5f1-cfb9-48c0-9054-10d3fdef9e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54981d1c7fe64f5cb6a846496ad4f776, user_id=61daaf70d25c4e1592fcb2f4feafff86, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:36.167386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f76f6f-efa6-4f8a-8cff-9a55a89f617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:36.168446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357f5f1-cfb9-48c0-9054-10d3fdef9e59 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:36.168878 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f76f6f-efa6-4f8a-8cff-9a55a89f617c admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.169153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f76f6f-efa6-4f8a-8cff-9a55a89f617c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.169421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f76f6f-efa6-4f8a-8cff-9a55a89f617c admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.170105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f76f6f-efa6-4f8a-8cff-9a55a89f617c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:36.172548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f76f6f-efa6-4f8a-8cff-9a55a89f617c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:36.183518 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1045/2083] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:36 2022] PUT /identity/v3/projects/54981d1c7fe64f5cb6a846496ad4f776/users/61daaf70d25c4e1592fcb2f4feafff86/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:36.189155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d7638-ec6c-45a8-8a55-a61106e0a215 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.189573 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d7638-ec6c-45a8-8a55-a61106e0a215 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.190164 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d7638-ec6c-45a8-8a55-a61106e0a215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.203213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1039/2084] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:36 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:36.207099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f76f6f-efa6-4f8a-8cff-9a55a89f617c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:36.212629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6a9d7638-ec6c-45a8-8a55-a61106e0a215 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:36.213936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6a9d7638-ec6c-45a8-8a55-a61106e0a215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:36.278380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f76f6f-efa6-4f8a-8cff-9a55a89f617c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:36.284294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124d419-45c7-44d1-b349-36b45f760485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:36.285113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124d419-45c7-44d1-b349-36b45f760485 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.285575 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124d419-45c7-44d1-b349-36b45f760485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.285852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124d419-45c7-44d1-b349-36b45f760485 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.287399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1046/2085] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:36.288078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124d419-45c7-44d1-b349-36b45f760485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:36.290407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124d419-45c7-44d1-b349-36b45f760485 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:36.298403 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d7638-ec6c-45a8-8a55-a61106e0a215 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:36.300391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6a9d7638-ec6c-45a8-8a55-a61106e0a215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:36.319968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1040/2086] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:36 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:11:36.324897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124d419-45c7-44d1-b349-36b45f760485 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:36.336418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124d419-45c7-44d1-b349-36b45f760485 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:36.341682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cafea-81ac-4fdf-8ede-f742e429f515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:36.342413 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cafea-81ac-4fdf-8ede-f742e429f515 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.342698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cafea-81ac-4fdf-8ede-f742e429f515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.342973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cafea-81ac-4fdf-8ede-f742e429f515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.343727 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cafea-81ac-4fdf-8ede-f742e429f515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:36.345333 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cafea-81ac-4fdf-8ede-f742e429f515 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:36.356623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1041/2087] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:36.360152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cafea-81ac-4fdf-8ede-f742e429f515 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:36.370893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cafea-81ac-4fdf-8ede-f742e429f515 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:36.375873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d46f0-e620-4072-b6e2-b2474b537008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:36.376631 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d7638-ec6c-45a8-8a55-a61106e0a215 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:36.377086 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d46f0-e620-4072-b6e2-b2474b537008 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.377086 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d46f0-e620-4072-b6e2-b2474b537008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.377265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d46f0-e620-4072-b6e2-b2474b537008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.378098 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d46f0-e620-4072-b6e2-b2474b537008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:36.380469 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d46f0-e620-4072-b6e2-b2474b537008 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:36.383273 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2ab68-d82c-447d-b453-6095dce8379d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:36.384903 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2ab68-d82c-447d-b453-6095dce8379d service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.385416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2ab68-d82c-447d-b453-6095dce8379d service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.386288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2ab68-d82c-447d-b453-6095dce8379d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.394240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1042/2088] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:36.398354 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d46f0-e620-4072-b6e2-b2474b537008 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:36.402955 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2ab68-d82c-447d-b453-6095dce8379d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:36.404956 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2ab68-d82c-447d-b453-6095dce8379d service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:36.411167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d46f0-e620-4072-b6e2-b2474b537008 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:36.417085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755fc43-7552-4bfe-8326-542039b2933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:36.417847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1047/2089] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:36.418621 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755fc43-7552-4bfe-8326-542039b2933c admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.418900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755fc43-7552-4bfe-8326-542039b2933c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.419169 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755fc43-7552-4bfe-8326-542039b2933c admin admin] PATH_INFO: `/v3/projects/76dd1e85ff064cdfa02c612a6ea756f1/users/4f6c6e1ae9314ccfbbfdcf645f59398f/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.433841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755fc43-7552-4bfe-8326-542039b2933c admin admin] RBAC: Authorizing `identity:create_grant(project_id=76dd1e85ff064cdfa02c612a6ea756f1, user_id=4f6c6e1ae9314ccfbbfdcf645f59398f, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:36.436509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755fc43-7552-4bfe-8326-542039b2933c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:36.451145 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1043/2090] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:36 2022] PUT /identity/v3/projects/76dd1e85ff064cdfa02c612a6ea756f1/users/4f6c6e1ae9314ccfbbfdcf645f59398f/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:36.463545 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfe350-991e-4740-85e6-0b8bc264c63e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.463965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfe350-991e-4740-85e6-0b8bc264c63e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.464246 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfe350-991e-4740-85e6-0b8bc264c63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.491021 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b1dfe350-991e-4740-85e6-0b8bc264c63e None None] MFA Rules not processed for user `4f6c6e1ae9314ccfbbfdcf645f59398f`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:36.492418 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b1dfe350-991e-4740-85e6-0b8bc264c63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:36.601135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1048/2091] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:36.606770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755fc43-7552-4bfe-8326-542039b2933c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:36.670368 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfe350-991e-4740-85e6-0b8bc264c63e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:36.671992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b1dfe350-991e-4740-85e6-0b8bc264c63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:36.699989 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755fc43-7552-4bfe-8326-542039b2933c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:36.712305 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c433dd-f15c-4768-b048-a2007df76d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:36.712989 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c433dd-f15c-4768-b048-a2007df76d1f admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.713271 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c433dd-f15c-4768-b048-a2007df76d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.713588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c433dd-f15c-4768-b048-a2007df76d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.714291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c433dd-f15c-4768-b048-a2007df76d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:36.716358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c433dd-f15c-4768-b048-a2007df76d1f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:36.775283 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1044/2092] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:36 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:36.780772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c433dd-f15c-4768-b048-a2007df76d1f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:36.782622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfe350-991e-4740-85e6-0b8bc264c63e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:36.872111 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefaa7e0-7435-4697-9f7a-9121ea25dc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:36.873240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaa7e0-7435-4697-9f7a-9121ea25dc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.874269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaa7e0-7435-4697-9f7a-9121ea25dc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.874699 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaa7e0-7435-4697-9f7a-9121ea25dc92 admin admin] PATH_INFO: `/v3/projects/49179ae52ac4414da8a7342133929859` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.876137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefaa7e0-7435-4697-9f7a-9121ea25dc92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49179ae52ac4414da8a7342133929859)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:36.878200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefaa7e0-7435-4697-9f7a-9121ea25dc92 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:36.918627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c433dd-f15c-4768-b048-a2007df76d1f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:36.925007 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13531f-0c43-4c8e-ab83-e0577ec432cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:36.925781 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13531f-0c43-4c8e-ab83-e0577ec432cd admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:36.926220 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13531f-0c43-4c8e-ab83-e0577ec432cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:36.926552 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13531f-0c43-4c8e-ab83-e0577ec432cd admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:36.928509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13531f-0c43-4c8e-ab83-e0577ec432cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:36.942540 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-eefaa7e0-7435-4697-9f7a-9121ea25dc92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49179ae52ac4414da8a7342133929859', 'request_id': 'req-eefaa7e0-7435-4697-9f7a-9121ea25dc92'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:36.945931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13531f-0c43-4c8e-ab83-e0577ec432cd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:36.958432 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-eefaa7e0-7435-4697-9f7a-9121ea25dc92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49179ae52ac4414da8a7342133929859', 'request_id': 'req-eefaa7e0-7435-4697-9f7a-9121ea25dc92'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:36.971035 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-eefaa7e0-7435-4697-9f7a-9121ea25dc92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49179ae52ac4414da8a7342133929859', 'request_id': 'req-eefaa7e0-7435-4697-9f7a-9121ea25dc92'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:36.982187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1045/2093] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:36 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:36.986756 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13531f-0c43-4c8e-ab83-e0577ec432cd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:36.991134 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-eefaa7e0-7435-4697-9f7a-9121ea25dc92 admin admin] The token cache is being invalidate because project 49179ae52ac4414da8a7342133929859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:36.991739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-eefaa7e0-7435-4697-9f7a-9121ea25dc92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:36.992588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-eefaa7e0-7435-4697-9f7a-9121ea25dc92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:36.995554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1049/2094] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:36 2022] DELETE /identity/v3/projects/49179ae52ac4414da8a7342133929859 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:37.000595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefaa7e0-7435-4697-9f7a-9121ea25dc92 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:37.002818 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13531f-0c43-4c8e-ab83-e0577ec432cd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:37.005231 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-eefaa7e0-7435-4697-9f7a-9121ea25dc92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:37.075061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5698133-ee02-4d6d-8a20-d8e94e5f3dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:37.076336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5698133-ee02-4d6d-8a20-d8e94e5f3dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:37.076619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5698133-ee02-4d6d-8a20-d8e94e5f3dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:37.077162 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5698133-ee02-4d6d-8a20-d8e94e5f3dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:37.077899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5698133-ee02-4d6d-8a20-d8e94e5f3dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:37.079331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefaa7e0-7435-4697-9f7a-9121ea25dc92 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:37.079692 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5698133-ee02-4d6d-8a20-d8e94e5f3dd2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:37.084704 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a9a28-6b48-4efa-af39-8647d98451d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:37.086294 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a9a28-6b48-4efa-af39-8647d98451d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:37.086643 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a9a28-6b48-4efa-af39-8647d98451d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:37.087279 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a9a28-6b48-4efa-af39-8647d98451d5 admin admin] PATH_INFO: `/v3/users/6475d79fef5e4f47a2178e23b03223d0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:37.089965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a9a28-6b48-4efa-af39-8647d98451d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6475d79fef5e4f47a2178e23b03223d0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:37.091938 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a9a28-6b48-4efa-af39-8647d98451d5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:37.096778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1046/2095] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:37.101671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5698133-ee02-4d6d-8a20-d8e94e5f3dd2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:37.104198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b5698133-ee02-4d6d-8a20-d8e94e5f3dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:37.118548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5698133-ee02-4d6d-8a20-d8e94e5f3dd2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:37.124035 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbb535-cad8-4064-b6a1-99d4a29c3b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:37.124982 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbb535-cad8-4064-b6a1-99d4a29c3b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:37.125266 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbb535-cad8-4064-b6a1-99d4a29c3b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:37.125716 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbb535-cad8-4064-b6a1-99d4a29c3b57 admin admin] PATH_INFO: `/v3/projects/559cd183044c49a89c7e38d8279a0b23/users/1d87640c2f554cfe99044eea6b6d7184/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:37.143695 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbb535-cad8-4064-b6a1-99d4a29c3b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559cd183044c49a89c7e38d8279a0b23, user_id=1d87640c2f554cfe99044eea6b6d7184, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:37.146509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbb535-cad8-4064-b6a1-99d4a29c3b57 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:37.156510 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-144a9a28-6b48-4efa-af39-8647d98451d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6475d79fef5e4f47a2178e23b03223d0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:37.157298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-144a9a28-6b48-4efa-af39-8647d98451d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6475d79fef5e4f47a2178e23b03223d0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:37.160651 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1047/2096] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:37 2022] PUT /identity/v3/projects/559cd183044c49a89c7e38d8279a0b23/users/1d87640c2f554cfe99044eea6b6d7184/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:37.165523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbb535-cad8-4064-b6a1-99d4a29c3b57 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:37.173284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-144a9a28-6b48-4efa-af39-8647d98451d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6475d79fef5e4f47a2178e23b03223d0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:37.180646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-144a9a28-6b48-4efa-af39-8647d98451d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6475d79fef5e4f47a2178e23b03223d0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:37.181438 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-144a9a28-6b48-4efa-af39-8647d98451d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6475d79fef5e4f47a2178e23b03223d0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:37.197448 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1050/2097] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:36 2022] DELETE /identity/v3/users/6475d79fef5e4f47a2178e23b03223d0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:37.236581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbb535-cad8-4064-b6a1-99d4a29c3b57 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:37.306791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a573e52-6919-4b55-9bae-828e1ffb2e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:37.307788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a573e52-6919-4b55-9bae-828e1ffb2e61 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:37.308254 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a573e52-6919-4b55-9bae-828e1ffb2e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:37.308423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a573e52-6919-4b55-9bae-828e1ffb2e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:37.309160 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a573e52-6919-4b55-9bae-828e1ffb2e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:37.311201 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a573e52-6919-4b55-9bae-828e1ffb2e61 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:37.327742 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1048/2098] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:11:37.328967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a9a28-6b48-4efa-af39-8647d98451d5 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:37.330395 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-144a9a28-6b48-4efa-af39-8647d98451d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:37.377866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a9a28-6b48-4efa-af39-8647d98451d5 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:37.393851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e8045-0d0a-4fae-9b84-fa493d6c260f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:37.395101 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e8045-0d0a-4fae-9b84-fa493d6c260f admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:37.397055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e8045-0d0a-4fae-9b84-fa493d6c260f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:37.398790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e8045-0d0a-4fae-9b84-fa493d6c260f admin admin] PATH_INFO: `/v3/projects/559cd183044c49a89c7e38d8279a0b23/users/1d87640c2f554cfe99044eea6b6d7184/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:37.404940 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e8045-0d0a-4fae-9b84-fa493d6c260f admin admin] RBAC: Authorizing `identity:create_grant(project_id=559cd183044c49a89c7e38d8279a0b23, user_id=1d87640c2f554cfe99044eea6b6d7184, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:37.413491 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e8045-0d0a-4fae-9b84-fa493d6c260f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:37.444000 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1051/2099] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:37 2022] PUT /identity/v3/projects/559cd183044c49a89c7e38d8279a0b23/users/1d87640c2f554cfe99044eea6b6d7184/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:37.455339 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c17e0-bf2a-4cd5-a1c1-6dc0a3e28eaa None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:37.455662 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c17e0-bf2a-4cd5-a1c1-6dc0a3e28eaa None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:37.456000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c17e0-bf2a-4cd5-a1c1-6dc0a3e28eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:37.491904 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1f1c17e0-bf2a-4cd5-a1c1-6dc0a3e28eaa None None] MFA Rules not processed for user `1d87640c2f554cfe99044eea6b6d7184`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:37.494289 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1f1c17e0-bf2a-4cd5-a1c1-6dc0a3e28eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:37.574993 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e8045-0d0a-4fae-9b84-fa493d6c260f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:37.580700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5d9e8045-0d0a-4fae-9b84-fa493d6c260f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:37.609773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1049/2100] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:37.621480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c17e0-bf2a-4cd5-a1c1-6dc0a3e28eaa None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:37.624816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1f1c17e0-bf2a-4cd5-a1c1-6dc0a3e28eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:37.711517 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c17e0-bf2a-4cd5-a1c1-6dc0a3e28eaa None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:37.715594 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4d5d4-2952-41e9-9198-a8b7ddf03f86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:37.716534 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4d5d4-2952-41e9-9198-a8b7ddf03f86 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:37.716805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4d5d4-2952-41e9-9198-a8b7ddf03f86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:37.717140 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4d5d4-2952-41e9-9198-a8b7ddf03f86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:37.749211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4d5d4-2952-41e9-9198-a8b7ddf03f86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:37.750660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4d5d4-2952-41e9-9198-a8b7ddf03f86 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:37.754807 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e8045-0d0a-4fae-9b84-fa493d6c260f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:37.764325 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:37.765337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:37.766621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:37.767911 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee admin admin] PATH_INFO: `/v3/projects/9a05945d71044cbeb474b0dfaa0dd7aa` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:37.770009 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a05945d71044cbeb474b0dfaa0dd7aa)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:37.770294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1050/2101] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:37.773947 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:37.896201 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a05945d71044cbeb474b0dfaa0dd7aa', 'request_id': 'req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:37.919072 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a05945d71044cbeb474b0dfaa0dd7aa', 'request_id': 'req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:37.938557 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a05945d71044cbeb474b0dfaa0dd7aa', 'request_id': 'req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:37.957536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee admin admin] The token cache is being invalidate because project 9a05945d71044cbeb474b0dfaa0dd7aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:37.958112 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:37.959471 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:37.964761 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1052/2102] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:37 2022] DELETE /identity/v3/projects/9a05945d71044cbeb474b0dfaa0dd7aa => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:37.965622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4d5d4-2952-41e9-9198-a8b7ddf03f86 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:37.989231 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4d5d4-2952-41e9-9198-a8b7ddf03f86 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:38.121089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18020b-8ada-4865-81d7-fc1e1cd2c76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:38.122007 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18020b-8ada-4865-81d7-fc1e1cd2c76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:38.122349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18020b-8ada-4865-81d7-fc1e1cd2c76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:38.122724 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18020b-8ada-4865-81d7-fc1e1cd2c76b admin admin] PATH_INFO: `/v3/users/685ffa74007d4369a3a5e0204c3bb2af` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:38.124302 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18020b-8ada-4865-81d7-fc1e1cd2c76b admin admin] RBAC: Authorizing `identity:delete_user(user_id=685ffa74007d4369a3a5e0204c3bb2af)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:38.128951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18020b-8ada-4865-81d7-fc1e1cd2c76b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:38.241153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ed18020b-8ada-4865-81d7-fc1e1cd2c76b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '685ffa74007d4369a3a5e0204c3bb2af'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:38.258040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ed18020b-8ada-4865-81d7-fc1e1cd2c76b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '685ffa74007d4369a3a5e0204c3bb2af'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:38.270311 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ed18020b-8ada-4865-81d7-fc1e1cd2c76b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '685ffa74007d4369a3a5e0204c3bb2af'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:38.272004 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ed18020b-8ada-4865-81d7-fc1e1cd2c76b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '685ffa74007d4369a3a5e0204c3bb2af'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:38.272872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ed18020b-8ada-4865-81d7-fc1e1cd2c76b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '685ffa74007d4369a3a5e0204c3bb2af'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:38.319649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1051/2103] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:37 2022] DELETE /identity/v3/users/685ffa74007d4369a3a5e0204c3bb2af => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:39.624298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:39.625748 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:39.650617 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a9c5f-6fd6-425d-afd8-f21f3ad16cee admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:39.764802 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1c221-58e9-424c-b5e5-fdd2ccedb434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:39.766178 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1c221-58e9-424c-b5e5-fdd2ccedb434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:39.766661 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1c221-58e9-424c-b5e5-fdd2ccedb434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:39.766943 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1c221-58e9-424c-b5e5-fdd2ccedb434 admin admin] PATH_INFO: `/v3/projects/f61bb679e37145a29a792179600fc15b` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:39.768467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1c221-58e9-424c-b5e5-fdd2ccedb434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61bb679e37145a29a792179600fc15b)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:39.770617 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1c221-58e9-424c-b5e5-fdd2ccedb434 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:39.849683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-aac1c221-58e9-424c-b5e5-fdd2ccedb434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61bb679e37145a29a792179600fc15b', 'request_id': 'req-aac1c221-58e9-424c-b5e5-fdd2ccedb434'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:39.858353 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-aac1c221-58e9-424c-b5e5-fdd2ccedb434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61bb679e37145a29a792179600fc15b', 'request_id': 'req-aac1c221-58e9-424c-b5e5-fdd2ccedb434'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:39.872976 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-aac1c221-58e9-424c-b5e5-fdd2ccedb434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61bb679e37145a29a792179600fc15b', 'request_id': 'req-aac1c221-58e9-424c-b5e5-fdd2ccedb434'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:39.889349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-aac1c221-58e9-424c-b5e5-fdd2ccedb434 admin admin] The token cache is being invalidate because project f61bb679e37145a29a792179600fc15b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:39.889728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-aac1c221-58e9-424c-b5e5-fdd2ccedb434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:39.891087 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-aac1c221-58e9-424c-b5e5-fdd2ccedb434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:39.894331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1053/2104] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:39 2022] DELETE /identity/v3/projects/f61bb679e37145a29a792179600fc15b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:39.899184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3d7f1-1bdb-4eed-9807-415445e3cb31 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:39.900106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3d7f1-1bdb-4eed-9807-415445e3cb31 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:39.900593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3d7f1-1bdb-4eed-9807-415445e3cb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:39.928015 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d6b3d7f1-1bdb-4eed-9807-415445e3cb31 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:39.936632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d6b3d7f1-1bdb-4eed-9807-415445e3cb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:40.012124 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1c221-58e9-424c-b5e5-fdd2ccedb434 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:40.013884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-aac1c221-58e9-424c-b5e5-fdd2ccedb434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:40.050988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1052/2105] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:40.059632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffde7fc-d4dc-419f-9be6-1af57e5355a8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:40.059995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffde7fc-d4dc-419f-9be6-1af57e5355a8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:40.060365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffde7fc-d4dc-419f-9be6-1af57e5355a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:40.080171 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0ffde7fc-d4dc-419f-9be6-1af57e5355a8 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:40.081480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0ffde7fc-d4dc-419f-9be6-1af57e5355a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:40.095741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1053/2106] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:11:40.098303 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffde7fc-d4dc-419f-9be6-1af57e5355a8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:40.107242 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1c221-58e9-424c-b5e5-fdd2ccedb434 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:40.108336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffde7fc-d4dc-419f-9be6-1af57e5355a8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:40.113213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d5535-f571-4e63-abd3-274e884f6c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:40.113927 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d5535-f571-4e63-abd3-274e884f6c5d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:40.114068 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fd7e4-0900-46ec-a13d-7db5e4b9487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:40.114180 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d5535-f571-4e63-abd3-274e884f6c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:40.114410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d5535-f571-4e63-abd3-274e884f6c5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:40.115586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fd7e4-0900-46ec-a13d-7db5e4b9487f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:40.115829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d5535-f571-4e63-abd3-274e884f6c5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:40.115914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fd7e4-0900-46ec-a13d-7db5e4b9487f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:40.116097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d5535-f571-4e63-abd3-274e884f6c5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:40.116197 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fd7e4-0900-46ec-a13d-7db5e4b9487f admin admin] PATH_INFO: `/v3/users/4f6c6e1ae9314ccfbbfdcf645f59398f` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:40.117381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fd7e4-0900-46ec-a13d-7db5e4b9487f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f6c6e1ae9314ccfbbfdcf645f59398f)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:40.117967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d5535-f571-4e63-abd3-274e884f6c5d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:40.119593 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fd7e4-0900-46ec-a13d-7db5e4b9487f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:40.140678 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1054/2107] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:40.146217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d5535-f571-4e63-abd3-274e884f6c5d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:40.157928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d5535-f571-4e63-abd3-274e884f6c5d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:40.164674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626e43d-9251-42b9-b5d2-fb5566e192ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:40.165341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626e43d-9251-42b9-b5d2-fb5566e192ef admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:40.165627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626e43d-9251-42b9-b5d2-fb5566e192ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:40.165903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626e43d-9251-42b9-b5d2-fb5566e192ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:40.166609 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626e43d-9251-42b9-b5d2-fb5566e192ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:40.168613 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626e43d-9251-42b9-b5d2-fb5566e192ef admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:40.184094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f86fd7e4-0900-46ec-a13d-7db5e4b9487f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f6c6e1ae9314ccfbbfdcf645f59398f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:40.184860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f86fd7e4-0900-46ec-a13d-7db5e4b9487f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f6c6e1ae9314ccfbbfdcf645f59398f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:40.203504 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f86fd7e4-0900-46ec-a13d-7db5e4b9487f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f6c6e1ae9314ccfbbfdcf645f59398f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:40.203890 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1055/2108] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:40 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:11:40.208265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626e43d-9251-42b9-b5d2-fb5566e192ef admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:40.212880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f86fd7e4-0900-46ec-a13d-7db5e4b9487f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f6c6e1ae9314ccfbbfdcf645f59398f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:40.213645 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f86fd7e4-0900-46ec-a13d-7db5e4b9487f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f6c6e1ae9314ccfbbfdcf645f59398f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:40.232237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1054/2109] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:40 2022] DELETE /identity/v3/users/4f6c6e1ae9314ccfbbfdcf645f59398f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:40.236547 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514692f-a174-4451-b710-21ee6c9fbd28 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:40.237308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514692f-a174-4451-b710-21ee6c9fbd28 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:40.237740 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514692f-a174-4451-b710-21ee6c9fbd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:40.266762 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6514692f-a174-4451-b710-21ee6c9fbd28 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:40.270463 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6514692f-a174-4451-b710-21ee6c9fbd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:40.300192 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626e43d-9251-42b9-b5d2-fb5566e192ef admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:40.374581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1055/2110] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:11:40.385793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514692f-a174-4451-b710-21ee6c9fbd28 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:40.387175 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6514692f-a174-4451-b710-21ee6c9fbd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:40.410877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0055-c13e-4a4a-9225-6e5a6ec53a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:40.411595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0055-c13e-4a4a-9225-6e5a6ec53a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:40.411950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0055-c13e-4a4a-9225-6e5a6ec53a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:40.412251 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0055-c13e-4a4a-9225-6e5a6ec53a61 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:40.413206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d0055-c13e-4a4a-9225-6e5a6ec53a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:40.415312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d0055-c13e-4a4a-9225-6e5a6ec53a61 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:40.444000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1056/2111] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:40 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:40.445225 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0055-c13e-4a4a-9225-6e5a6ec53a61 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:40.447072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b31d0055-c13e-4a4a-9225-6e5a6ec53a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:40.460297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0055-c13e-4a4a-9225-6e5a6ec53a61 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:40.468062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514692f-a174-4451-b710-21ee6c9fbd28 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:40.473014 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe39c9d-6674-40e6-aa5b-fb0ae9cea8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:40.473707 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe39c9d-6674-40e6-aa5b-fb0ae9cea8fc service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:40.474429 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe39c9d-6674-40e6-aa5b-fb0ae9cea8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:40.474821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe39c9d-6674-40e6-aa5b-fb0ae9cea8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:40.478217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ece1d-c337-40ec-909a-e59bd015a610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:40.478943 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ece1d-c337-40ec-909a-e59bd015a610 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:40.479300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ece1d-c337-40ec-909a-e59bd015a610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:40.481390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ece1d-c337-40ec-909a-e59bd015a610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:40.482216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ece1d-c337-40ec-909a-e59bd015a610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:40.484351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ece1d-c337-40ec-909a-e59bd015a610 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:40.489049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe39c9d-6674-40e6-aa5b-fb0ae9cea8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:40.491762 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe39c9d-6674-40e6-aa5b-fb0ae9cea8fc service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:40.510505 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1057/2112] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:11:40.513857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ece1d-c337-40ec-909a-e59bd015a610 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:40.541733 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ece1d-c337-40ec-909a-e59bd015a610 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:40.545336 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1056/2113] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:11:40.565536 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850a20f-7501-4a05-8654-3263cf678b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:40.566379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850a20f-7501-4a05-8654-3263cf678b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:40.566778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850a20f-7501-4a05-8654-3263cf678b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:40.567154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850a20f-7501-4a05-8654-3263cf678b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:40.570260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850a20f-7501-4a05-8654-3263cf678b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:40.574006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850a20f-7501-4a05-8654-3263cf678b2c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:40.603977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1058/2114] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:40.608403 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe39c9d-6674-40e6-aa5b-fb0ae9cea8fc service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:40.620166 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe39c9d-6674-40e6-aa5b-fb0ae9cea8fc service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:40.630121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d21e1-38ab-4ab9-878c-0cc2562aca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:40.632195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d21e1-38ab-4ab9-878c-0cc2562aca30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:40.632195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d21e1-38ab-4ab9-878c-0cc2562aca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:40.632409 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d21e1-38ab-4ab9-878c-0cc2562aca30 admin admin] PATH_INFO: `/v3/projects/260311245b60460283c01ebc87cb5bc2/users/d7b9ce69a40845c5adef40e3e0355747/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:40.648901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d21e1-38ab-4ab9-878c-0cc2562aca30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=260311245b60460283c01ebc87cb5bc2, user_id=d7b9ce69a40845c5adef40e3e0355747, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:40.651831 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d21e1-38ab-4ab9-878c-0cc2562aca30 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:40.690299 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1057/2115] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:40 2022] PUT /identity/v3/projects/260311245b60460283c01ebc87cb5bc2/users/d7b9ce69a40845c5adef40e3e0355747/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:40.696797 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94ab04-d876-4bc7-a42f-a3a420a8d80f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:40.697365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94ab04-d876-4bc7-a42f-a3a420a8d80f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:40.697869 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94ab04-d876-4bc7-a42f-a3a420a8d80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:40.723573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ce94ab04-d876-4bc7-a42f-a3a420a8d80f None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:40.725379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ce94ab04-d876-4bc7-a42f-a3a420a8d80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:40.817417 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1059/2116] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:40.854322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d21e1-38ab-4ab9-878c-0cc2562aca30 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:40.981405 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d21e1-38ab-4ab9-878c-0cc2562aca30 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:40.991454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab54edb-5809-4569-9267-6773bb464fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:40.993225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab54edb-5809-4569-9267-6773bb464fed service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:40.993744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab54edb-5809-4569-9267-6773bb464fed service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:40.994450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab54edb-5809-4569-9267-6773bb464fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:41.013927 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab54edb-5809-4569-9267-6773bb464fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:41.016435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab54edb-5809-4569-9267-6773bb464fed service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:41.054104 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1058/2117] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:41.315505 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94ab04-d876-4bc7-a42f-a3a420a8d80f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:41.317260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ce94ab04-d876-4bc7-a42f-a3a420a8d80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:41.334268 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94ab04-d876-4bc7-a42f-a3a420a8d80f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:41.355467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aabea-6f07-42c3-9544-3ae5bb00dcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:41.356387 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aabea-6f07-42c3-9544-3ae5bb00dcb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:41.356669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aabea-6f07-42c3-9544-3ae5bb00dcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:41.356942 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aabea-6f07-42c3-9544-3ae5bb00dcb3 admin admin] PATH_INFO: `/v3/projects/76dd1e85ff064cdfa02c612a6ea756f1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:41.358178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189aabea-6f07-42c3-9544-3ae5bb00dcb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76dd1e85ff064cdfa02c612a6ea756f1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:41.360145 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189aabea-6f07-42c3-9544-3ae5bb00dcb3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:41.450861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-189aabea-6f07-42c3-9544-3ae5bb00dcb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76dd1e85ff064cdfa02c612a6ea756f1', 'request_id': 'req-189aabea-6f07-42c3-9544-3ae5bb00dcb3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:41.459154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-189aabea-6f07-42c3-9544-3ae5bb00dcb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76dd1e85ff064cdfa02c612a6ea756f1', 'request_id': 'req-189aabea-6f07-42c3-9544-3ae5bb00dcb3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:41.495828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-189aabea-6f07-42c3-9544-3ae5bb00dcb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76dd1e85ff064cdfa02c612a6ea756f1', 'request_id': 'req-189aabea-6f07-42c3-9544-3ae5bb00dcb3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:41.514020 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-189aabea-6f07-42c3-9544-3ae5bb00dcb3 admin admin] The token cache is being invalidate because project 76dd1e85ff064cdfa02c612a6ea756f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:41.514309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-189aabea-6f07-42c3-9544-3ae5bb00dcb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:41.514977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-189aabea-6f07-42c3-9544-3ae5bb00dcb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:41.519657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1060/2118] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:41 2022] DELETE /identity/v3/projects/76dd1e85ff064cdfa02c612a6ea756f1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:41.522097 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab54edb-5809-4569-9267-6773bb464fed service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:41.535344 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab54edb-5809-4569-9267-6773bb464fed service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:41.647312 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e6547-7330-45e5-aa57-55e787eb9dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:41.648237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e6547-7330-45e5-aa57-55e787eb9dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:41.648517 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e6547-7330-45e5-aa57-55e787eb9dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:41.650309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e6547-7330-45e5-aa57-55e787eb9dc4 admin admin] PATH_INFO: `/v3/users/1d87640c2f554cfe99044eea6b6d7184` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:41.657084 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e6547-7330-45e5-aa57-55e787eb9dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d87640c2f554cfe99044eea6b6d7184)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:41.659050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e6547-7330-45e5-aa57-55e787eb9dc4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:41.789836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8e6e6547-7330-45e5-aa57-55e787eb9dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d87640c2f554cfe99044eea6b6d7184'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:41.796145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8e6e6547-7330-45e5-aa57-55e787eb9dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d87640c2f554cfe99044eea6b6d7184'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:41.851113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8e6e6547-7330-45e5-aa57-55e787eb9dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d87640c2f554cfe99044eea6b6d7184'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:41.864300 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8e6e6547-7330-45e5-aa57-55e787eb9dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d87640c2f554cfe99044eea6b6d7184'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:41.865103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8e6e6547-7330-45e5-aa57-55e787eb9dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d87640c2f554cfe99044eea6b6d7184'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:41.894995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1059/2119] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:41 2022] DELETE /identity/v3/users/1d87640c2f554cfe99044eea6b6d7184 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:42.486728 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aabea-6f07-42c3-9544-3ae5bb00dcb3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:42.489023 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-189aabea-6f07-42c3-9544-3ae5bb00dcb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:42.513634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aabea-6f07-42c3-9544-3ae5bb00dcb3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:42.625918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90985e-5a77-454b-8de0-40e5c84ffeed None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:42.625918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90985e-5a77-454b-8de0-40e5c84ffeed None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:42.626174 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90985e-5a77-454b-8de0-40e5c84ffeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:42.639490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3adc2-20b5-435a-9afb-6932734f3f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:42.640715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3adc2-20b5-435a-9afb-6932734f3f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:42.641431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3adc2-20b5-435a-9afb-6932734f3f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:42.641941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3adc2-20b5-435a-9afb-6932734f3f21 admin admin] PATH_INFO: `/v3/projects/559cd183044c49a89c7e38d8279a0b23` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:42.649834 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3adc2-20b5-435a-9afb-6932734f3f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=559cd183044c49a89c7e38d8279a0b23)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:42.652967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3adc2-20b5-435a-9afb-6932734f3f21 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:42.681850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ed90985e-5a77-454b-8de0-40e5c84ffeed None None] MFA Rules not processed for user `d7b9ce69a40845c5adef40e3e0355747`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:42.684081 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ed90985e-5a77-454b-8de0-40e5c84ffeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:42.778229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-98b3adc2-20b5-435a-9afb-6932734f3f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559cd183044c49a89c7e38d8279a0b23', 'request_id': 'req-98b3adc2-20b5-435a-9afb-6932734f3f21'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:42.790066 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-98b3adc2-20b5-435a-9afb-6932734f3f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559cd183044c49a89c7e38d8279a0b23', 'request_id': 'req-98b3adc2-20b5-435a-9afb-6932734f3f21'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:42.806883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-98b3adc2-20b5-435a-9afb-6932734f3f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559cd183044c49a89c7e38d8279a0b23', 'request_id': 'req-98b3adc2-20b5-435a-9afb-6932734f3f21'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:42.826497 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-98b3adc2-20b5-435a-9afb-6932734f3f21 admin admin] The token cache is being invalidate because project 559cd183044c49a89c7e38d8279a0b23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:42.826841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-98b3adc2-20b5-435a-9afb-6932734f3f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:42.828113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-98b3adc2-20b5-435a-9afb-6932734f3f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:42.832772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1061/2120] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:42 2022] DELETE /identity/v3/projects/559cd183044c49a89c7e38d8279a0b23 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:42.838724 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62310e11-3c80-4eed-9e46-165b20f57eb2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:42.840552 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62310e11-3c80-4eed-9e46-165b20f57eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:42.841293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62310e11-3c80-4eed-9e46-165b20f57eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:42.877343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1060/2121] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:11:42.886839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90985e-5a77-454b-8de0-40e5c84ffeed None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:42.891826 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ed90985e-5a77-454b-8de0-40e5c84ffeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:42.895310 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-62310e11-3c80-4eed-9e46-165b20f57eb2 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:42.898430 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-62310e11-3c80-4eed-9e46-165b20f57eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:43.030172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90985e-5a77-454b-8de0-40e5c84ffeed None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:43.032400 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1062/2122] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:43.041375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48c647-f811-4d63-bcae-481c5b5bfa5c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:43.041654 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48c647-f811-4d63-bcae-481c5b5bfa5c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:43.042084 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48c647-f811-4d63-bcae-481c5b5bfa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:43.076683 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0c48c647-f811-4d63-bcae-481c5b5bfa5c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:43.079204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0c48c647-f811-4d63-bcae-481c5b5bfa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:43.108798 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1063/2123] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:11:43.113865 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dba6af-66f6-4033-9458-f3e44ef7c368 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:43.114159 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dba6af-66f6-4033-9458-f3e44ef7c368 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:43.114438 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dba6af-66f6-4033-9458-f3e44ef7c368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:43.135394 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481f72d-8563-4723-a1ab-fda898d499fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:43.137039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481f72d-8563-4723-a1ab-fda898d499fa service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:43.137547 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481f72d-8563-4723-a1ab-fda898d499fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:43.138577 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481f72d-8563-4723-a1ab-fda898d499fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:43.161969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-39dba6af-66f6-4033-9458-f3e44ef7c368 None None] MFA Rules not processed for user `61daaf70d25c4e1592fcb2f4feafff86`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:43.165618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-39dba6af-66f6-4033-9458-f3e44ef7c368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:43.249244 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481f72d-8563-4723-a1ab-fda898d499fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:43.251859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481f72d-8563-4723-a1ab-fda898d499fa service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:43.258924 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1064/2124] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:43.260661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dba6af-66f6-4033-9458-f3e44ef7c368 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:43.269700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1061/2125] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:11:43.278884 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dba6af-66f6-4033-9458-f3e44ef7c368 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:43.289145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481f72d-8563-4723-a1ab-fda898d499fa service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:43.289896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ad3f3-b326-46c2-b26a-7e725addac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:43.290588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ad3f3-b326-46c2-b26a-7e725addac15 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:43.290689 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2481f72d-8563-4723-a1ab-fda898d499fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:43.290871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ad3f3-b326-46c2-b26a-7e725addac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:43.291149 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ad3f3-b326-46c2-b26a-7e725addac15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:43.291947 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ad3f3-b326-46c2-b26a-7e725addac15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:43.292260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ad3f3-b326-46c2-b26a-7e725addac15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:43.293882 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ad3f3-b326-46c2-b26a-7e725addac15 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:43.308985 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1065/2126] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:43.313758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ad3f3-b326-46c2-b26a-7e725addac15 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:43.332232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ad3f3-b326-46c2-b26a-7e725addac15 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:43.340462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b67d9-217d-429d-b679-5938e9cc2cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:43.341337 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b67d9-217d-429d-b679-5938e9cc2cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:43.341722 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b67d9-217d-429d-b679-5938e9cc2cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:43.342096 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b67d9-217d-429d-b679-5938e9cc2cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:43.343110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b67d9-217d-429d-b679-5938e9cc2cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:43.345499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b67d9-217d-429d-b679-5938e9cc2cb2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:43.387489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1066/2127] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:43 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:43.391321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b67d9-217d-429d-b679-5938e9cc2cb2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:43.411071 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481f72d-8563-4723-a1ab-fda898d499fa service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:43.505911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b67d9-217d-429d-b679-5938e9cc2cb2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:43.510858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6e188-bb5d-4891-a0d5-cde9bce02cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:43.511748 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6e188-bb5d-4891-a0d5-cde9bce02cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:43.512040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6e188-bb5d-4891-a0d5-cde9bce02cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:43.512316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6e188-bb5d-4891-a0d5-cde9bce02cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:43.513010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6e188-bb5d-4891-a0d5-cde9bce02cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:43.515114 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6e188-bb5d-4891-a0d5-cde9bce02cc8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:43.519793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bc185-066c-4ab4-9af4-d5a0efdec0ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:43.520393 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bc185-066c-4ab4-9af4-d5a0efdec0ed service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:43.520862 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bc185-066c-4ab4-9af4-d5a0efdec0ed service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:43.521273 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bc185-066c-4ab4-9af4-d5a0efdec0ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:43.555095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1067/2128] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:43 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:11:43.557582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6e188-bb5d-4891-a0d5-cde9bce02cc8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:43.586384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6e188-bb5d-4891-a0d5-cde9bce02cc8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:43.600284 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd33500-1f66-4b5b-a6ce-a27037b4b01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:43.603842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd33500-1f66-4b5b-a6ce-a27037b4b01d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:43.604142 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd33500-1f66-4b5b-a6ce-a27037b4b01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:43.604431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd33500-1f66-4b5b-a6ce-a27037b4b01d admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:43.605241 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd33500-1f66-4b5b-a6ce-a27037b4b01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:43.607254 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd33500-1f66-4b5b-a6ce-a27037b4b01d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:43.623133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1068/2129] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:43.628783 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd33500-1f66-4b5b-a6ce-a27037b4b01d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:43.640388 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bc185-066c-4ab4-9af4-d5a0efdec0ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:43.644759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bc185-066c-4ab4-9af4-d5a0efdec0ed service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:43.645365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd33500-1f66-4b5b-a6ce-a27037b4b01d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:43.659989 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618624c4-ccc8-4d35-be14-93c34bfc083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:43.660683 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618624c4-ccc8-4d35-be14-93c34bfc083f admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:43.662198 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1062/2130] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:11:43.663403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618624c4-ccc8-4d35-be14-93c34bfc083f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:43.663721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618624c4-ccc8-4d35-be14-93c34bfc083f admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:43.664528 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618624c4-ccc8-4d35-be14-93c34bfc083f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:43.666213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618624c4-ccc8-4d35-be14-93c34bfc083f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:43.680851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1069/2131] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:43.685026 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bc185-066c-4ab4-9af4-d5a0efdec0ed service nova] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:43.701497 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bc185-066c-4ab4-9af4-d5a0efdec0ed service nova] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:43.708330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951066f-9a42-4f4b-9690-66ed7c2093ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:43.709397 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951066f-9a42-4f4b-9690-66ed7c2093ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:43.709681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951066f-9a42-4f4b-9690-66ed7c2093ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:43.709961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951066f-9a42-4f4b-9690-66ed7c2093ca admin admin] PATH_INFO: `/v3/projects/c45d96c514344e00be8f38052b2bb7fc/users/f101ba280ebf4ab9a35db767b6b19c65/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:43.731302 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951066f-9a42-4f4b-9690-66ed7c2093ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45d96c514344e00be8f38052b2bb7fc, user_id=f101ba280ebf4ab9a35db767b6b19c65, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:43.734472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951066f-9a42-4f4b-9690-66ed7c2093ca admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:43.761789 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1063/2132] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:43 2022] PUT /identity/v3/projects/c45d96c514344e00be8f38052b2bb7fc/users/f101ba280ebf4ab9a35db767b6b19c65/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:43.773324 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11063c4d-389e-475e-805b-74e6767c38dc None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:43.773625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11063c4d-389e-475e-805b-74e6767c38dc None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:43.773965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11063c4d-389e-475e-805b-74e6767c38dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:43.809353 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-11063c4d-389e-475e-805b-74e6767c38dc None None] MFA Rules not processed for user `f101ba280ebf4ab9a35db767b6b19c65`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:43.810980 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-11063c4d-389e-475e-805b-74e6767c38dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:43.894660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1070/2133] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:43.899895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951066f-9a42-4f4b-9690-66ed7c2093ca admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:43.995594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951066f-9a42-4f4b-9690-66ed7c2093ca admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:44.000733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911ca77-1fdc-4a22-b53a-b1b7142d08dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:44.001487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911ca77-1fdc-4a22-b53a-b1b7142d08dd admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:44.001775 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911ca77-1fdc-4a22-b53a-b1b7142d08dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:44.002053 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911ca77-1fdc-4a22-b53a-b1b7142d08dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:44.002755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911ca77-1fdc-4a22-b53a-b1b7142d08dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:44.007725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911ca77-1fdc-4a22-b53a-b1b7142d08dd admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:44.040492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1064/2134] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:43 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:44.044603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11063c4d-389e-475e-805b-74e6767c38dc None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:44.058743 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11063c4d-389e-475e-805b-74e6767c38dc None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:44.136652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1b909-d6c1-44d6-aae5-1f72677b6a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:44.137352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1b909-d6c1-44d6-aae5-1f72677b6a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:44.137634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1b909-d6c1-44d6-aae5-1f72677b6a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:44.138088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1b909-d6c1-44d6-aae5-1f72677b6a8b admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:44.138897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1b909-d6c1-44d6-aae5-1f72677b6a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:44.140983 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1b909-d6c1-44d6-aae5-1f72677b6a8b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:44.165914 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1071/2135] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:44 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:11:44.170077 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911ca77-1fdc-4a22-b53a-b1b7142d08dd admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:44.182481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911ca77-1fdc-4a22-b53a-b1b7142d08dd admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:44.187680 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561bc7e-1946-4afd-a5a3-04f7bf53a11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:44.188520 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561bc7e-1946-4afd-a5a3-04f7bf53a11b admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:44.188808 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561bc7e-1946-4afd-a5a3-04f7bf53a11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:44.189082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561bc7e-1946-4afd-a5a3-04f7bf53a11b admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:44.189821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561bc7e-1946-4afd-a5a3-04f7bf53a11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:44.191444 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561bc7e-1946-4afd-a5a3-04f7bf53a11b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:44.203196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1065/2136] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:44.207406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1b909-d6c1-44d6-aae5-1f72677b6a8b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:44.218793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1b909-d6c1-44d6-aae5-1f72677b6a8b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:44.223894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fac65-adfc-4ad0-9d0c-c70f4e3efc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:44.225439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fac65-adfc-4ad0-9d0c-c70f4e3efc2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:44.225822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fac65-adfc-4ad0-9d0c-c70f4e3efc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:44.226204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fac65-adfc-4ad0-9d0c-c70f4e3efc2d admin admin] PATH_INFO: `/v3/projects/e15563dc0df84b7e8bd4506d0eb41352/users/6a45b90ce72746aeab3d38e80c11e513/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:44.244341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943fac65-adfc-4ad0-9d0c-c70f4e3efc2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15563dc0df84b7e8bd4506d0eb41352, user_id=6a45b90ce72746aeab3d38e80c11e513, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:44.247143 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943fac65-adfc-4ad0-9d0c-c70f4e3efc2d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:44.264407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1072/2137] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:44 2022] PUT /identity/v3/projects/e15563dc0df84b7e8bd4506d0eb41352/users/6a45b90ce72746aeab3d38e80c11e513/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:44.265622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561bc7e-1946-4afd-a5a3-04f7bf53a11b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:44.276764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561bc7e-1946-4afd-a5a3-04f7bf53a11b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:44.366121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7b2f7-d2c0-43c8-aae0-06ea155fb3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:44.366877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7b2f7-d2c0-43c8-aae0-06ea155fb3aa admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:44.367191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7b2f7-d2c0-43c8-aae0-06ea155fb3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:44.367471 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7b2f7-d2c0-43c8-aae0-06ea155fb3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:44.368301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7b2f7-d2c0-43c8-aae0-06ea155fb3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:44.370079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7b2f7-d2c0-43c8-aae0-06ea155fb3aa admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:44.382866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1066/2138] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:44.387865 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fac65-adfc-4ad0-9d0c-c70f4e3efc2d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:44.402542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fac65-adfc-4ad0-9d0c-c70f4e3efc2d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:44.417078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9506bc1-909e-4304-8374-06a8fa8ed6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:44.418323 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9506bc1-909e-4304-8374-06a8fa8ed6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:44.419571 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9506bc1-909e-4304-8374-06a8fa8ed6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:44.419571 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9506bc1-909e-4304-8374-06a8fa8ed6ed admin admin] PATH_INFO: `/v3/projects/e15563dc0df84b7e8bd4506d0eb41352/users/6a45b90ce72746aeab3d38e80c11e513/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:44.426978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9506bc1-909e-4304-8374-06a8fa8ed6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15563dc0df84b7e8bd4506d0eb41352, user_id=6a45b90ce72746aeab3d38e80c11e513, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:44.441181 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9506bc1-909e-4304-8374-06a8fa8ed6ed admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:44.464334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1073/2139] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:44 2022] PUT /identity/v3/projects/e15563dc0df84b7e8bd4506d0eb41352/users/6a45b90ce72746aeab3d38e80c11e513/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:44.480928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6caef-e99f-47f2-8923-1c454bad54fa None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:44.481357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6caef-e99f-47f2-8923-1c454bad54fa None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:44.481771 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6caef-e99f-47f2-8923-1c454bad54fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:44.533488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-72d6caef-e99f-47f2-8923-1c454bad54fa None None] MFA Rules not processed for user `6a45b90ce72746aeab3d38e80c11e513`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:44.534908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-72d6caef-e99f-47f2-8923-1c454bad54fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:44.829304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1067/2140] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:44.849086 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9506bc1-909e-4304-8374-06a8fa8ed6ed admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:44.925130 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8945e-c55a-47f4-8c11-3bc5a61d85eb None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:44.926176 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8945e-c55a-47f4-8c11-3bc5a61d85eb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:44.928581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8945e-c55a-47f4-8c11-3bc5a61d85eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:45.009105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9506bc1-909e-4304-8374-06a8fa8ed6ed admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:45.024876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-97a8945e-c55a-47f4-8c11-3bc5a61d85eb None None] MFA Rules not processed for user `d7b9ce69a40845c5adef40e3e0355747`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:45.025893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fa0ff-9e4b-484e-b1cd-bac1b274eb3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:45.028461 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fa0ff-9e4b-484e-b1cd-bac1b274eb3a service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:45.029106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fa0ff-9e4b-484e-b1cd-bac1b274eb3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:45.030338 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fa0ff-9e4b-484e-b1cd-bac1b274eb3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:45.031320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-97a8945e-c55a-47f4-8c11-3bc5a61d85eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:45.055903 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fa0ff-9e4b-484e-b1cd-bac1b274eb3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:45.057374 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fa0ff-9e4b-484e-b1cd-bac1b274eb3a service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:45.073954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1074/2141] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:45.284377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1068/2142] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:45.320052 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fa0ff-9e4b-484e-b1cd-bac1b274eb3a service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:45.336931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fa0ff-9e4b-484e-b1cd-bac1b274eb3a service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:45.342625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c317ee3-d5c0-4448-807e-8e9e0092785d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:45.343944 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c317ee3-d5c0-4448-807e-8e9e0092785d service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:45.344633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c317ee3-d5c0-4448-807e-8e9e0092785d service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:45.345105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c317ee3-d5c0-4448-807e-8e9e0092785d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:45.456520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c317ee3-d5c0-4448-807e-8e9e0092785d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:45.457986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c317ee3-d5c0-4448-807e-8e9e0092785d service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:45.474205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1075/2143] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:46.359014 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af670f-530f-421a-aa8e-4dd28052ef57 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:46.359728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af670f-530f-421a-aa8e-4dd28052ef57 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:46.360740 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af670f-530f-421a-aa8e-4dd28052ef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:46.382717 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c4fe5-d972-4338-a7a1-78c15a0ae3e0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:46.383332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c4fe5-d972-4338-a7a1-78c15a0ae3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:46.383656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c4fe5-d972-4338-a7a1-78c15a0ae3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:46.395960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a5af670f-530f-421a-aa8e-4dd28052ef57 None None] MFA Rules not processed for user `c3feefbd066d49148171c392838b4e15`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:46.397377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a5af670f-530f-421a-aa8e-4dd28052ef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:46.458878 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4c3c4fe5-d972-4338-a7a1-78c15a0ae3e0 None None] MFA Rules not processed for user `61daaf70d25c4e1592fcb2f4feafff86`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:46.464589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4c3c4fe5-d972-4338-a7a1-78c15a0ae3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:46.532340 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1069/2144] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:46.538457 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1076/2145] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:11:48.432239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af670f-530f-421a-aa8e-4dd28052ef57 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:48.768266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af670f-530f-421a-aa8e-4dd28052ef57 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:48.779243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efbade-1e6d-4b77-82a0-b3650139c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:48.781091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efbade-1e6d-4b77-82a0-b3650139c3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:48.781980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efbade-1e6d-4b77-82a0-b3650139c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:48.782966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efbade-1e6d-4b77-82a0-b3650139c3d7 admin admin] PATH_INFO: `/v3/users/f101ba280ebf4ab9a35db767b6b19c65` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:48.785144 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efbade-1e6d-4b77-82a0-b3650139c3d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f101ba280ebf4ab9a35db767b6b19c65)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:48.790911 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efbade-1e6d-4b77-82a0-b3650139c3d7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:48.921810 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-19efbade-1e6d-4b77-82a0-b3650139c3d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f101ba280ebf4ab9a35db767b6b19c65'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:48.924673 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-19efbade-1e6d-4b77-82a0-b3650139c3d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f101ba280ebf4ab9a35db767b6b19c65'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:48.951866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-19efbade-1e6d-4b77-82a0-b3650139c3d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f101ba280ebf4ab9a35db767b6b19c65'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:48.988237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-19efbade-1e6d-4b77-82a0-b3650139c3d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f101ba280ebf4ab9a35db767b6b19c65'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:48.999079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-19efbade-1e6d-4b77-82a0-b3650139c3d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f101ba280ebf4ab9a35db767b6b19c65'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:49.070909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1070/2146] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:48 2022] DELETE /identity/v3/users/f101ba280ebf4ab9a35db767b6b19c65 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:49.077380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10470c-1425-4adf-b1e7-aaafd0f34932 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:49.078724 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10470c-1425-4adf-b1e7-aaafd0f34932 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:49.079391 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10470c-1425-4adf-b1e7-aaafd0f34932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:49.137968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ac10470c-1425-4adf-b1e7-aaafd0f34932 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:49.142422 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ac10470c-1425-4adf-b1e7-aaafd0f34932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:49.266080 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1077/2147] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:49.274788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efbade-1e6d-4b77-82a0-b3650139c3d7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:49.277332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-19efbade-1e6d-4b77-82a0-b3650139c3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:49.375005 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efbade-1e6d-4b77-82a0-b3650139c3d7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:49.384903 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7714ac5-1480-4138-8304-c69d87b98e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:49.387549 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7714ac5-1480-4138-8304-c69d87b98e02 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:49.387887 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7714ac5-1480-4138-8304-c69d87b98e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:49.388170 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7714ac5-1480-4138-8304-c69d87b98e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:49.409414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7714ac5-1480-4138-8304-c69d87b98e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:49.410967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7714ac5-1480-4138-8304-c69d87b98e02 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:49.424276 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1071/2148] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:49.916817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10470c-1425-4adf-b1e7-aaafd0f34932 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:49.918297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ac10470c-1425-4adf-b1e7-aaafd0f34932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:49.930536 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10470c-1425-4adf-b1e7-aaafd0f34932 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:49.935765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:49.936659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:49.936939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:49.937212 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae admin admin] PATH_INFO: `/v3/projects/c45d96c514344e00be8f38052b2bb7fc` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:49.938443 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45d96c514344e00be8f38052b2bb7fc)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:49.940525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:49.987349 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45d96c514344e00be8f38052b2bb7fc', 'request_id': 'req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:49.993342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45d96c514344e00be8f38052b2bb7fc', 'request_id': 'req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:50.000371 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45d96c514344e00be8f38052b2bb7fc', 'request_id': 'req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:50.012334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae admin admin] The token cache is being invalidate because project c45d96c514344e00be8f38052b2bb7fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:50.012785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:50.013800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:50.015473 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1078/2149] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:49 2022] DELETE /identity/v3/projects/c45d96c514344e00be8f38052b2bb7fc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:50.019953 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7714ac5-1480-4138-8304-c69d87b98e02 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:50.029277 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7714ac5-1480-4138-8304-c69d87b98e02 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:50.100274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db62221-4d47-42d7-b0c2-cc380697d767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:50.101269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db62221-4d47-42d7-b0c2-cc380697d767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:50.101642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db62221-4d47-42d7-b0c2-cc380697d767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:50.102011 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db62221-4d47-42d7-b0c2-cc380697d767 admin admin] PATH_INFO: `/v3/users/6a45b90ce72746aeab3d38e80c11e513` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:50.103311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db62221-4d47-42d7-b0c2-cc380697d767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a45b90ce72746aeab3d38e80c11e513)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:50.105284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db62221-4d47-42d7-b0c2-cc380697d767 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:50.150539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3db62221-4d47-42d7-b0c2-cc380697d767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a45b90ce72746aeab3d38e80c11e513'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:50.151176 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3db62221-4d47-42d7-b0c2-cc380697d767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a45b90ce72746aeab3d38e80c11e513'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:50.163424 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3db62221-4d47-42d7-b0c2-cc380697d767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a45b90ce72746aeab3d38e80c11e513'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:50.170082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3db62221-4d47-42d7-b0c2-cc380697d767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a45b90ce72746aeab3d38e80c11e513'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:50.170731 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3db62221-4d47-42d7-b0c2-cc380697d767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a45b90ce72746aeab3d38e80c11e513'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:50.184556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1072/2150] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:50 2022] DELETE /identity/v3/users/6a45b90ce72746aeab3d38e80c11e513 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:50.494614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:50.496172 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:50.512818 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e301f-1d30-44dc-ac5d-c44deb60b8ae admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:50.571672 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8f525-7612-4c75-968e-3fe409c42c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:50.573323 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8f525-7612-4c75-968e-3fe409c42c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:50.573609 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8f525-7612-4c75-968e-3fe409c42c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:50.573890 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8f525-7612-4c75-968e-3fe409c42c32 admin admin] PATH_INFO: `/v3/projects/e15563dc0df84b7e8bd4506d0eb41352` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:50.575252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8f525-7612-4c75-968e-3fe409c42c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15563dc0df84b7e8bd4506d0eb41352)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:50.577195 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8f525-7612-4c75-968e-3fe409c42c32 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:50.658317 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47c8f525-7612-4c75-968e-3fe409c42c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15563dc0df84b7e8bd4506d0eb41352', 'request_id': 'req-47c8f525-7612-4c75-968e-3fe409c42c32'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:50.665939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47c8f525-7612-4c75-968e-3fe409c42c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15563dc0df84b7e8bd4506d0eb41352', 'request_id': 'req-47c8f525-7612-4c75-968e-3fe409c42c32'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:50.676313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47c8f525-7612-4c75-968e-3fe409c42c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15563dc0df84b7e8bd4506d0eb41352', 'request_id': 'req-47c8f525-7612-4c75-968e-3fe409c42c32'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:50.700159 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47c8f525-7612-4c75-968e-3fe409c42c32 admin admin] The token cache is being invalidate because project e15563dc0df84b7e8bd4506d0eb41352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:50.700565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47c8f525-7612-4c75-968e-3fe409c42c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:50.701571 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-47c8f525-7612-4c75-968e-3fe409c42c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:50.707658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1079/2151] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:50 2022] DELETE /identity/v3/projects/e15563dc0df84b7e8bd4506d0eb41352 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:50.710797 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f289a70-ded5-4260-9f8f-cd56858e7a10 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:50.711195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f289a70-ded5-4260-9f8f-cd56858e7a10 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:50.711685 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f289a70-ded5-4260-9f8f-cd56858e7a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:50.734233 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5f289a70-ded5-4260-9f8f-cd56858e7a10 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:50.735317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5f289a70-ded5-4260-9f8f-cd56858e7a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:50.820456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1073/2152] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:50.828272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3c354-1430-4444-82bf-30beb1049764 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:50.829163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3c354-1430-4444-82bf-30beb1049764 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:50.829551 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3c354-1430-4444-82bf-30beb1049764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:50.862206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d2f3c354-1430-4444-82bf-30beb1049764 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:50.863504 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d2f3c354-1430-4444-82bf-30beb1049764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:50.874092 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1080/2153] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:11:50.878361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f289a70-ded5-4260-9f8f-cd56858e7a10 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:50.888426 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f289a70-ded5-4260-9f8f-cd56858e7a10 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:50.898412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544afb88-aa44-458b-881c-038e8b7096bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:50.899085 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544afb88-aa44-458b-881c-038e8b7096bc admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:50.899365 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544afb88-aa44-458b-881c-038e8b7096bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:50.900427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544afb88-aa44-458b-881c-038e8b7096bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:50.901545 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544afb88-aa44-458b-881c-038e8b7096bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:50.903698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544afb88-aa44-458b-881c-038e8b7096bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:50.904989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544afb88-aa44-458b-881c-038e8b7096bc admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:50.922062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1074/2154] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:50.923457 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3c354-1430-4444-82bf-30beb1049764 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:50.934840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3c354-1430-4444-82bf-30beb1049764 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:50.939953 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0684f-8c83-4f42-9c2a-846f9d122bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:50.940688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0684f-8c83-4f42-9c2a-846f9d122bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:50.941043 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0684f-8c83-4f42-9c2a-846f9d122bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:50.941984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0684f-8c83-4f42-9c2a-846f9d122bd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:50.944329 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0684f-8c83-4f42-9c2a-846f9d122bd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:50.946323 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0684f-8c83-4f42-9c2a-846f9d122bd3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:50.979676 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1081/2155] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:50 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:50.981263 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544afb88-aa44-458b-881c-038e8b7096bc admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:50.992059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544afb88-aa44-458b-881c-038e8b7096bc admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:51.051328 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8c53a-3fe7-4361-9a6b-14395d97294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:51.052913 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8c53a-3fe7-4361-9a6b-14395d97294e admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:51.052913 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8c53a-3fe7-4361-9a6b-14395d97294e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:51.053100 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8c53a-3fe7-4361-9a6b-14395d97294e admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:51.053788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8c53a-3fe7-4361-9a6b-14395d97294e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:51.055802 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8c53a-3fe7-4361-9a6b-14395d97294e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:51.075070 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1075/2156] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:50 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:51.079077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0684f-8c83-4f42-9c2a-846f9d122bd3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:51.090316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0684f-8c83-4f42-9c2a-846f9d122bd3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:51.095062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546c13b-92ef-4eb1-9db7-a715dbe5ce7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:51.095771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546c13b-92ef-4eb1-9db7-a715dbe5ce7d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:51.096053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546c13b-92ef-4eb1-9db7-a715dbe5ce7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:51.096327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546c13b-92ef-4eb1-9db7-a715dbe5ce7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:51.097061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546c13b-92ef-4eb1-9db7-a715dbe5ce7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:51.099371 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546c13b-92ef-4eb1-9db7-a715dbe5ce7d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:51.110427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1082/2157] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:51.114390 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8c53a-3fe7-4361-9a6b-14395d97294e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:51.124881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8c53a-3fe7-4361-9a6b-14395d97294e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:51.134304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e9477-821a-4116-8a01-c0fb2b8a2734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:51.137524 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e9477-821a-4116-8a01-c0fb2b8a2734 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:51.137920 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e9477-821a-4116-8a01-c0fb2b8a2734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:51.138379 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e9477-821a-4116-8a01-c0fb2b8a2734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:51.139558 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e9477-821a-4116-8a01-c0fb2b8a2734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:51.142123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e9477-821a-4116-8a01-c0fb2b8a2734 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:51.166261 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546c13b-92ef-4eb1-9db7-a715dbe5ce7d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:51.172010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1076/2158] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:51.177940 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546c13b-92ef-4eb1-9db7-a715dbe5ce7d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:51.183269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae06778-9749-4b0c-9008-042a19474506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:51.184432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae06778-9749-4b0c-9008-042a19474506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:51.184884 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae06778-9749-4b0c-9008-042a19474506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:51.185644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae06778-9749-4b0c-9008-042a19474506 admin admin] PATH_INFO: `/v3/projects/611e0d5b79e0441599b60bd7b1fd972a/users/6f7b59375f424fa699b50a159a5eb38e/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:51.213832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae06778-9749-4b0c-9008-042a19474506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=611e0d5b79e0441599b60bd7b1fd972a, user_id=6f7b59375f424fa699b50a159a5eb38e, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:51.216638 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae06778-9749-4b0c-9008-042a19474506 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:51.232462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1083/2159] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:51 2022] PUT /identity/v3/projects/611e0d5b79e0441599b60bd7b1fd972a/users/6f7b59375f424fa699b50a159a5eb38e/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:51.243039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc30f-7c4a-44b2-b79a-27dc45471ec8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:51.243671 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc30f-7c4a-44b2-b79a-27dc45471ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:51.243671 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc30f-7c4a-44b2-b79a-27dc45471ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:51.277282 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-625dc30f-7c4a-44b2-b79a-27dc45471ec8 None None] MFA Rules not processed for user `6f7b59375f424fa699b50a159a5eb38e`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:51.278575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-625dc30f-7c4a-44b2-b79a-27dc45471ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:51.348964 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1077/2160] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:51.353432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae06778-9749-4b0c-9008-042a19474506 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:51.418097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae06778-9749-4b0c-9008-042a19474506 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:51.423075 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19e1dc-62ad-4c57-b2c0-4477835dc0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:51.423832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19e1dc-62ad-4c57-b2c0-4477835dc0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:51.424191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19e1dc-62ad-4c57-b2c0-4477835dc0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:51.424542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19e1dc-62ad-4c57-b2c0-4477835dc0f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:51.425245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19e1dc-62ad-4c57-b2c0-4477835dc0f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:51.427593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19e1dc-62ad-4c57-b2c0-4477835dc0f5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:51.466243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1084/2161] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:51 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:51.467508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc30f-7c4a-44b2-b79a-27dc45471ec8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:51.479256 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc30f-7c4a-44b2-b79a-27dc45471ec8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:51.535352 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890bf2e-00be-4c2c-90cf-91c7e4bf7d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:51.536209 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890bf2e-00be-4c2c-90cf-91c7e4bf7d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:51.536508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890bf2e-00be-4c2c-90cf-91c7e4bf7d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:51.536825 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890bf2e-00be-4c2c-90cf-91c7e4bf7d96 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:51.537713 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890bf2e-00be-4c2c-90cf-91c7e4bf7d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:51.539642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890bf2e-00be-4c2c-90cf-91c7e4bf7d96 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:51.562614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1078/2162] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:51 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:51.564068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19e1dc-62ad-4c57-b2c0-4477835dc0f5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:51.574642 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19e1dc-62ad-4c57-b2c0-4477835dc0f5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:51.579346 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c06d7-c410-48bf-8075-607895fae8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:51.580134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c06d7-c410-48bf-8075-607895fae8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:51.580486 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c06d7-c410-48bf-8075-607895fae8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:51.580828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c06d7-c410-48bf-8075-607895fae8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:51.581629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c06d7-c410-48bf-8075-607895fae8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:51.583735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c06d7-c410-48bf-8075-607895fae8a6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:51.594419 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1085/2163] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:51.598571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890bf2e-00be-4c2c-90cf-91c7e4bf7d96 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:51.608380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890bf2e-00be-4c2c-90cf-91c7e4bf7d96 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:51.615547 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b549e-856d-47d8-a98e-32890f92b24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:51.616461 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b549e-856d-47d8-a98e-32890f92b24a admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:51.616741 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b549e-856d-47d8-a98e-32890f92b24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:51.617012 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b549e-856d-47d8-a98e-32890f92b24a admin admin] PATH_INFO: `/v3/projects/80ce5df8fb7b4332832f43bde9b84f12/users/196a9be380ba4e2e88ad36d26d929892/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:51.633274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b549e-856d-47d8-a98e-32890f92b24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ce5df8fb7b4332832f43bde9b84f12, user_id=196a9be380ba4e2e88ad36d26d929892, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:51.636421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b549e-856d-47d8-a98e-32890f92b24a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:51.652718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1079/2164] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:51 2022] PUT /identity/v3/projects/80ce5df8fb7b4332832f43bde9b84f12/users/196a9be380ba4e2e88ad36d26d929892/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:51.657243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c06d7-c410-48bf-8075-607895fae8a6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:51.669518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c06d7-c410-48bf-8075-607895fae8a6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:51.735419 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0676f0-54a7-45ed-9b8b-01270606abc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:51.736149 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0676f0-54a7-45ed-9b8b-01270606abc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:51.736432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0676f0-54a7-45ed-9b8b-01270606abc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:51.736702 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0676f0-54a7-45ed-9b8b-01270606abc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:51.737451 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0676f0-54a7-45ed-9b8b-01270606abc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:51.739089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0676f0-54a7-45ed-9b8b-01270606abc0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:51.754303 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1086/2165] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:51.756313 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b549e-856d-47d8-a98e-32890f92b24a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:51.770774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b549e-856d-47d8-a98e-32890f92b24a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:51.777505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd30be-ea3e-4a66-8094-5de69bacff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:51.778446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd30be-ea3e-4a66-8094-5de69bacff09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:51.778750 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd30be-ea3e-4a66-8094-5de69bacff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:51.779008 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd30be-ea3e-4a66-8094-5de69bacff09 admin admin] PATH_INFO: `/v3/projects/80ce5df8fb7b4332832f43bde9b84f12/users/196a9be380ba4e2e88ad36d26d929892/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:51.781355 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd30be-ea3e-4a66-8094-5de69bacff09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ce5df8fb7b4332832f43bde9b84f12, user_id=196a9be380ba4e2e88ad36d26d929892, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:51.784047 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd30be-ea3e-4a66-8094-5de69bacff09 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:51.795564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1080/2166] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:51 2022] PUT /identity/v3/projects/80ce5df8fb7b4332832f43bde9b84f12/users/196a9be380ba4e2e88ad36d26d929892/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:51.806660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dab2a-db40-44f3-802a-69cd4395c803 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:51.806951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dab2a-db40-44f3-802a-69cd4395c803 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:51.807226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dab2a-db40-44f3-802a-69cd4395c803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:51.836608 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-431dab2a-db40-44f3-802a-69cd4395c803 None None] MFA Rules not processed for user `196a9be380ba4e2e88ad36d26d929892`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:51.837929 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-431dab2a-db40-44f3-802a-69cd4395c803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:51.946283 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1087/2167] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:51.960915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd30be-ea3e-4a66-8094-5de69bacff09 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:51.962722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3acd30be-ea3e-4a66-8094-5de69bacff09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:52.029929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd30be-ea3e-4a66-8094-5de69bacff09 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:52.033563 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93665765-732b-4e9a-bbb8-2e7f67c00ee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:52.034235 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93665765-732b-4e9a-bbb8-2e7f67c00ee5 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:52.034522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93665765-732b-4e9a-bbb8-2e7f67c00ee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:52.034800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93665765-732b-4e9a-bbb8-2e7f67c00ee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:52.044945 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93665765-732b-4e9a-bbb8-2e7f67c00ee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:52.046350 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93665765-732b-4e9a-bbb8-2e7f67c00ee5 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:52.056361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1081/2168] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:52.674085 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dab2a-db40-44f3-802a-69cd4395c803 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:52.744404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dab2a-db40-44f3-802a-69cd4395c803 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:52.749035 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4dc12a-924b-49e4-ad6d-5ab27b4166a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:52.749988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dc12a-924b-49e4-ad6d-5ab27b4166a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:52.750337 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dc12a-924b-49e4-ad6d-5ab27b4166a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:52.750677 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dc12a-924b-49e4-ad6d-5ab27b4166a4 admin admin] PATH_INFO: `/v3/users/6f7b59375f424fa699b50a159a5eb38e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:52.751984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4dc12a-924b-49e4-ad6d-5ab27b4166a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7b59375f424fa699b50a159a5eb38e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:52.753975 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4dc12a-924b-49e4-ad6d-5ab27b4166a4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:52.804328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-af4dc12a-924b-49e4-ad6d-5ab27b4166a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7b59375f424fa699b50a159a5eb38e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:52.818308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-af4dc12a-924b-49e4-ad6d-5ab27b4166a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7b59375f424fa699b50a159a5eb38e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:52.825897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-af4dc12a-924b-49e4-ad6d-5ab27b4166a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7b59375f424fa699b50a159a5eb38e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:52.826864 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-af4dc12a-924b-49e4-ad6d-5ab27b4166a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7b59375f424fa699b50a159a5eb38e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:52.827471 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-af4dc12a-924b-49e4-ad6d-5ab27b4166a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7b59375f424fa699b50a159a5eb38e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:52.841661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1088/2169] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:52 2022] DELETE /identity/v3/users/6f7b59375f424fa699b50a159a5eb38e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:52.845989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a73b0b-574d-4777-a60e-1437f829b462 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:52.846614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a73b0b-574d-4777-a60e-1437f829b462 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:52.846919 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a73b0b-574d-4777-a60e-1437f829b462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:52.865950 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-55a73b0b-574d-4777-a60e-1437f829b462 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:52.867441 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-55a73b0b-574d-4777-a60e-1437f829b462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:52.929805 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1082/2170] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:52.940139 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4dc12a-924b-49e4-ad6d-5ab27b4166a4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:52.941946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-af4dc12a-924b-49e4-ad6d-5ab27b4166a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:53.012399 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4dc12a-924b-49e4-ad6d-5ab27b4166a4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:53.019565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da14fd4-f65e-4d42-9d2f-0ae4bf0eaa03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:53.021577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da14fd4-f65e-4d42-9d2f-0ae4bf0eaa03 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:53.022097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da14fd4-f65e-4d42-9d2f-0ae4bf0eaa03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:53.022539 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da14fd4-f65e-4d42-9d2f-0ae4bf0eaa03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:53.033553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da14fd4-f65e-4d42-9d2f-0ae4bf0eaa03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:53.035328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da14fd4-f65e-4d42-9d2f-0ae4bf0eaa03 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:53.047495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1089/2171] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:53.842969 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a73b0b-574d-4777-a60e-1437f829b462 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:53.844545 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-55a73b0b-574d-4777-a60e-1437f829b462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:53.859420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a73b0b-574d-4777-a60e-1437f829b462 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:53.867196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004429f7-d6ac-4cce-97dc-0fc12321ca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:53.868183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004429f7-d6ac-4cce-97dc-0fc12321ca78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:53.868650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004429f7-d6ac-4cce-97dc-0fc12321ca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:53.869092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004429f7-d6ac-4cce-97dc-0fc12321ca78 admin admin] PATH_INFO: `/v3/projects/611e0d5b79e0441599b60bd7b1fd972a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:53.871186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004429f7-d6ac-4cce-97dc-0fc12321ca78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=611e0d5b79e0441599b60bd7b1fd972a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:53.873417 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004429f7-d6ac-4cce-97dc-0fc12321ca78 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:53.926820 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-004429f7-d6ac-4cce-97dc-0fc12321ca78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '611e0d5b79e0441599b60bd7b1fd972a', 'request_id': 'req-004429f7-d6ac-4cce-97dc-0fc12321ca78'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:53.932815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-004429f7-d6ac-4cce-97dc-0fc12321ca78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '611e0d5b79e0441599b60bd7b1fd972a', 'request_id': 'req-004429f7-d6ac-4cce-97dc-0fc12321ca78'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:53.940923 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-004429f7-d6ac-4cce-97dc-0fc12321ca78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '611e0d5b79e0441599b60bd7b1fd972a', 'request_id': 'req-004429f7-d6ac-4cce-97dc-0fc12321ca78'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:53.955462 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-004429f7-d6ac-4cce-97dc-0fc12321ca78 admin admin] The token cache is being invalidate because project 611e0d5b79e0441599b60bd7b1fd972a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:53.955797 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-004429f7-d6ac-4cce-97dc-0fc12321ca78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:53.956782 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-004429f7-d6ac-4cce-97dc-0fc12321ca78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:53.959043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1083/2172] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:53 2022] DELETE /identity/v3/projects/611e0d5b79e0441599b60bd7b1fd972a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:53.963565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da14fd4-f65e-4d42-9d2f-0ae4bf0eaa03 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:53.975217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da14fd4-f65e-4d42-9d2f-0ae4bf0eaa03 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:54.040821 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcf53c-094e-4740-9573-263f984a1470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:54.041070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcf53c-094e-4740-9573-263f984a1470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:54.041583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcf53c-094e-4740-9573-263f984a1470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:54.041864 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcf53c-094e-4740-9573-263f984a1470 admin admin] PATH_INFO: `/v3/users/196a9be380ba4e2e88ad36d26d929892` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:54.043087 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcf53c-094e-4740-9573-263f984a1470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=196a9be380ba4e2e88ad36d26d929892)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:54.045178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcf53c-094e-4740-9573-263f984a1470 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:54.109883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b0fcf53c-094e-4740-9573-263f984a1470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196a9be380ba4e2e88ad36d26d929892'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:54.122574 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b0fcf53c-094e-4740-9573-263f984a1470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196a9be380ba4e2e88ad36d26d929892'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:54.130022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b0fcf53c-094e-4740-9573-263f984a1470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196a9be380ba4e2e88ad36d26d929892'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:54.130939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b0fcf53c-094e-4740-9573-263f984a1470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196a9be380ba4e2e88ad36d26d929892'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:54.131539 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b0fcf53c-094e-4740-9573-263f984a1470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196a9be380ba4e2e88ad36d26d929892'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:54.144643 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1090/2173] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:53 2022] DELETE /identity/v3/users/196a9be380ba4e2e88ad36d26d929892 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:54.457184 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004429f7-d6ac-4cce-97dc-0fc12321ca78 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:54.459939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-004429f7-d6ac-4cce-97dc-0fc12321ca78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:54.484414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004429f7-d6ac-4cce-97dc-0fc12321ca78 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:54.548759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fb7fe-cf9c-497e-b7b7-19937f0e51af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:54.549628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fb7fe-cf9c-497e-b7b7-19937f0e51af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:54.550210 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fb7fe-cf9c-497e-b7b7-19937f0e51af admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:54.550210 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fb7fe-cf9c-497e-b7b7-19937f0e51af admin admin] PATH_INFO: `/v3/projects/80ce5df8fb7b4332832f43bde9b84f12` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:54.551899 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fb7fe-cf9c-497e-b7b7-19937f0e51af admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ce5df8fb7b4332832f43bde9b84f12)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:54.553919 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fb7fe-cf9c-497e-b7b7-19937f0e51af admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:54.603121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-485fb7fe-cf9c-497e-b7b7-19937f0e51af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ce5df8fb7b4332832f43bde9b84f12', 'request_id': 'req-485fb7fe-cf9c-497e-b7b7-19937f0e51af'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:54.608505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-485fb7fe-cf9c-497e-b7b7-19937f0e51af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ce5df8fb7b4332832f43bde9b84f12', 'request_id': 'req-485fb7fe-cf9c-497e-b7b7-19937f0e51af'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:54.616138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-485fb7fe-cf9c-497e-b7b7-19937f0e51af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ce5df8fb7b4332832f43bde9b84f12', 'request_id': 'req-485fb7fe-cf9c-497e-b7b7-19937f0e51af'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:54.627560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-485fb7fe-cf9c-497e-b7b7-19937f0e51af admin admin] The token cache is being invalidate because project 80ce5df8fb7b4332832f43bde9b84f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:54.627836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-485fb7fe-cf9c-497e-b7b7-19937f0e51af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:54.628509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-485fb7fe-cf9c-497e-b7b7-19937f0e51af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:54.630594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1084/2174] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:54 2022] DELETE /identity/v3/projects/80ce5df8fb7b4332832f43bde9b84f12 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:54.635489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71896a92-e13e-4f2c-8e9a-c9d269ce0510 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:54.635812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71896a92-e13e-4f2c-8e9a-c9d269ce0510 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:54.636092 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71896a92-e13e-4f2c-8e9a-c9d269ce0510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:54.654969 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-71896a92-e13e-4f2c-8e9a-c9d269ce0510 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:54.656167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-71896a92-e13e-4f2c-8e9a-c9d269ce0510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:54.718415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1091/2175] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:54.727072 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88eaaa-2225-4a7b-a39c-0236ceda2396 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:54.727389 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88eaaa-2225-4a7b-a39c-0236ceda2396 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:54.727704 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88eaaa-2225-4a7b-a39c-0236ceda2396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:54.746032 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-5b88eaaa-2225-4a7b-a39c-0236ceda2396 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:54.747154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5b88eaaa-2225-4a7b-a39c-0236ceda2396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:54.755136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1085/2176] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:54.759357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71896a92-e13e-4f2c-8e9a-c9d269ce0510 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:54.769056 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71896a92-e13e-4f2c-8e9a-c9d269ce0510 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:54.774868 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf53c51-e059-4341-bb71-9daa1bc4b590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:54.775723 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf53c51-e059-4341-bb71-9daa1bc4b590 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:54.776007 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf53c51-e059-4341-bb71-9daa1bc4b590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:54.776282 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf53c51-e059-4341-bb71-9daa1bc4b590 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:54.777009 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf53c51-e059-4341-bb71-9daa1bc4b590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:54.777328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf53c51-e059-4341-bb71-9daa1bc4b590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:54.778950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf53c51-e059-4341-bb71-9daa1bc4b590 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:54.794876 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1092/2177] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:54.796338 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88eaaa-2225-4a7b-a39c-0236ceda2396 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:54.805897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88eaaa-2225-4a7b-a39c-0236ceda2396 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:54.811307 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9d447-5810-48ce-94ea-7ac3dd12b1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:54.811986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9d447-5810-48ce-94ea-7ac3dd12b1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:54.812269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9d447-5810-48ce-94ea-7ac3dd12b1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:54.812543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9d447-5810-48ce-94ea-7ac3dd12b1e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:54.813255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9d447-5810-48ce-94ea-7ac3dd12b1e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:54.815471 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9d447-5810-48ce-94ea-7ac3dd12b1e6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:54.844485 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1086/2178] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:54 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:54.848813 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf53c51-e059-4341-bb71-9daa1bc4b590 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:54.860034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf53c51-e059-4341-bb71-9daa1bc4b590 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:54.916081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e31b-09e0-48e2-ade2-4b4f3f0386c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:54.916747 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e31b-09e0-48e2-ade2-4b4f3f0386c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:54.917030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e31b-09e0-48e2-ade2-4b4f3f0386c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:54.917307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e31b-09e0-48e2-ade2-4b4f3f0386c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:54.917998 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764e31b-09e0-48e2-ade2-4b4f3f0386c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:54.919941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764e31b-09e0-48e2-ade2-4b4f3f0386c5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:54.943998 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1093/2179] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:54 2022] POST /identity/v3/users => generated 280 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:54.945293 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9d447-5810-48ce-94ea-7ac3dd12b1e6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:54.955997 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9d447-5810-48ce-94ea-7ac3dd12b1e6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:54.961571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744c877-9826-41fa-9b71-79d508c542f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:54.962272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744c877-9826-41fa-9b71-79d508c542f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:54.962549 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744c877-9826-41fa-9b71-79d508c542f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:54.962854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744c877-9826-41fa-9b71-79d508c542f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:54.963735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744c877-9826-41fa-9b71-79d508c542f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:54.965337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744c877-9826-41fa-9b71-79d508c542f7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:54.976317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1087/2180] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:54.980422 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e31b-09e0-48e2-ade2-4b4f3f0386c5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:54.990548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e31b-09e0-48e2-ade2-4b4f3f0386c5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:54.995321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8aff3-9c49-47d3-9087-36f6bdee1e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:54.996029 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8aff3-9c49-47d3-9087-36f6bdee1e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:54.996365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8aff3-9c49-47d3-9087-36f6bdee1e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:54.996595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8aff3-9c49-47d3-9087-36f6bdee1e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:54.997322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8aff3-9c49-47d3-9087-36f6bdee1e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:54.998963 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8aff3-9c49-47d3-9087-36f6bdee1e46 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:55.009470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1094/2181] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:11:55.015581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744c877-9826-41fa-9b71-79d508c542f7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:55.026312 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744c877-9826-41fa-9b71-79d508c542f7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:55.030913 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f48f99-9a1a-414f-b139-504b8c841c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:55.032288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f48f99-9a1a-414f-b139-504b8c841c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:55.032676 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f48f99-9a1a-414f-b139-504b8c841c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:55.032836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f48f99-9a1a-414f-b139-504b8c841c59 admin admin] PATH_INFO: `/v3/projects/c0af80e81cfe45b3b08d386d91770c29/users/f4c848f2bc0a46c09ab27f9b7158e371/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:55.048047 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f48f99-9a1a-414f-b139-504b8c841c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0af80e81cfe45b3b08d386d91770c29, user_id=f4c848f2bc0a46c09ab27f9b7158e371, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:55.050705 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f48f99-9a1a-414f-b139-504b8c841c59 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:55.065072 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1088/2182] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:55 2022] PUT /identity/v3/projects/c0af80e81cfe45b3b08d386d91770c29/users/f4c848f2bc0a46c09ab27f9b7158e371/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:55.075956 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37350979-9746-4ba6-bcad-02693b8fd4ca None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:55.076248 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37350979-9746-4ba6-bcad-02693b8fd4ca None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:55.076533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37350979-9746-4ba6-bcad-02693b8fd4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:55.106895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-37350979-9746-4ba6-bcad-02693b8fd4ca None None] MFA Rules not processed for user `f4c848f2bc0a46c09ab27f9b7158e371`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:55.108204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-37350979-9746-4ba6-bcad-02693b8fd4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:55.179431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1095/2183] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:55 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:55.214244 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f48f99-9a1a-414f-b139-504b8c841c59 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:55.216209 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a3f48f99-9a1a-414f-b139-504b8c841c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:55.278399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f48f99-9a1a-414f-b139-504b8c841c59 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:55.285432 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ef5a1-0498-44e7-a111-c1060164ac14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:55.286242 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ef5a1-0498-44e7-a111-c1060164ac14 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:55.286635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ef5a1-0498-44e7-a111-c1060164ac14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:55.287005 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ef5a1-0498-44e7-a111-c1060164ac14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:55.297688 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ef5a1-0498-44e7-a111-c1060164ac14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:55.299315 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ef5a1-0498-44e7-a111-c1060164ac14 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:55.319713 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1089/2184] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:55 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:55.328048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37350979-9746-4ba6-bcad-02693b8fd4ca None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:55.412758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37350979-9746-4ba6-bcad-02693b8fd4ca None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:55.418675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e977a-b5a9-4e8e-9457-eed1b09a239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:55.419653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e977a-b5a9-4e8e-9457-eed1b09a239b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:55.420006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e977a-b5a9-4e8e-9457-eed1b09a239b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:55.420377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e977a-b5a9-4e8e-9457-eed1b09a239b admin admin] PATH_INFO: `/v3/users/f4c848f2bc0a46c09ab27f9b7158e371` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:55.421835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e977a-b5a9-4e8e-9457-eed1b09a239b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4c848f2bc0a46c09ab27f9b7158e371)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:55.424264 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e977a-b5a9-4e8e-9457-eed1b09a239b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:55.481693 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-960e977a-b5a9-4e8e-9457-eed1b09a239b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4c848f2bc0a46c09ab27f9b7158e371'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:55.494496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-960e977a-b5a9-4e8e-9457-eed1b09a239b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4c848f2bc0a46c09ab27f9b7158e371'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:55.501984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-960e977a-b5a9-4e8e-9457-eed1b09a239b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4c848f2bc0a46c09ab27f9b7158e371'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:55.502791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-960e977a-b5a9-4e8e-9457-eed1b09a239b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4c848f2bc0a46c09ab27f9b7158e371'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:55.503471 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-960e977a-b5a9-4e8e-9457-eed1b09a239b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4c848f2bc0a46c09ab27f9b7158e371'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:55.520677 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1096/2185] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:11:55 2022] DELETE /identity/v3/users/f4c848f2bc0a46c09ab27f9b7158e371 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:55.525529 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fa7a7-c578-482e-8ded-604d20f7f43c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:55.525774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fa7a7-c578-482e-8ded-604d20f7f43c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:55.526410 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fa7a7-c578-482e-8ded-604d20f7f43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:55.544915 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4d1fa7a7-c578-482e-8ded-604d20f7f43c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:55.546137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4d1fa7a7-c578-482e-8ded-604d20f7f43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:55.641568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1090/2186] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:55.657326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e977a-b5a9-4e8e-9457-eed1b09a239b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:55.658782 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-960e977a-b5a9-4e8e-9457-eed1b09a239b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:55.750124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e977a-b5a9-4e8e-9457-eed1b09a239b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:55.756491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db909755-70d9-4469-9dff-47f64b55c48d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:55.757389 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db909755-70d9-4469-9dff-47f64b55c48d service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:55.757817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db909755-70d9-4469-9dff-47f64b55c48d service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:55.758718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db909755-70d9-4469-9dff-47f64b55c48d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:55.776204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db909755-70d9-4469-9dff-47f64b55c48d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:55.778055 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db909755-70d9-4469-9dff-47f64b55c48d service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:55.790821 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1097/2187] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:11:56.175714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fa7a7-c578-482e-8ded-604d20f7f43c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:56.181434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4d1fa7a7-c578-482e-8ded-604d20f7f43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:56.206354 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fa7a7-c578-482e-8ded-604d20f7f43c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:56.213331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f085bc-3224-49db-8d7e-45cc7c9b31e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:56.214222 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f085bc-3224-49db-8d7e-45cc7c9b31e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:56.214489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f085bc-3224-49db-8d7e-45cc7c9b31e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:56.215101 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f085bc-3224-49db-8d7e-45cc7c9b31e8 admin admin] PATH_INFO: `/v3/projects/c0af80e81cfe45b3b08d386d91770c29` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:56.236345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f085bc-3224-49db-8d7e-45cc7c9b31e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0af80e81cfe45b3b08d386d91770c29)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:56.244112 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f085bc-3224-49db-8d7e-45cc7c9b31e8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:56.317682 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-72f085bc-3224-49db-8d7e-45cc7c9b31e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0af80e81cfe45b3b08d386d91770c29', 'request_id': 'req-72f085bc-3224-49db-8d7e-45cc7c9b31e8'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:56.323635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-72f085bc-3224-49db-8d7e-45cc7c9b31e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0af80e81cfe45b3b08d386d91770c29', 'request_id': 'req-72f085bc-3224-49db-8d7e-45cc7c9b31e8'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:56.333108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-72f085bc-3224-49db-8d7e-45cc7c9b31e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0af80e81cfe45b3b08d386d91770c29', 'request_id': 'req-72f085bc-3224-49db-8d7e-45cc7c9b31e8'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:56.345607 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-72f085bc-3224-49db-8d7e-45cc7c9b31e8 admin admin] The token cache is being invalidate because project c0af80e81cfe45b3b08d386d91770c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:11:56.346109 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-72f085bc-3224-49db-8d7e-45cc7c9b31e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:56.346858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-72f085bc-3224-49db-8d7e-45cc7c9b31e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:11:56.349095 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1091/2188] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:11:56 2022] DELETE /identity/v3/projects/c0af80e81cfe45b3b08d386d91770c29 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:11:56.354026 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddfee1-d722-42c7-9130-db660eeb0b51 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:56.354522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddfee1-d722-42c7-9130-db660eeb0b51 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:56.354632 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddfee1-d722-42c7-9130-db660eeb0b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:56.373838 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ccddfee1-d722-42c7-9130-db660eeb0b51 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:56.375075 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ccddfee1-d722-42c7-9130-db660eeb0b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:56.438647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1098/2189] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:56.447170 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196b9a4-3525-4e7a-8891-fec23ff390e8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:56.447454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196b9a4-3525-4e7a-8891-fec23ff390e8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:56.447764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196b9a4-3525-4e7a-8891-fec23ff390e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:56.466581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6196b9a4-3525-4e7a-8891-fec23ff390e8 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:56.467809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6196b9a4-3525-4e7a-8891-fec23ff390e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:56.477554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1092/2190] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:56.482046 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddfee1-d722-42c7-9130-db660eeb0b51 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:56.492306 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddfee1-d722-42c7-9130-db660eeb0b51 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:56.497889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995e416-8ba9-4f37-a53b-eb2f796d896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:56.498596 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995e416-8ba9-4f37-a53b-eb2f796d896c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:56.498880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995e416-8ba9-4f37-a53b-eb2f796d896c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:56.499156 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995e416-8ba9-4f37-a53b-eb2f796d896c admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:56.499979 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995e416-8ba9-4f37-a53b-eb2f796d896c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:11:56.500228 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995e416-8ba9-4f37-a53b-eb2f796d896c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:56.501827 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995e416-8ba9-4f37-a53b-eb2f796d896c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:56.515790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1099/2191] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:11:56.520159 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196b9a4-3525-4e7a-8891-fec23ff390e8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:56.530226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196b9a4-3525-4e7a-8891-fec23ff390e8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:56.536391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d901427-be1d-4e78-8642-abc252d75910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:56.537855 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d901427-be1d-4e78-8642-abc252d75910 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:56.538144 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d901427-be1d-4e78-8642-abc252d75910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:56.538594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d901427-be1d-4e78-8642-abc252d75910 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:56.539876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d901427-be1d-4e78-8642-abc252d75910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:56.541066 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d901427-be1d-4e78-8642-abc252d75910 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:56.572147 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1093/2192] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:11:56 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:11:56.576299 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995e416-8ba9-4f37-a53b-eb2f796d896c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:56.594322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995e416-8ba9-4f37-a53b-eb2f796d896c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:56.674896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead7927-5946-4403-893f-3bc94aaeb6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:56.675739 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7927-5946-4403-893f-3bc94aaeb6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:56.676024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7927-5946-4403-893f-3bc94aaeb6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:56.677372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7927-5946-4403-893f-3bc94aaeb6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:56.677961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead7927-5946-4403-893f-3bc94aaeb6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:56.680110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead7927-5946-4403-893f-3bc94aaeb6c8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:56.701021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1100/2193] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:11:56 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:11:56.705277 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d901427-be1d-4e78-8642-abc252d75910 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:56.716240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d901427-be1d-4e78-8642-abc252d75910 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:56.722027 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a9601-f2ec-4368-9e22-8ca7233d82bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:56.722844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a9601-f2ec-4368-9e22-8ca7233d82bb admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:56.723836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a9601-f2ec-4368-9e22-8ca7233d82bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:56.724056 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a9601-f2ec-4368-9e22-8ca7233d82bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:56.724722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a9601-f2ec-4368-9e22-8ca7233d82bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:56.726387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a9601-f2ec-4368-9e22-8ca7233d82bb admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:56.737846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1094/2194] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:11:56.742856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead7927-5946-4403-893f-3bc94aaeb6c8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:56.753100 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead7927-5946-4403-893f-3bc94aaeb6c8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:56.758734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe24b3e-b3aa-4ad6-bb1e-6e2a0c628753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:56.759526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe24b3e-b3aa-4ad6-bb1e-6e2a0c628753 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:56.759948 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe24b3e-b3aa-4ad6-bb1e-6e2a0c628753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:56.760299 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe24b3e-b3aa-4ad6-bb1e-6e2a0c628753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:56.761304 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe24b3e-b3aa-4ad6-bb1e-6e2a0c628753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:56.763791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe24b3e-b3aa-4ad6-bb1e-6e2a0c628753 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:56.775954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1101/2195] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:11:56.780284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a9601-f2ec-4368-9e22-8ca7233d82bb admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:56.791483 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a9601-f2ec-4368-9e22-8ca7233d82bb admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:56.803054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56793cd1-f698-4bf5-8c92-33b2356798e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:56.803054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56793cd1-f698-4bf5-8c92-33b2356798e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:56.803054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56793cd1-f698-4bf5-8c92-33b2356798e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:56.803054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56793cd1-f698-4bf5-8c92-33b2356798e8 admin admin] PATH_INFO: `/v3/projects/f59594f738594bc9a8a7395dd53bf279/users/db8acfcc9a874ddcab5f8f0d3ca4e595/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:56.820128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56793cd1-f698-4bf5-8c92-33b2356798e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59594f738594bc9a8a7395dd53bf279, user_id=db8acfcc9a874ddcab5f8f0d3ca4e595, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:56.822974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56793cd1-f698-4bf5-8c92-33b2356798e8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:56.845757 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1095/2196] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:11:56 2022] PUT /identity/v3/projects/f59594f738594bc9a8a7395dd53bf279/users/db8acfcc9a874ddcab5f8f0d3ca4e595/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:11:56.850340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd050e92-a72b-4a64-9f7e-82ec5ab4c909 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:56.850652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd050e92-a72b-4a64-9f7e-82ec5ab4c909 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:56.850927 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd050e92-a72b-4a64-9f7e-82ec5ab4c909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:56.878556 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cd050e92-a72b-4a64-9f7e-82ec5ab4c909 None None] MFA Rules not processed for user `db8acfcc9a874ddcab5f8f0d3ca4e595`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:11:56.880407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cd050e92-a72b-4a64-9f7e-82ec5ab4c909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:56.944103 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1102/2197] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:11:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:11:56.958017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56793cd1-f698-4bf5-8c92-33b2356798e8 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:11:56.960972 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-56793cd1-f698-4bf5-8c92-33b2356798e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:11:57.039986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56793cd1-f698-4bf5-8c92-33b2356798e8 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:11:57.044680 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ac55d-e0eb-4849-b9e7-e0111c06298e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:11:57.055651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac55d-e0eb-4849-b9e7-e0111c06298e service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:11:57.055651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac55d-e0eb-4849-b9e7-e0111c06298e service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:11:57.055651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac55d-e0eb-4849-b9e7-e0111c06298e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:11:57.056088 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ac55d-e0eb-4849-b9e7-e0111c06298e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:11:57.057536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ac55d-e0eb-4849-b9e7-e0111c06298e service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:11:57.067437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1096/2198] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:11:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:12:02.081674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd050e92-a72b-4a64-9f7e-82ec5ab4c909 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:02.083408 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cd050e92-a72b-4a64-9f7e-82ec5ab4c909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:02.177129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd050e92-a72b-4a64-9f7e-82ec5ab4c909 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:02.181754 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cd53d-1c65-4339-9ecf-703711440b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:02.182736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd53d-1c65-4339-9ecf-703711440b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:02.183020 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd53d-1c65-4339-9ecf-703711440b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:02.183290 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd53d-1c65-4339-9ecf-703711440b8b admin admin] PATH_INFO: `/v3/users/8da343f74eb54e318b3a57764490362a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:02.184493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cd53d-1c65-4339-9ecf-703711440b8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da343f74eb54e318b3a57764490362a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:02.186423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cd53d-1c65-4339-9ecf-703711440b8b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:02.244460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-815cd53d-1c65-4339-9ecf-703711440b8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da343f74eb54e318b3a57764490362a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:02.258151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-815cd53d-1c65-4339-9ecf-703711440b8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da343f74eb54e318b3a57764490362a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:02.265202 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-815cd53d-1c65-4339-9ecf-703711440b8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da343f74eb54e318b3a57764490362a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:02.265924 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-815cd53d-1c65-4339-9ecf-703711440b8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da343f74eb54e318b3a57764490362a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:02.266525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-815cd53d-1c65-4339-9ecf-703711440b8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da343f74eb54e318b3a57764490362a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:02.281611 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1103/2199] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:12:02 2022] DELETE /identity/v3/users/8da343f74eb54e318b3a57764490362a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:12:02.287157 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6466-5061-49dc-bded-eb25670874a9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:02.287908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6466-5061-49dc-bded-eb25670874a9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:02.288287 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6466-5061-49dc-bded-eb25670874a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:02.308230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a80f6466-5061-49dc-bded-eb25670874a9 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:02.309632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a80f6466-5061-49dc-bded-eb25670874a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:02.376573 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1097/2200] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:02.386820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cd53d-1c65-4339-9ecf-703711440b8b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:02.388256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-815cd53d-1c65-4339-9ecf-703711440b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:02.454774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cd53d-1c65-4339-9ecf-703711440b8b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:02.458743 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e061d9-a27a-4589-89ef-a6846d85e4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:02.459391 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e061d9-a27a-4589-89ef-a6846d85e4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:02.459802 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e061d9-a27a-4589-89ef-a6846d85e4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:02.460086 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e061d9-a27a-4589-89ef-a6846d85e4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:02.469570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e061d9-a27a-4589-89ef-a6846d85e4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:02.471017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e061d9-a27a-4589-89ef-a6846d85e4e4 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:02.481481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1104/2201] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:12:02.974038 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6466-5061-49dc-bded-eb25670874a9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:02.978037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a80f6466-5061-49dc-bded-eb25670874a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:02.990697 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6466-5061-49dc-bded-eb25670874a9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:02.995731 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3374aa-53e9-4afe-a52b-154c35432ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:02.996653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3374aa-53e9-4afe-a52b-154c35432ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:02.996862 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3374aa-53e9-4afe-a52b-154c35432ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:02.997143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3374aa-53e9-4afe-a52b-154c35432ce4 admin admin] PATH_INFO: `/v3/projects/ac1c2f9254984d3aab4ba96ed6c28f38` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:02.998326 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3374aa-53e9-4afe-a52b-154c35432ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1c2f9254984d3aab4ba96ed6c28f38)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:03.000308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3374aa-53e9-4afe-a52b-154c35432ce4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:03.057399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-af3374aa-53e9-4afe-a52b-154c35432ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1c2f9254984d3aab4ba96ed6c28f38', 'request_id': 'req-af3374aa-53e9-4afe-a52b-154c35432ce4'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:03.063808 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-af3374aa-53e9-4afe-a52b-154c35432ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1c2f9254984d3aab4ba96ed6c28f38', 'request_id': 'req-af3374aa-53e9-4afe-a52b-154c35432ce4'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:03.074507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-af3374aa-53e9-4afe-a52b-154c35432ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1c2f9254984d3aab4ba96ed6c28f38', 'request_id': 'req-af3374aa-53e9-4afe-a52b-154c35432ce4'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:03.100237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-af3374aa-53e9-4afe-a52b-154c35432ce4 admin admin] The token cache is being invalidate because project ac1c2f9254984d3aab4ba96ed6c28f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:12:03.100460 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-af3374aa-53e9-4afe-a52b-154c35432ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:03.101414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-af3374aa-53e9-4afe-a52b-154c35432ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:03.104427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1098/2202] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:12:02 2022] DELETE /identity/v3/projects/ac1c2f9254984d3aab4ba96ed6c28f38 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:12:03.108509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec72079-effa-4a85-b6b2-2c53b42647fd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:03.108964 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec72079-effa-4a85-b6b2-2c53b42647fd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:03.109245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec72079-effa-4a85-b6b2-2c53b42647fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:03.132060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-dec72079-effa-4a85-b6b2-2c53b42647fd None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:03.133440 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-dec72079-effa-4a85-b6b2-2c53b42647fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:03.236056 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1105/2203] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:12:03.236179 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f83f8-0713-4949-81e3-46fb783a7ea2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:03.236179 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f83f8-0713-4949-81e3-46fb783a7ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:03.236179 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f83f8-0713-4949-81e3-46fb783a7ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:03.254938 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-685f83f8-0713-4949-81e3-46fb783a7ea2 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:03.256465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-685f83f8-0713-4949-81e3-46fb783a7ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:03.271700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1099/2204] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:03.275982 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec72079-effa-4a85-b6b2-2c53b42647fd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:03.287174 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec72079-effa-4a85-b6b2-2c53b42647fd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:03.292210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ced27-2280-4a63-acac-ab3c6e49624b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:03.292930 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ced27-2280-4a63-acac-ab3c6e49624b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:03.293427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ced27-2280-4a63-acac-ab3c6e49624b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:03.293915 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ced27-2280-4a63-acac-ab3c6e49624b admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:03.294854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ced27-2280-4a63-acac-ab3c6e49624b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:12:03.295357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ced27-2280-4a63-acac-ab3c6e49624b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:03.297177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ced27-2280-4a63-acac-ab3c6e49624b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:03.315334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f83f8-0713-4949-81e3-46fb783a7ea2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:03.325446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1106/2205] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:12:03.330335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f83f8-0713-4949-81e3-46fb783a7ea2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:03.344537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a466a-f9de-4a9f-a4eb-d54e5d39c760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:03.345493 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a466a-f9de-4a9f-a4eb-d54e5d39c760 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:03.345970 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a466a-f9de-4a9f-a4eb-d54e5d39c760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:03.346482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a466a-f9de-4a9f-a4eb-d54e5d39c760 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:03.350792 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a466a-f9de-4a9f-a4eb-d54e5d39c760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:03.353090 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a466a-f9de-4a9f-a4eb-d54e5d39c760 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:03.414218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1100/2206] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:12:03 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:12:03.418608 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ced27-2280-4a63-acac-ab3c6e49624b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:03.430846 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ced27-2280-4a63-acac-ab3c6e49624b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:03.503592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1d179-460b-4df9-a3d4-85e63a8d8a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:03.504832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1d179-460b-4df9-a3d4-85e63a8d8a29 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:03.505111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1d179-460b-4df9-a3d4-85e63a8d8a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:03.505384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1d179-460b-4df9-a3d4-85e63a8d8a29 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:03.506069 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1d179-460b-4df9-a3d4-85e63a8d8a29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:03.508264 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1d179-460b-4df9-a3d4-85e63a8d8a29 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:03.533838 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1107/2207] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:12:03 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:12:03.536287 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a466a-f9de-4a9f-a4eb-d54e5d39c760 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:03.549292 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a466a-f9de-4a9f-a4eb-d54e5d39c760 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:03.554222 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da47913-f8dc-4e6f-951a-35f8a74d5dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:03.554889 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da47913-f8dc-4e6f-951a-35f8a74d5dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:03.555185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da47913-f8dc-4e6f-951a-35f8a74d5dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:03.555431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da47913-f8dc-4e6f-951a-35f8a74d5dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:03.556191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da47913-f8dc-4e6f-951a-35f8a74d5dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:03.557900 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da47913-f8dc-4e6f-951a-35f8a74d5dd7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:03.573009 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1101/2208] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:12:03.574803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1d179-460b-4df9-a3d4-85e63a8d8a29 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:03.589954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1d179-460b-4df9-a3d4-85e63a8d8a29 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:03.594848 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948728e-f26d-431a-90fb-833c8fb82b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:03.595520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948728e-f26d-431a-90fb-833c8fb82b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:03.595841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948728e-f26d-431a-90fb-833c8fb82b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:03.596124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948728e-f26d-431a-90fb-833c8fb82b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:03.596855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948728e-f26d-431a-90fb-833c8fb82b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:03.599410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948728e-f26d-431a-90fb-833c8fb82b03 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:03.613114 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1108/2209] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:12:03.614607 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da47913-f8dc-4e6f-951a-35f8a74d5dd7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:03.625539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da47913-f8dc-4e6f-951a-35f8a74d5dd7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:03.635918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda42be-19c1-42b4-9085-a78e7b9bfbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:03.636957 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda42be-19c1-42b4-9085-a78e7b9bfbd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:03.637271 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda42be-19c1-42b4-9085-a78e7b9bfbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:03.637730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda42be-19c1-42b4-9085-a78e7b9bfbd2 admin admin] PATH_INFO: `/v3/projects/d440db1af37449b1a5d268506dc5bf11/users/c7e15f0e588042df9a7502c9f8d50479/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:03.654456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda42be-19c1-42b4-9085-a78e7b9bfbd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d440db1af37449b1a5d268506dc5bf11, user_id=c7e15f0e588042df9a7502c9f8d50479, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:03.657273 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda42be-19c1-42b4-9085-a78e7b9bfbd2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:03.672760 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1102/2210] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:12:03 2022] PUT /identity/v3/projects/d440db1af37449b1a5d268506dc5bf11/users/c7e15f0e588042df9a7502c9f8d50479/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:12:03.683722 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b0f66-9af7-4e05-bb2a-45b85809f6fb None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:03.684230 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b0f66-9af7-4e05-bb2a-45b85809f6fb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:03.684734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b0f66-9af7-4e05-bb2a-45b85809f6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:03.721675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-764b0f66-9af7-4e05-bb2a-45b85809f6fb None None] MFA Rules not processed for user `c7e15f0e588042df9a7502c9f8d50479`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:03.723570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-764b0f66-9af7-4e05-bb2a-45b85809f6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:03.788665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1109/2211] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:03.799074 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda42be-19c1-42b4-9085-a78e7b9bfbd2 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:03.801054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-fcda42be-19c1-42b4-9085-a78e7b9bfbd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:03.859488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda42be-19c1-42b4-9085-a78e7b9bfbd2 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:03.863458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f442fe1-f059-4e44-ba40-1acdc9e204f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:03.864430 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f442fe1-f059-4e44-ba40-1acdc9e204f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:03.864715 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f442fe1-f059-4e44-ba40-1acdc9e204f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:03.865117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f442fe1-f059-4e44-ba40-1acdc9e204f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:03.881091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f442fe1-f059-4e44-ba40-1acdc9e204f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:03.882598 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f442fe1-f059-4e44-ba40-1acdc9e204f2 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:03.892588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1103/2212] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:12:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:12:05.299667 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae66496-742f-4b2c-a0d8-a88714befc8c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:05.300525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae66496-742f-4b2c-a0d8-a88714befc8c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:05.300983 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae66496-742f-4b2c-a0d8-a88714befc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:05.318165 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4ae66496-742f-4b2c-a0d8-a88714befc8c None None] MFA Rules not processed for user `c7e15f0e588042df9a7502c9f8d50479`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:05.319331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4ae66496-742f-4b2c-a0d8-a88714befc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:05.327020 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1110/2213] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:07.499987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f442fe1-f059-4e44-ba40-1acdc9e204f2 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:07.501468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7f442fe1-f059-4e44-ba40-1acdc9e204f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:07.583180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f442fe1-f059-4e44-ba40-1acdc9e204f2 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:07.588787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b48c21-8c9d-4a79-bfe4-02a175dd65ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:07.589673 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b48c21-8c9d-4a79-bfe4-02a175dd65ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:07.589955 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b48c21-8c9d-4a79-bfe4-02a175dd65ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:07.590226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b48c21-8c9d-4a79-bfe4-02a175dd65ad admin admin] PATH_INFO: `/v3/users/db8acfcc9a874ddcab5f8f0d3ca4e595` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:07.591439 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b48c21-8c9d-4a79-bfe4-02a175dd65ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8acfcc9a874ddcab5f8f0d3ca4e595)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:07.593407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b48c21-8c9d-4a79-bfe4-02a175dd65ad admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:07.640307 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a9b48c21-8c9d-4a79-bfe4-02a175dd65ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8acfcc9a874ddcab5f8f0d3ca4e595'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:07.641172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a9b48c21-8c9d-4a79-bfe4-02a175dd65ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8acfcc9a874ddcab5f8f0d3ca4e595'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:07.653609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a9b48c21-8c9d-4a79-bfe4-02a175dd65ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8acfcc9a874ddcab5f8f0d3ca4e595'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:07.660193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a9b48c21-8c9d-4a79-bfe4-02a175dd65ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8acfcc9a874ddcab5f8f0d3ca4e595'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:07.660853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a9b48c21-8c9d-4a79-bfe4-02a175dd65ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8acfcc9a874ddcab5f8f0d3ca4e595'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:07.676924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1104/2214] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:12:07 2022] DELETE /identity/v3/users/db8acfcc9a874ddcab5f8f0d3ca4e595 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:12:07.684734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d49e6-a030-48af-98b8-1d318db6ccea None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:07.685286 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d49e6-a030-48af-98b8-1d318db6ccea None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:07.685286 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d49e6-a030-48af-98b8-1d318db6ccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:07.704068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d22d49e6-a030-48af-98b8-1d318db6ccea None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:07.705263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d22d49e6-a030-48af-98b8-1d318db6ccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:07.796496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1111/2215] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:07.809484 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b48c21-8c9d-4a79-bfe4-02a175dd65ad admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:07.812181 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a9b48c21-8c9d-4a79-bfe4-02a175dd65ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:07.896201 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b48c21-8c9d-4a79-bfe4-02a175dd65ad admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:07.900557 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b22f-92e8-442a-967a-326c438fa734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:07.902385 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b22f-92e8-442a-967a-326c438fa734 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:07.902515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b22f-92e8-442a-967a-326c438fa734 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:07.902758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b22f-92e8-442a-967a-326c438fa734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:07.920418 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0b22f-92e8-442a-967a-326c438fa734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:07.922313 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0b22f-92e8-442a-967a-326c438fa734 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:07.957687 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1105/2216] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:12:08.427148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d49e6-a030-48af-98b8-1d318db6ccea None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:08.428943 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d22d49e6-a030-48af-98b8-1d318db6ccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:08.443223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d49e6-a030-48af-98b8-1d318db6ccea None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:08.448828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d973a82-a809-4c00-ac31-63c248d8fcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:08.449947 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d973a82-a809-4c00-ac31-63c248d8fcd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:08.450232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d973a82-a809-4c00-ac31-63c248d8fcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:08.450501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d973a82-a809-4c00-ac31-63c248d8fcd2 admin admin] PATH_INFO: `/v3/projects/f59594f738594bc9a8a7395dd53bf279` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:08.452235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d973a82-a809-4c00-ac31-63c248d8fcd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59594f738594bc9a8a7395dd53bf279)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:08.454332 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d973a82-a809-4c00-ac31-63c248d8fcd2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:08.527327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8d973a82-a809-4c00-ac31-63c248d8fcd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59594f738594bc9a8a7395dd53bf279', 'request_id': 'req-8d973a82-a809-4c00-ac31-63c248d8fcd2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:08.533507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8d973a82-a809-4c00-ac31-63c248d8fcd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59594f738594bc9a8a7395dd53bf279', 'request_id': 'req-8d973a82-a809-4c00-ac31-63c248d8fcd2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:08.546318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8d973a82-a809-4c00-ac31-63c248d8fcd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59594f738594bc9a8a7395dd53bf279', 'request_id': 'req-8d973a82-a809-4c00-ac31-63c248d8fcd2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:08.564060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8d973a82-a809-4c00-ac31-63c248d8fcd2 admin admin] The token cache is being invalidate because project f59594f738594bc9a8a7395dd53bf279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:12:08.566715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8d973a82-a809-4c00-ac31-63c248d8fcd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:08.566715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8d973a82-a809-4c00-ac31-63c248d8fcd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:08.570030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1112/2217] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:12:08 2022] DELETE /identity/v3/projects/f59594f738594bc9a8a7395dd53bf279 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:12:08.574465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3be9a-3c5a-493b-8bb0-d32ba92fe878 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:08.575579 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3be9a-3c5a-493b-8bb0-d32ba92fe878 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:08.576187 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3be9a-3c5a-493b-8bb0-d32ba92fe878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:08.596457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-70f3be9a-3c5a-493b-8bb0-d32ba92fe878 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:08.598007 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-70f3be9a-3c5a-493b-8bb0-d32ba92fe878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:08.662057 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1106/2218] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:08.672718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb13d2f-9cf3-4933-873c-928a5d69de0e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:08.673003 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb13d2f-9cf3-4933-873c-928a5d69de0e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:08.673280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb13d2f-9cf3-4933-873c-928a5d69de0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:08.694419 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3cb13d2f-9cf3-4933-873c-928a5d69de0e None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:08.697036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3cb13d2f-9cf3-4933-873c-928a5d69de0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:08.705968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1113/2219] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:08.711164 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3be9a-3c5a-493b-8bb0-d32ba92fe878 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:08.720968 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3be9a-3c5a-493b-8bb0-d32ba92fe878 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:08.726894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3054513-14dd-4d39-854e-c139b1d20011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:08.727545 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3054513-14dd-4d39-854e-c139b1d20011 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:08.727854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3054513-14dd-4d39-854e-c139b1d20011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:08.728128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3054513-14dd-4d39-854e-c139b1d20011 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:08.729451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3054513-14dd-4d39-854e-c139b1d20011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:12:08.729833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3054513-14dd-4d39-854e-c139b1d20011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:08.732597 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3054513-14dd-4d39-854e-c139b1d20011 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:08.756447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1107/2220] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:12:08.757194 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb13d2f-9cf3-4933-873c-928a5d69de0e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:08.767989 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb13d2f-9cf3-4933-873c-928a5d69de0e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:08.773423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82080e0c-de05-4e84-9ca2-3fd5ac24e611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:08.774712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82080e0c-de05-4e84-9ca2-3fd5ac24e611 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:08.775231 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82080e0c-de05-4e84-9ca2-3fd5ac24e611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:08.775498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82080e0c-de05-4e84-9ca2-3fd5ac24e611 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:08.777224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82080e0c-de05-4e84-9ca2-3fd5ac24e611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:08.779420 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82080e0c-de05-4e84-9ca2-3fd5ac24e611 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:08.817064 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1114/2221] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:12:08 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:12:08.821606 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3054513-14dd-4d39-854e-c139b1d20011 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:08.831380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3054513-14dd-4d39-854e-c139b1d20011 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:08.893536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0a275-6e6a-4f83-abfa-d94b7d1cab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:08.894829 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0a275-6e6a-4f83-abfa-d94b7d1cab19 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:08.895110 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0a275-6e6a-4f83-abfa-d94b7d1cab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:08.895379 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0a275-6e6a-4f83-abfa-d94b7d1cab19 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:08.896100 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0a275-6e6a-4f83-abfa-d94b7d1cab19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:08.898025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0a275-6e6a-4f83-abfa-d94b7d1cab19 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:08.920279 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1108/2222] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:12:08 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:12:08.924327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82080e0c-de05-4e84-9ca2-3fd5ac24e611 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:08.934890 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82080e0c-de05-4e84-9ca2-3fd5ac24e611 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:08.953813 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83029a62-b71a-452f-8b1d-f5f0273afb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:08.956040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83029a62-b71a-452f-8b1d-f5f0273afb3a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:08.956410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83029a62-b71a-452f-8b1d-f5f0273afb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:08.956855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83029a62-b71a-452f-8b1d-f5f0273afb3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:08.958440 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83029a62-b71a-452f-8b1d-f5f0273afb3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:08.959629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83029a62-b71a-452f-8b1d-f5f0273afb3a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:08.970913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1115/2223] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:12:08.975125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0a275-6e6a-4f83-abfa-d94b7d1cab19 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:08.987076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0a275-6e6a-4f83-abfa-d94b7d1cab19 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:08.993773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec18ca-9d54-4897-a97c-c92fc0668717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:08.994447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec18ca-9d54-4897-a97c-c92fc0668717 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:08.994727 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec18ca-9d54-4897-a97c-c92fc0668717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:08.994997 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec18ca-9d54-4897-a97c-c92fc0668717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:08.995756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec18ca-9d54-4897-a97c-c92fc0668717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:08.997369 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec18ca-9d54-4897-a97c-c92fc0668717 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:09.008717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1109/2224] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:12:09.012789 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83029a62-b71a-452f-8b1d-f5f0273afb3a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:09.024526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83029a62-b71a-452f-8b1d-f5f0273afb3a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:09.029788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078dde4-fdae-46b0-934a-04c74bf9b7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:09.030642 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078dde4-fdae-46b0-934a-04c74bf9b7a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:09.030924 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078dde4-fdae-46b0-934a-04c74bf9b7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:09.031203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078dde4-fdae-46b0-934a-04c74bf9b7a2 admin admin] PATH_INFO: `/v3/projects/2630e0044e5f4f28b8d2adcfeaf0c604/users/4302f72c503341d4a5367613edf38055/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:09.046750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078dde4-fdae-46b0-934a-04c74bf9b7a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2630e0044e5f4f28b8d2adcfeaf0c604, user_id=4302f72c503341d4a5367613edf38055, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:09.049724 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078dde4-fdae-46b0-934a-04c74bf9b7a2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:09.071979 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1116/2225] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:12:09 2022] PUT /identity/v3/projects/2630e0044e5f4f28b8d2adcfeaf0c604/users/4302f72c503341d4a5367613edf38055/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:12:09.073546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed634b-b4e4-4641-9b20-1f0921648991 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:09.073701 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed634b-b4e4-4641-9b20-1f0921648991 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:09.073865 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed634b-b4e4-4641-9b20-1f0921648991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:09.105432 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-74ed634b-b4e4-4641-9b20-1f0921648991 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:09.106263 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-74ed634b-b4e4-4641-9b20-1f0921648991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:09.199011 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1110/2226] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:12:09.212385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078dde4-fdae-46b0-934a-04c74bf9b7a2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:09.214241 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9078dde4-fdae-46b0-934a-04c74bf9b7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:09.313640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078dde4-fdae-46b0-934a-04c74bf9b7a2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:09.323835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f70f6-bc8f-4a72-97f9-a5bd45c6a035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:09.324233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f70f6-bc8f-4a72-97f9-a5bd45c6a035 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:09.324774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f70f6-bc8f-4a72-97f9-a5bd45c6a035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:09.325231 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f70f6-bc8f-4a72-97f9-a5bd45c6a035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:09.339715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f70f6-bc8f-4a72-97f9-a5bd45c6a035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:09.341418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f70f6-bc8f-4a72-97f9-a5bd45c6a035 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:09.358863 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1117/2227] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:12:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:12:15.225907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787466c-7922-4731-9f33-d7ad7047d2ab None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:15.226424 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787466c-7922-4731-9f33-d7ad7047d2ab None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:15.226515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787466c-7922-4731-9f33-d7ad7047d2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:15.262524 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d787466c-7922-4731-9f33-d7ad7047d2ab None None] MFA Rules not processed for user `4302f72c503341d4a5367613edf38055`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:15.263728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d787466c-7922-4731-9f33-d7ad7047d2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:15.326778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1111/2228] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:15.332146 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f70f6-bc8f-4a72-97f9-a5bd45c6a035 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:15.343376 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f70f6-bc8f-4a72-97f9-a5bd45c6a035 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:15.349488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414f798-88fb-44fd-8368-6e7c8ab75d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:15.350139 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414f798-88fb-44fd-8368-6e7c8ab75d26 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:15.350417 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414f798-88fb-44fd-8368-6e7c8ab75d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:15.350688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414f798-88fb-44fd-8368-6e7c8ab75d26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:15.351413 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414f798-88fb-44fd-8368-6e7c8ab75d26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:15.353359 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414f798-88fb-44fd-8368-6e7c8ab75d26 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:15.381474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1118/2229] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:12:15 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:12:15.385554 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787466c-7922-4731-9f33-d7ad7047d2ab None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:15.396895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787466c-7922-4731-9f33-d7ad7047d2ab None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:15.451018 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2e38f-7038-46eb-a476-23d878342688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:15.451800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2e38f-7038-46eb-a476-23d878342688 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:15.452136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2e38f-7038-46eb-a476-23d878342688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:15.452399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2e38f-7038-46eb-a476-23d878342688 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:15.453128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2e38f-7038-46eb-a476-23d878342688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:15.455100 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2e38f-7038-46eb-a476-23d878342688 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:15.486846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1112/2230] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:12:15 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:12:15.488740 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414f798-88fb-44fd-8368-6e7c8ab75d26 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:15.499015 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414f798-88fb-44fd-8368-6e7c8ab75d26 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:15.504490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76bdce-a705-48a3-b0ba-bf1747fa4e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:15.505102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76bdce-a705-48a3-b0ba-bf1747fa4e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:15.505380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76bdce-a705-48a3-b0ba-bf1747fa4e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:15.505649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76bdce-a705-48a3-b0ba-bf1747fa4e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:15.506472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76bdce-a705-48a3-b0ba-bf1747fa4e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:15.507982 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76bdce-a705-48a3-b0ba-bf1747fa4e20 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:15.518412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1119/2231] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:12:15.522385 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2e38f-7038-46eb-a476-23d878342688 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:15.533172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2e38f-7038-46eb-a476-23d878342688 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:15.538033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793084b-b8b9-4a1e-9adb-bd67784ecdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:15.538904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793084b-b8b9-4a1e-9adb-bd67784ecdd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:15.539179 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793084b-b8b9-4a1e-9adb-bd67784ecdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:15.539450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793084b-b8b9-4a1e-9adb-bd67784ecdd1 admin admin] PATH_INFO: `/v3/projects/21299fda6d7a4f278b2594739476b380/users/870dd4a30bf14ec78e3263b72f936628/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:15.557989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793084b-b8b9-4a1e-9adb-bd67784ecdd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21299fda6d7a4f278b2594739476b380, user_id=870dd4a30bf14ec78e3263b72f936628, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:15.560930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793084b-b8b9-4a1e-9adb-bd67784ecdd1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:15.574905 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1113/2232] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:12:15 2022] PUT /identity/v3/projects/21299fda6d7a4f278b2594739476b380/users/870dd4a30bf14ec78e3263b72f936628/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:12:15.578648 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76bdce-a705-48a3-b0ba-bf1747fa4e20 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:15.588775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76bdce-a705-48a3-b0ba-bf1747fa4e20 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:15.651441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b813bef-5111-4dc1-bf6d-a2ad9e82374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:15.652164 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b813bef-5111-4dc1-bf6d-a2ad9e82374c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:15.652442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b813bef-5111-4dc1-bf6d-a2ad9e82374c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:15.652711 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b813bef-5111-4dc1-bf6d-a2ad9e82374c admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:15.653561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b813bef-5111-4dc1-bf6d-a2ad9e82374c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:15.655146 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b813bef-5111-4dc1-bf6d-a2ad9e82374c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:15.666636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1120/2233] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:12:15.670652 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793084b-b8b9-4a1e-9adb-bd67784ecdd1 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:15.682096 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793084b-b8b9-4a1e-9adb-bd67784ecdd1 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:15.687864 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967e77b-f495-4a1d-9774-177617811e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:15.688218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967e77b-f495-4a1d-9774-177617811e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:15.688498 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967e77b-f495-4a1d-9774-177617811e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:15.688775 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967e77b-f495-4a1d-9774-177617811e39 admin admin] PATH_INFO: `/v3/projects/21299fda6d7a4f278b2594739476b380/users/870dd4a30bf14ec78e3263b72f936628/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:15.690774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967e77b-f495-4a1d-9774-177617811e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21299fda6d7a4f278b2594739476b380, user_id=870dd4a30bf14ec78e3263b72f936628, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:15.693888 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967e77b-f495-4a1d-9774-177617811e39 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:15.705122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1114/2234] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:12:15 2022] PUT /identity/v3/projects/21299fda6d7a4f278b2594739476b380/users/870dd4a30bf14ec78e3263b72f936628/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:12:16.157927 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f80256-9066-47ab-baf8-26ce331ac2ee None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:16.158548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f80256-9066-47ab-baf8-26ce331ac2ee None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:16.159002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f80256-9066-47ab-baf8-26ce331ac2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:16.189772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f8f80256-9066-47ab-baf8-26ce331ac2ee None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:16.194093 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f8f80256-9066-47ab-baf8-26ce331ac2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:16.385181 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1121/2235] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 17:12:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:16.479547 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967e77b-f495-4a1d-9774-177617811e39 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:16.482704 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d967e77b-f495-4a1d-9774-177617811e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:16.585230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967e77b-f495-4a1d-9774-177617811e39 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:16.591693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad43a8e-10e2-4cf3-854c-bf1b65884b50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:16.592605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad43a8e-10e2-4cf3-854c-bf1b65884b50 service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:16.592892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad43a8e-10e2-4cf3-854c-bf1b65884b50 service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:16.593191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad43a8e-10e2-4cf3-854c-bf1b65884b50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:16.608354 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad43a8e-10e2-4cf3-854c-bf1b65884b50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:16.610244 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad43a8e-10e2-4cf3-854c-bf1b65884b50 service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:16.639309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1115/2236] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:12:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:12:24.878670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a322fe-41f6-4347-8699-8a0f6bbfae54 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:24.879955 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a322fe-41f6-4347-8699-8a0f6bbfae54 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:24.880247 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a322fe-41f6-4347-8699-8a0f6bbfae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:24.912245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e6a322fe-41f6-4347-8699-8a0f6bbfae54 None None] MFA Rules not processed for user `870dd4a30bf14ec78e3263b72f936628`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:24.913694 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e6a322fe-41f6-4347-8699-8a0f6bbfae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:24.997186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1122/2237] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:24 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:25.397682 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad43a8e-10e2-4cf3-854c-bf1b65884b50 service swift] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:25.399981 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3ad43a8e-10e2-4cf3-854c-bf1b65884b50 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:25.523013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad43a8e-10e2-4cf3-854c-bf1b65884b50 service swift] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:25.531114 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408908da-3f97-477a-85a6-5b4aff71cd90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:25.532523 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408908da-3f97-477a-85a6-5b4aff71cd90 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:25.532929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408908da-3f97-477a-85a6-5b4aff71cd90 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:25.533345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408908da-3f97-477a-85a6-5b4aff71cd90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:25.656912 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408908da-3f97-477a-85a6-5b4aff71cd90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:25.659110 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408908da-3f97-477a-85a6-5b4aff71cd90 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:25.673058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1116/2238] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:12:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:12:28.069356 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76297e9e-47a2-4208-ab77-538c655dae7f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:28.070219 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76297e9e-47a2-4208-ab77-538c655dae7f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:28.070658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76297e9e-47a2-4208-ab77-538c655dae7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:28.106884 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-76297e9e-47a2-4208-ab77-538c655dae7f None None] MFA Rules not processed for user `4302f72c503341d4a5367613edf38055`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:28.108419 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-76297e9e-47a2-4208-ab77-538c655dae7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:28.163382 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1123/2239] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:35.801864 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697225b-caf0-4f03-b558-63a086096233 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:35.802499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697225b-caf0-4f03-b558-63a086096233 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:35.803022 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697225b-caf0-4f03-b558-63a086096233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:35.827399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-8697225b-caf0-4f03-b558-63a086096233 None None] MFA Rules not processed for user `824915e26a724d938e5dd0a3c1f57932`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:35.828959 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8697225b-caf0-4f03-b558-63a086096233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:35.894142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1117/2240] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:46.192327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bc0d4-ad60-46e8-b260-0b3b318c4dae None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:46.192832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bc0d4-ad60-46e8-b260-0b3b318c4dae None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:46.192930 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bc0d4-ad60-46e8-b260-0b3b318c4dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:46.220444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f25bc0d4-ad60-46e8-b260-0b3b318c4dae None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:46.221628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f25bc0d4-ad60-46e8-b260-0b3b318c4dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:46.244693 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1124/2241] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 17:12:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:12:46.257184 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697225b-caf0-4f03-b558-63a086096233 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:46.275230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697225b-caf0-4f03-b558-63a086096233 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:46.280247 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88646fc1-b307-4647-9b09-153954905c58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:46.280872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88646fc1-b307-4647-9b09-153954905c58 service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:46.281149 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88646fc1-b307-4647-9b09-153954905c58 service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:46.281419 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88646fc1-b307-4647-9b09-153954905c58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:46.289533 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88646fc1-b307-4647-9b09-153954905c58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:46.291120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88646fc1-b307-4647-9b09-153954905c58 service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:46.299488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1118/2242] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:12:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:12:46.827455 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900bd1a-826b-43a4-89b4-852ba032ca25 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:46.827785 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900bd1a-826b-43a4-89b4-852ba032ca25 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:46.828066 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900bd1a-826b-43a4-89b4-852ba032ca25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:46.847348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a900bd1a-826b-43a4-89b4-852ba032ca25 None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:46.848611 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a900bd1a-826b-43a4-89b4-852ba032ca25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:46.856277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1125/2243] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 17 17:12:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:46.870101 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88646fc1-b307-4647-9b09-153954905c58 service swift] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:46.884553 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88646fc1-b307-4647-9b09-153954905c58 service swift] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:46.893109 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933112-28b6-4a9d-b6d5-f9d15b0bc6d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:46.894233 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933112-28b6-4a9d-b6d5-f9d15b0bc6d3 service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:46.894518 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933112-28b6-4a9d-b6d5-f9d15b0bc6d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:46.894796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933112-28b6-4a9d-b6d5-f9d15b0bc6d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:46.904651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c933112-28b6-4a9d-b6d5-f9d15b0bc6d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:46.907024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c933112-28b6-4a9d-b6d5-f9d15b0bc6d3 service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:46.917781 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1119/2244] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:12:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:12:47.159417 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cb2d5-7546-45c5-a1f8-cb0a99fbf8cb None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:47.159979 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cb2d5-7546-45c5-a1f8-cb0a99fbf8cb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:47.160360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cb2d5-7546-45c5-a1f8-cb0a99fbf8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:47.184789 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b16cb2d5-7546-45c5-a1f8-cb0a99fbf8cb None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:47.186441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b16cb2d5-7546-45c5-a1f8-cb0a99fbf8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:47.201315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1126/2245] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 17:12:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:47.216308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933112-28b6-4a9d-b6d5-f9d15b0bc6d3 service swift] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:47.227303 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933112-28b6-4a9d-b6d5-f9d15b0bc6d3 service swift] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:47.233487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca0abf-a8b1-4e53-af1c-14fbb30b445a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:47.234161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca0abf-a8b1-4e53-af1c-14fbb30b445a service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:47.234443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca0abf-a8b1-4e53-af1c-14fbb30b445a service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:47.234718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca0abf-a8b1-4e53-af1c-14fbb30b445a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:47.244143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca0abf-a8b1-4e53-af1c-14fbb30b445a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:47.245716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca0abf-a8b1-4e53-af1c-14fbb30b445a service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:47.254465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1120/2246] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:12:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:12:47.578031 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff7c81-7750-40cc-93d2-ea15eda6555c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:47.578314 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff7c81-7750-40cc-93d2-ea15eda6555c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:47.578582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff7c81-7750-40cc-93d2-ea15eda6555c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:47.596268 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-20ff7c81-7750-40cc-93d2-ea15eda6555c None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:47.597432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-20ff7c81-7750-40cc-93d2-ea15eda6555c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:47.604335 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1127/2247] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 17 17:12:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:47.617576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca0abf-a8b1-4e53-af1c-14fbb30b445a service swift] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:47.627184 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca0abf-a8b1-4e53-af1c-14fbb30b445a service swift] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:47.632234 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59a025-8038-4dde-95b5-52e00f2426f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:47.632858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59a025-8038-4dde-95b5-52e00f2426f6 service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:47.633133 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59a025-8038-4dde-95b5-52e00f2426f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:47.633402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59a025-8038-4dde-95b5-52e00f2426f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:47.641260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59a025-8038-4dde-95b5-52e00f2426f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:47.643001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59a025-8038-4dde-95b5-52e00f2426f6 service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:47.650701 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1121/2248] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:12:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:12:49.370825 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6b95a-9a8d-42f3-83e3-ba20205c0760 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:49.371351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6b95a-9a8d-42f3-83e3-ba20205c0760 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:49.371444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6b95a-9a8d-42f3-83e3-ba20205c0760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:49.390509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-75e6b95a-9a8d-42f3-83e3-ba20205c0760 None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:49.391764 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-75e6b95a-9a8d-42f3-83e3-ba20205c0760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:49.399573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1128/2249] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 17 17:12:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:49.412933 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59a025-8038-4dde-95b5-52e00f2426f6 service swift] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:49.427698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59a025-8038-4dde-95b5-52e00f2426f6 service swift] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:49.432774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5738acd-39f9-414d-ab23-ccfe2ff153e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:49.433471 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5738acd-39f9-414d-ab23-ccfe2ff153e0 service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:49.433755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5738acd-39f9-414d-ab23-ccfe2ff153e0 service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:49.434035 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5738acd-39f9-414d-ab23-ccfe2ff153e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:49.443064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5738acd-39f9-414d-ab23-ccfe2ff153e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:49.444677 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5738acd-39f9-414d-ab23-ccfe2ff153e0 service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:49.452499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1122/2250] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:12:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:12:49.711710 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6b95a-9a8d-42f3-83e3-ba20205c0760 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:49.711710 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-75e6b95a-9a8d-42f3-83e3-ba20205c0760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:49.847924 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6b95a-9a8d-42f3-83e3-ba20205c0760 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:49.853690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b521ebc-b13e-438e-9f56-079effc2efde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:49.854885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b521ebc-b13e-438e-9f56-079effc2efde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:49.855337 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b521ebc-b13e-438e-9f56-079effc2efde admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:49.855702 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b521ebc-b13e-438e-9f56-079effc2efde admin admin] PATH_INFO: `/v3/users/c7e15f0e588042df9a7502c9f8d50479` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:49.857183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b521ebc-b13e-438e-9f56-079effc2efde admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e15f0e588042df9a7502c9f8d50479)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:49.859421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b521ebc-b13e-438e-9f56-079effc2efde admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:49.936283 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0b521ebc-b13e-438e-9f56-079effc2efde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e15f0e588042df9a7502c9f8d50479'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:49.951548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0b521ebc-b13e-438e-9f56-079effc2efde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e15f0e588042df9a7502c9f8d50479'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:49.961187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0b521ebc-b13e-438e-9f56-079effc2efde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e15f0e588042df9a7502c9f8d50479'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:49.962037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0b521ebc-b13e-438e-9f56-079effc2efde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e15f0e588042df9a7502c9f8d50479'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:49.962997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0b521ebc-b13e-438e-9f56-079effc2efde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e15f0e588042df9a7502c9f8d50479'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:49.979163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1129/2251] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:12:49 2022] DELETE /identity/v3/users/c7e15f0e588042df9a7502c9f8d50479 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:12:49.984191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57a30f-ba60-43f3-84e7-173e5793ceea None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:49.984432 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57a30f-ba60-43f3-84e7-173e5793ceea None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:49.984704 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57a30f-ba60-43f3-84e7-173e5793ceea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:50.015792 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1d57a30f-ba60-43f3-84e7-173e5793ceea None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:50.017061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1d57a30f-ba60-43f3-84e7-173e5793ceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:50.083094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1123/2252] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:12:50.100051 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b521ebc-b13e-438e-9f56-079effc2efde admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:50.111495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0b521ebc-b13e-438e-9f56-079effc2efde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:50.193700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b521ebc-b13e-438e-9f56-079effc2efde admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:50.197725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214d69-e7f1-448c-a5ef-ef512f4836e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:50.198398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214d69-e7f1-448c-a5ef-ef512f4836e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:50.198840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214d69-e7f1-448c-a5ef-ef512f4836e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:50.199131 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214d69-e7f1-448c-a5ef-ef512f4836e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:50.208883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8214d69-e7f1-448c-a5ef-ef512f4836e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:50.210507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8214d69-e7f1-448c-a5ef-ef512f4836e7 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:50.221254 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1130/2253] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:12:50.405914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57a30f-ba60-43f3-84e7-173e5793ceea None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:50.408265 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1d57a30f-ba60-43f3-84e7-173e5793ceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:50.426214 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57a30f-ba60-43f3-84e7-173e5793ceea None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:50.433536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f627d4-21c3-4163-90bc-54ae13b5496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:50.435956 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f627d4-21c3-4163-90bc-54ae13b5496e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:50.436407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f627d4-21c3-4163-90bc-54ae13b5496e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:50.436862 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f627d4-21c3-4163-90bc-54ae13b5496e admin admin] PATH_INFO: `/v3/projects/d440db1af37449b1a5d268506dc5bf11` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:50.439365 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f627d4-21c3-4163-90bc-54ae13b5496e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d440db1af37449b1a5d268506dc5bf11)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:50.442547 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f627d4-21c3-4163-90bc-54ae13b5496e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:50.512746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-48f627d4-21c3-4163-90bc-54ae13b5496e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd440db1af37449b1a5d268506dc5bf11', 'request_id': 'req-48f627d4-21c3-4163-90bc-54ae13b5496e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:50.524606 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-48f627d4-21c3-4163-90bc-54ae13b5496e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd440db1af37449b1a5d268506dc5bf11', 'request_id': 'req-48f627d4-21c3-4163-90bc-54ae13b5496e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:50.534342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-48f627d4-21c3-4163-90bc-54ae13b5496e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd440db1af37449b1a5d268506dc5bf11', 'request_id': 'req-48f627d4-21c3-4163-90bc-54ae13b5496e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:50.546943 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-48f627d4-21c3-4163-90bc-54ae13b5496e admin admin] The token cache is being invalidate because project d440db1af37449b1a5d268506dc5bf11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:12:50.547223 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-48f627d4-21c3-4163-90bc-54ae13b5496e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:50.548755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-48f627d4-21c3-4163-90bc-54ae13b5496e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:50.550762 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1124/2254] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:12:50 2022] DELETE /identity/v3/projects/d440db1af37449b1a5d268506dc5bf11 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:12:51.564159 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214d69-e7f1-448c-a5ef-ef512f4836e7 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:51.566406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f8214d69-e7f1-448c-a5ef-ef512f4836e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:51.592787 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214d69-e7f1-448c-a5ef-ef512f4836e7 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:51.690899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b9df5-7506-40e3-9db2-1201439cabd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:51.691833 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9df5-7506-40e3-9db2-1201439cabd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:51.692115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9df5-7506-40e3-9db2-1201439cabd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:51.692385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9df5-7506-40e3-9db2-1201439cabd3 admin admin] PATH_INFO: `/v3/users/c3feefbd066d49148171c392838b4e15` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:51.695950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b9df5-7506-40e3-9db2-1201439cabd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3feefbd066d49148171c392838b4e15)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:51.697879 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b9df5-7506-40e3-9db2-1201439cabd3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:51.758863 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-220b9df5-7506-40e3-9db2-1201439cabd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3feefbd066d49148171c392838b4e15'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:51.774004 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-220b9df5-7506-40e3-9db2-1201439cabd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3feefbd066d49148171c392838b4e15'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:51.783769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-220b9df5-7506-40e3-9db2-1201439cabd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3feefbd066d49148171c392838b4e15'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:51.785210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-220b9df5-7506-40e3-9db2-1201439cabd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3feefbd066d49148171c392838b4e15'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:51.786324 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-220b9df5-7506-40e3-9db2-1201439cabd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3feefbd066d49148171c392838b4e15'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:51.808996 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1131/2255] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:12:51 2022] DELETE /identity/v3/users/c3feefbd066d49148171c392838b4e15 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:12:52.085118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f627d4-21c3-4163-90bc-54ae13b5496e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:52.086593 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-48f627d4-21c3-4163-90bc-54ae13b5496e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:52.100598 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f627d4-21c3-4163-90bc-54ae13b5496e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:52.167786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6c396-daef-4528-892f-b62704c293cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:52.168692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6c396-daef-4528-892f-b62704c293cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:52.168972 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6c396-daef-4528-892f-b62704c293cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:52.169245 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6c396-daef-4528-892f-b62704c293cd admin admin] PATH_INFO: `/v3/projects/b5858756d2b74673a765c1d2e6adf280` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:52.170440 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6c396-daef-4528-892f-b62704c293cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5858756d2b74673a765c1d2e6adf280)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:52.172500 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6c396-daef-4528-892f-b62704c293cd admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:52.234499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-51d6c396-daef-4528-892f-b62704c293cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5858756d2b74673a765c1d2e6adf280', 'request_id': 'req-51d6c396-daef-4528-892f-b62704c293cd'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:52.249130 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-51d6c396-daef-4528-892f-b62704c293cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5858756d2b74673a765c1d2e6adf280', 'request_id': 'req-51d6c396-daef-4528-892f-b62704c293cd'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:52.260095 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-51d6c396-daef-4528-892f-b62704c293cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5858756d2b74673a765c1d2e6adf280', 'request_id': 'req-51d6c396-daef-4528-892f-b62704c293cd'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:52.274573 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-51d6c396-daef-4528-892f-b62704c293cd admin admin] The token cache is being invalidate because project b5858756d2b74673a765c1d2e6adf280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:12:52.274952 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-51d6c396-daef-4528-892f-b62704c293cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:52.275811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-51d6c396-daef-4528-892f-b62704c293cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:12:52.277563 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1125/2256] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:12:52 2022] DELETE /identity/v3/projects/b5858756d2b74673a765c1d2e6adf280 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:12:52.286190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c9c16-bafa-4cf4-8ac3-6bf38900e323 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:52.286556 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c9c16-bafa-4cf4-8ac3-6bf38900e323 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:52.286842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c9c16-bafa-4cf4-8ac3-6bf38900e323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:52.342495 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-272c9c16-bafa-4cf4-8ac3-6bf38900e323 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:52.344510 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-272c9c16-bafa-4cf4-8ac3-6bf38900e323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:52.405062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1132/2257] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:52.413727 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40fd9b-a715-42b2-abc7-6fc3972f6689 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:52.414285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40fd9b-a715-42b2-abc7-6fc3972f6689 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:52.414790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40fd9b-a715-42b2-abc7-6fc3972f6689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:52.434282 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-fa40fd9b-a715-42b2-abc7-6fc3972f6689 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:52.435575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-fa40fd9b-a715-42b2-abc7-6fc3972f6689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:52.444558 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1126/2258] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:52.448721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c9c16-bafa-4cf4-8ac3-6bf38900e323 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:52.458383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c9c16-bafa-4cf4-8ac3-6bf38900e323 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:52.462935 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882480e5-7ad1-4d05-a23b-a519e77e1ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:52.463587 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882480e5-7ad1-4d05-a23b-a519e77e1ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:52.463906 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882480e5-7ad1-4d05-a23b-a519e77e1ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:52.464184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882480e5-7ad1-4d05-a23b-a519e77e1ae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:52.464911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882480e5-7ad1-4d05-a23b-a519e77e1ae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:12:52.465221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882480e5-7ad1-4d05-a23b-a519e77e1ae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:52.466827 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882480e5-7ad1-4d05-a23b-a519e77e1ae0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:52.478716 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1133/2259] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:12:52.483057 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40fd9b-a715-42b2-abc7-6fc3972f6689 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:52.493182 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40fd9b-a715-42b2-abc7-6fc3972f6689 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:52.497753 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caf607-f5c0-425f-aad5-15f1083a6fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:52.498433 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caf607-f5c0-425f-aad5-15f1083a6fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:52.498714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caf607-f5c0-425f-aad5-15f1083a6fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:52.498989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caf607-f5c0-425f-aad5-15f1083a6fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:52.499756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caf607-f5c0-425f-aad5-15f1083a6fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:52.502350 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caf607-f5c0-425f-aad5-15f1083a6fb7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:52.531050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1127/2260] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:12:52 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:12:52.533631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882480e5-7ad1-4d05-a23b-a519e77e1ae0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:52.545405 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882480e5-7ad1-4d05-a23b-a519e77e1ae0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:52.601612 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e882b-26d1-4b37-9d01-ab3607173545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:52.602365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e882b-26d1-4b37-9d01-ab3607173545 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:52.602645 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e882b-26d1-4b37-9d01-ab3607173545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:52.602918 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e882b-26d1-4b37-9d01-ab3607173545 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:52.603628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e882b-26d1-4b37-9d01-ab3607173545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:52.605564 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e882b-26d1-4b37-9d01-ab3607173545 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:52.626378 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1134/2261] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:12:52 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:12:52.630586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caf607-f5c0-425f-aad5-15f1083a6fb7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:52.641240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caf607-f5c0-425f-aad5-15f1083a6fb7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:52.646716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8500e-83d8-4cb3-85f0-12c995409ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:52.647367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8500e-83d8-4cb3-85f0-12c995409ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:52.647674 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8500e-83d8-4cb3-85f0-12c995409ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:52.647951 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8500e-83d8-4cb3-85f0-12c995409ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:52.648667 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8500e-83d8-4cb3-85f0-12c995409ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:52.650251 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8500e-83d8-4cb3-85f0-12c995409ae0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:52.662773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1128/2262] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:12:52.665833 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e882b-26d1-4b37-9d01-ab3607173545 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:52.676328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e882b-26d1-4b37-9d01-ab3607173545 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:52.681037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371f92b-7287-4fbb-a1b2-793643d3cb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:52.681788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371f92b-7287-4fbb-a1b2-793643d3cb19 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:52.682080 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371f92b-7287-4fbb-a1b2-793643d3cb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:52.682354 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371f92b-7287-4fbb-a1b2-793643d3cb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:52.683078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371f92b-7287-4fbb-a1b2-793643d3cb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:52.684713 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371f92b-7287-4fbb-a1b2-793643d3cb19 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:52.695750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1135/2263] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:12:52.700252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8500e-83d8-4cb3-85f0-12c995409ae0 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:52.711881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8500e-83d8-4cb3-85f0-12c995409ae0 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:52.716659 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb38c2-4a60-4d25-bd93-c092c7d3fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:52.717536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb38c2-4a60-4d25-bd93-c092c7d3fc7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:52.717818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb38c2-4a60-4d25-bd93-c092c7d3fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:52.718092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb38c2-4a60-4d25-bd93-c092c7d3fc7f admin admin] PATH_INFO: `/v3/projects/8fb2bceba70b4deebef4f0e2f2e825b2/users/6dedc2af7b66481a9499133e7692e642/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:52.733647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb38c2-4a60-4d25-bd93-c092c7d3fc7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb2bceba70b4deebef4f0e2f2e825b2, user_id=6dedc2af7b66481a9499133e7692e642, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:52.737413 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb38c2-4a60-4d25-bd93-c092c7d3fc7f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:52.750576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1129/2264] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:12:52 2022] PUT /identity/v3/projects/8fb2bceba70b4deebef4f0e2f2e825b2/users/6dedc2af7b66481a9499133e7692e642/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:12:52.760896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd9215-fe45-46cd-8b85-68615afb180b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:52.761190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd9215-fe45-46cd-8b85-68615afb180b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:52.761485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd9215-fe45-46cd-8b85-68615afb180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:52.787978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2bdd9215-fe45-46cd-8b85-68615afb180b None None] MFA Rules not processed for user `6dedc2af7b66481a9499133e7692e642`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:52.789184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2bdd9215-fe45-46cd-8b85-68615afb180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:52.849808 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1136/2265] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:12:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:52.860980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb38c2-4a60-4d25-bd93-c092c7d3fc7f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:52.862701 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-77cb38c2-4a60-4d25-bd93-c092c7d3fc7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:52.918254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb38c2-4a60-4d25-bd93-c092c7d3fc7f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:52.921854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27150bcc-91d6-48bf-88e5-ddd76c684c1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25519cdc25244a0b039ce3097c328d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:52.922486 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27150bcc-91d6-48bf-88e5-ddd76c684c1d service glance] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:52.922767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27150bcc-91d6-48bf-88e5-ddd76c684c1d service glance] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:52.923358 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27150bcc-91d6-48bf-88e5-ddd76c684c1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:52.931126 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27150bcc-91d6-48bf-88e5-ddd76c684c1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:52.932576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27150bcc-91d6-48bf-88e5-ddd76c684c1d service glance] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:52.941816 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1130/2266] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:12:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:12:55.353084 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51be333-374f-4427-9588-6188fd44fa8d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:55.353656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51be333-374f-4427-9588-6188fd44fa8d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:55.353882 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51be333-374f-4427-9588-6188fd44fa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:55.374068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f51be333-374f-4427-9588-6188fd44fa8d None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:12:55.375321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f51be333-374f-4427-9588-6188fd44fa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:55.443374 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1137/2267] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 17:12:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:12:55.456051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27150bcc-91d6-48bf-88e5-ddd76c684c1d service glance] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:12:55.457522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-27150bcc-91d6-48bf-88e5-ddd76c684c1d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:12:55.541839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27150bcc-91d6-48bf-88e5-ddd76c684c1d service glance] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:12:55.547560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2957777-df86-4107-9e58-7f94801ec9bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:12:55.548235 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2957777-df86-4107-9e58-7f94801ec9bd service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:12:55.548517 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2957777-df86-4107-9e58-7f94801ec9bd service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:12:55.548793 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2957777-df86-4107-9e58-7f94801ec9bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:12:55.558187 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2957777-df86-4107-9e58-7f94801ec9bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:12:55.559838 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2957777-df86-4107-9e58-7f94801ec9bd service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:12:55.569068 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1131/2268] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:12:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:13:12.203847 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8cdac-eb48-4782-a2fe-21183300350c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:12.204381 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8cdac-eb48-4782-a2fe-21183300350c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:12.204381 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8cdac-eb48-4782-a2fe-21183300350c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:12.223534 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-97a8cdac-eb48-4782-a2fe-21183300350c None None] MFA Rules not processed for user `d7b9ce69a40845c5adef40e3e0355747`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:13:12.224758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-97a8cdac-eb48-4782-a2fe-21183300350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:12.279674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1138/2269] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:13:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:13:12.879024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9e7ce-b171-4e75-9c67-2b6196fa4923 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:12.879997 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9e7ce-b171-4e75-9c67-2b6196fa4923 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:12.880495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9e7ce-b171-4e75-9c67-2b6196fa4923 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:12.882511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1132/2270] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 17:13:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:13:12.893513 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27358c4d-d4c4-4f6c-a0d4-9d7a4e9e9709 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:12.893800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27358c4d-d4c4-4f6c-a0d4-9d7a4e9e9709 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:12.894074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27358c4d-d4c4-4f6c-a0d4-9d7a4e9e9709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:12.949900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-27358c4d-d4c4-4f6c-a0d4-9d7a4e9e9709 None None] MFA Rules not processed for user `5becb135afbd43e9bc0b1347ba04e2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:13:12.951112 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-27358c4d-d4c4-4f6c-a0d4-9d7a4e9e9709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:13.037484 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1139/2271] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 17:13:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:13:13.050897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9e7ce-b171-4e75-9c67-2b6196fa4923 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:13:13.062846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9e7ce-b171-4e75-9c67-2b6196fa4923 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:13:13.067099 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2ba9c-ae42-4eeb-960e-ad45f382dc30 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25519cdc25244a0b039ce3097c328d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:13:13.067800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2ba9c-ae42-4eeb-960e-ad45f382dc30 service glance] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:13.068083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2ba9c-ae42-4eeb-960e-ad45f382dc30 service glance] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:13.068360 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2ba9c-ae42-4eeb-960e-ad45f382dc30 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:13.080454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2ba9c-ae42-4eeb-960e-ad45f382dc30 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:13:13.081739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2ba9c-ae42-4eeb-960e-ad45f382dc30 service glance] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:13:13.098477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1133/2272] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:13:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:13:13.176225 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8652c25-e398-46a9-b76b-bc002e935f6e None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:13.176566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8652c25-e398-46a9-b76b-bc002e935f6e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:13.176850 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8652c25-e398-46a9-b76b-bc002e935f6e None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:13.178911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1140/2273] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 17:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:13:13.184755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383d665-9959-4506-aecc-033685d6d67b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:13.185049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383d665-9959-4506-aecc-033685d6d67b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:13.185379 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383d665-9959-4506-aecc-033685d6d67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:13.207991 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f383d665-9959-4506-aecc-033685d6d67b None None] MFA Rules not processed for user `5819e022286b454e9e2f23d975c6e921`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:13:13.209255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f383d665-9959-4506-aecc-033685d6d67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:13.262136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1134/2274] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 17:13:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:13:13.274697 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8652c25-e398-46a9-b76b-bc002e935f6e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:13:13.276489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d8652c25-e398-46a9-b76b-bc002e935f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:13.290051 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8652c25-e398-46a9-b76b-bc002e935f6e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:13:13.295581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29e43-c1f9-4412-ab73-fd6cb73de98c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:13:13.296280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29e43-c1f9-4412-ab73-fd6cb73de98c service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:13.296620 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29e43-c1f9-4412-ab73-fd6cb73de98c service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:13.296908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29e43-c1f9-4412-ab73-fd6cb73de98c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:13.306547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c29e43-c1f9-4412-ab73-fd6cb73de98c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:13:13.308016 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c29e43-c1f9-4412-ab73-fd6cb73de98c service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:13:13.318864 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1141/2275] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:13:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:13:13.403645 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3d2f7-3c07-436e-9886-5d76c362efd2 None None] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:13.403942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3d2f7-3c07-436e-9886-5d76c362efd2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:13.404238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3d2f7-3c07-436e-9886-5d76c362efd2 None None] PATH_INFO: `/` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:13.405618 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1135/2276] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 17:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:13:13.411640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e75cff-f580-4aad-88b9-b2f91dda2999 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:13.411932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e75cff-f580-4aad-88b9-b2f91dda2999 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:13.412209 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e75cff-f580-4aad-88b9-b2f91dda2999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:13.431687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c9e75cff-f580-4aad-88b9-b2f91dda2999 None None] MFA Rules not processed for user `5becb135afbd43e9bc0b1347ba04e2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:13:13.432867 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c9e75cff-f580-4aad-88b9-b2f91dda2999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:13.443111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1142/2277] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 17:13:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:13:13.453599 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3d2f7-3c07-436e-9886-5d76c362efd2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:13:13.464502 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3d2f7-3c07-436e-9886-5d76c362efd2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:13:13.468063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5ad37-40a9-43c3-b025-f63b2790fa16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:13:13.468687 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5ad37-40a9-43c3-b025-f63b2790fa16 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:13.468964 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5ad37-40a9-43c3-b025-f63b2790fa16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:13.469237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5ad37-40a9-43c3-b025-f63b2790fa16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:13.479116 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5ad37-40a9-43c3-b025-f63b2790fa16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:13:13.480583 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5ad37-40a9-43c3-b025-f63b2790fa16 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:13:13.491771 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1136/2278] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:13:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:13:16.779316 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4fabe-d802-4228-bf96-28a27bc1bf36 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:16.780272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4fabe-d802-4228-bf96-28a27bc1bf36 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:16.780708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4fabe-d802-4228-bf96-28a27bc1bf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:16.833679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1be4fabe-d802-4228-bf96-28a27bc1bf36 None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:13:16.836132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1be4fabe-d802-4228-bf96-28a27bc1bf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:16.857936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1143/2279] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 17:13:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:13:16.879847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5ad37-40a9-43c3-b025-f63b2790fa16 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:13:16.903123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5ad37-40a9-43c3-b025-f63b2790fa16 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:13:16.910776 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aab8c-6597-478e-9810-fee872c313a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:13:16.911654 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aab8c-6597-478e-9810-fee872c313a9 service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:16.912103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aab8c-6597-478e-9810-fee872c313a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:16.912559 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aab8c-6597-478e-9810-fee872c313a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:16.921507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8aab8c-6597-478e-9810-fee872c313a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:13:16.923939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8aab8c-6597-478e-9810-fee872c313a9 service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:13:16.935237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1137/2280] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:13:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:13:28.708500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4fabe-d802-4228-bf96-28a27bc1bf36 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:13:28.779530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4fabe-d802-4228-bf96-28a27bc1bf36 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:13:28.785262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf68074-23ed-4dee-b538-c3d4b251ad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:13:28.786190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf68074-23ed-4dee-b538-c3d4b251ad30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:28.786475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf68074-23ed-4dee-b538-c3d4b251ad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:28.786750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf68074-23ed-4dee-b538-c3d4b251ad30 admin admin] PATH_INFO: `/v3/users/6dedc2af7b66481a9499133e7692e642` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:28.787977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf68074-23ed-4dee-b538-c3d4b251ad30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dedc2af7b66481a9499133e7692e642)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:13:28.789945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf68074-23ed-4dee-b538-c3d4b251ad30 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:13:28.854637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-adf68074-23ed-4dee-b538-c3d4b251ad30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dedc2af7b66481a9499133e7692e642'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:13:28.868121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-adf68074-23ed-4dee-b538-c3d4b251ad30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dedc2af7b66481a9499133e7692e642'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:13:28.874875 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-adf68074-23ed-4dee-b538-c3d4b251ad30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dedc2af7b66481a9499133e7692e642'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:13:28.875970 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-adf68074-23ed-4dee-b538-c3d4b251ad30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dedc2af7b66481a9499133e7692e642'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:13:28.876737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-adf68074-23ed-4dee-b538-c3d4b251ad30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dedc2af7b66481a9499133e7692e642'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:13:28.890684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1144/2281] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:13:28 2022] DELETE /identity/v3/users/6dedc2af7b66481a9499133e7692e642 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:13:28.896568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71993d88-f28d-461c-acc9-6a7c3d128ffe None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:28.897113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71993d88-f28d-461c-acc9-6a7c3d128ffe None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:28.897288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71993d88-f28d-461c-acc9-6a7c3d128ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:28.918237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-71993d88-f28d-461c-acc9-6a7c3d128ffe None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:13:28.919420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-71993d88-f28d-461c-acc9-6a7c3d128ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:28.980046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1138/2282] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:13:28.989872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf68074-23ed-4dee-b538-c3d4b251ad30 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:13:28.991297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-adf68074-23ed-4dee-b538-c3d4b251ad30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:29.050191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf68074-23ed-4dee-b538-c3d4b251ad30 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:13:29.053877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e43ae-0da3-4dc4-b1fa-866e1ee6c1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:13:29.054547 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e43ae-0da3-4dc4-b1fa-866e1ee6c1da service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:29.054824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e43ae-0da3-4dc4-b1fa-866e1ee6c1da service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:29.055094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e43ae-0da3-4dc4-b1fa-866e1ee6c1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:29.064828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e43ae-0da3-4dc4-b1fa-866e1ee6c1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:13:29.066259 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e43ae-0da3-4dc4-b1fa-866e1ee6c1da service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:13:29.075335 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1145/2283] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:13:29.334711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71993d88-f28d-461c-acc9-6a7c3d128ffe None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:13:29.336204 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-71993d88-f28d-461c-acc9-6a7c3d128ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:29.350481 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71993d88-f28d-461c-acc9-6a7c3d128ffe None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:13:29.355174 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:13:29.356094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:29.356406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:29.356678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24 admin admin] PATH_INFO: `/v3/projects/8fb2bceba70b4deebef4f0e2f2e825b2` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:29.357858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb2bceba70b4deebef4f0e2f2e825b2)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:13:29.359821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:13:29.405826 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb2bceba70b4deebef4f0e2f2e825b2', 'request_id': 'req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:13:29.411368 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb2bceba70b4deebef4f0e2f2e825b2', 'request_id': 'req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:13:29.418495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb2bceba70b4deebef4f0e2f2e825b2', 'request_id': 'req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:13:29.429668 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24 admin admin] The token cache is being invalidate because project 8fb2bceba70b4deebef4f0e2f2e825b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:13:29.429986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:13:29.430614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:13:29.432182 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1139/2284] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:13:29 2022] DELETE /identity/v3/projects/8fb2bceba70b4deebef4f0e2f2e825b2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:13:33.885252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e43ae-0da3-4dc4-b1fa-866e1ee6c1da service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:13:33.886634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cd5e43ae-0da3-4dc4-b1fa-866e1ee6c1da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:33.898122 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e43ae-0da3-4dc4-b1fa-866e1ee6c1da service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:13:33.949009 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e124431-46ee-4f01-9e33-ea47e9a32cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:13:33.949659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e124431-46ee-4f01-9e33-ea47e9a32cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:33.949941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e124431-46ee-4f01-9e33-ea47e9a32cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:33.950216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e124431-46ee-4f01-9e33-ea47e9a32cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:33.952134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1e124431-46ee-4f01-9e33-ea47e9a32cf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:34.012954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e124431-46ee-4f01-9e33-ea47e9a32cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:13:34.014388 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e124431-46ee-4f01-9e33-ea47e9a32cf1 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:13:34.025682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1146/2285] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:13:33 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:13:36.123650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:13:36.127207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:36.267861 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ce3a2-fa94-4ec8-a3f3-b5e39dc52e24 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:13:36.268775 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f49ddc-7e8e-4a04-b917-e120b7dcd6f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7730d6cad2ba40c19cb671268cf04d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:13:36.269443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f49ddc-7e8e-4a04-b917-e120b7dcd6f8 service placement] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:36.269728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f49ddc-7e8e-4a04-b917-e120b7dcd6f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:36.270007 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f49ddc-7e8e-4a04-b917-e120b7dcd6f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:36.271971 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-13f49ddc-7e8e-4a04-b917-e120b7dcd6f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:36.288641 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f49ddc-7e8e-4a04-b917-e120b7dcd6f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:13:36.290570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f49ddc-7e8e-4a04-b917-e120b7dcd6f8 service placement] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:13:36.317145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1140/2286] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:13:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:13:37.735629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526bc83-ab29-43ca-8d12-10d5123cab80 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:37.736143 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526bc83-ab29-43ca-8d12-10d5123cab80 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:37.736241 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526bc83-ab29-43ca-8d12-10d5123cab80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:37.753877 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f526bc83-ab29-43ca-8d12-10d5123cab80 None None] MFA Rules not processed for user `61daaf70d25c4e1592fcb2f4feafff86`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:13:37.755042 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f526bc83-ab29-43ca-8d12-10d5123cab80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:37.806820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1147/2287] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:13:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:13:49.173929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521a506-3010-46f2-936d-57a9aa04f447 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:49.174386 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521a506-3010-46f2-936d-57a9aa04f447 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:49.174608 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521a506-3010-46f2-936d-57a9aa04f447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:49.191902 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6521a506-3010-46f2-936d-57a9aa04f447 None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:13:49.193085 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6521a506-3010-46f2-936d-57a9aa04f447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:49.245494 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1141/2288] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 17 17:13:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:13:49.257894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526bc83-ab29-43ca-8d12-10d5123cab80 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:13:49.259325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f526bc83-ab29-43ca-8d12-10d5123cab80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:13:49.340927 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526bc83-ab29-43ca-8d12-10d5123cab80 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:13:49.348050 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a95c84-aa15-4a06-9169-017d39a9f5f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:13:49.348881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a95c84-aa15-4a06-9169-017d39a9f5f5 service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:13:49.349267 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a95c84-aa15-4a06-9169-017d39a9f5f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:13:49.349660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a95c84-aa15-4a06-9169-017d39a9f5f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:13:49.358801 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a95c84-aa15-4a06-9169-017d39a9f5f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:13:49.360755 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a95c84-aa15-4a06-9169-017d39a9f5f5 service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:13:49.368719 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1148/2289] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:13:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:14:26.729202 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521a506-3010-46f2-936d-57a9aa04f447 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:26.731535 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6521a506-3010-46f2-936d-57a9aa04f447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:14:26.821484 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521a506-3010-46f2-936d-57a9aa04f447 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:26.826312 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1bf5f-a63c-4004-98ac-b335510048b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:26.827185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1bf5f-a63c-4004-98ac-b335510048b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:26.827459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1bf5f-a63c-4004-98ac-b335510048b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:26.827763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1bf5f-a63c-4004-98ac-b335510048b6 admin admin] PATH_INFO: `/v3/users/d7b9ce69a40845c5adef40e3e0355747` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:26.828965 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1bf5f-a63c-4004-98ac-b335510048b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b9ce69a40845c5adef40e3e0355747)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:26.830910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1bf5f-a63c-4004-98ac-b335510048b6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:26.876112 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-77b1bf5f-a63c-4004-98ac-b335510048b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b9ce69a40845c5adef40e3e0355747'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:14:26.876900 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-77b1bf5f-a63c-4004-98ac-b335510048b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b9ce69a40845c5adef40e3e0355747'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:14:26.889891 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-77b1bf5f-a63c-4004-98ac-b335510048b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b9ce69a40845c5adef40e3e0355747'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:14:26.896960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-77b1bf5f-a63c-4004-98ac-b335510048b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b9ce69a40845c5adef40e3e0355747'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:14:26.897667 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-77b1bf5f-a63c-4004-98ac-b335510048b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b9ce69a40845c5adef40e3e0355747'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:14:26.911375 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1142/2290] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:14:26 2022] DELETE /identity/v3/users/d7b9ce69a40845c5adef40e3e0355747 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:14:27.093052 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a95c84-aa15-4a06-9169-017d39a9f5f5 service swift] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:27.122952 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a95c84-aa15-4a06-9169-017d39a9f5f5 service swift] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:27.187726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba289cac-3d9d-4040-be12-dc145c69d0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:27.188845 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba289cac-3d9d-4040-be12-dc145c69d0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:27.189261 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba289cac-3d9d-4040-be12-dc145c69d0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:27.189601 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba289cac-3d9d-4040-be12-dc145c69d0fb admin admin] PATH_INFO: `/v3/projects/260311245b60460283c01ebc87cb5bc2` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:27.190998 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba289cac-3d9d-4040-be12-dc145c69d0fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=260311245b60460283c01ebc87cb5bc2)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:27.193035 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba289cac-3d9d-4040-be12-dc145c69d0fb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:27.244565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba289cac-3d9d-4040-be12-dc145c69d0fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260311245b60460283c01ebc87cb5bc2', 'request_id': 'req-ba289cac-3d9d-4040-be12-dc145c69d0fb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:14:27.252490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba289cac-3d9d-4040-be12-dc145c69d0fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260311245b60460283c01ebc87cb5bc2', 'request_id': 'req-ba289cac-3d9d-4040-be12-dc145c69d0fb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:14:27.261899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba289cac-3d9d-4040-be12-dc145c69d0fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260311245b60460283c01ebc87cb5bc2', 'request_id': 'req-ba289cac-3d9d-4040-be12-dc145c69d0fb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:14:27.275361 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba289cac-3d9d-4040-be12-dc145c69d0fb admin admin] The token cache is being invalidate because project 260311245b60460283c01ebc87cb5bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:14:27.275674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba289cac-3d9d-4040-be12-dc145c69d0fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:14:27.276330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ba289cac-3d9d-4040-be12-dc145c69d0fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:14:27.277893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1149/2291] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:14:27 2022] DELETE /identity/v3/projects/260311245b60460283c01ebc87cb5bc2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:14:27.283414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea44078-320c-470b-ac1d-b4686d388e12 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:27.283736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea44078-320c-470b-ac1d-b4686d388e12 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:27.284532 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea44078-320c-470b-ac1d-b4686d388e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:27.302677 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2ea44078-320c-470b-ac1d-b4686d388e12 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:14:27.303931 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2ea44078-320c-470b-ac1d-b4686d388e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:14:27.365758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1143/2292] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:14:27.373849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140b49c-ed1c-415c-8803-231fed404d62 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:27.374187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140b49c-ed1c-415c-8803-231fed404d62 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:27.374474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140b49c-ed1c-415c-8803-231fed404d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:27.400058 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0140b49c-ed1c-415c-8803-231fed404d62 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:14:27.401814 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0140b49c-ed1c-415c-8803-231fed404d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:14:27.414545 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1150/2293] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:14:27.419254 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea44078-320c-470b-ac1d-b4686d388e12 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:27.429949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea44078-320c-470b-ac1d-b4686d388e12 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:27.434755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3a4ce-d6ac-4907-a64f-d7e9464cfdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:27.435412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3a4ce-d6ac-4907-a64f-d7e9464cfdde admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:27.435733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3a4ce-d6ac-4907-a64f-d7e9464cfdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:27.436012 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3a4ce-d6ac-4907-a64f-d7e9464cfdde admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:27.436744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3a4ce-d6ac-4907-a64f-d7e9464cfdde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:14:27.437056 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3a4ce-d6ac-4907-a64f-d7e9464cfdde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:27.438660 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3a4ce-d6ac-4907-a64f-d7e9464cfdde admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:27.452784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1144/2294] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:14:27.457805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140b49c-ed1c-415c-8803-231fed404d62 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:27.468539 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140b49c-ed1c-415c-8803-231fed404d62 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:27.473245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8688dee-4d2b-4bcc-ada1-e033626bcaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:27.473896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8688dee-4d2b-4bcc-ada1-e033626bcaea admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:27.474209 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8688dee-4d2b-4bcc-ada1-e033626bcaea admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:27.474479 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8688dee-4d2b-4bcc-ada1-e033626bcaea admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:27.475172 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8688dee-4d2b-4bcc-ada1-e033626bcaea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:27.477110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8688dee-4d2b-4bcc-ada1-e033626bcaea admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:27.505168 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1151/2295] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:14:27 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:14:27.509322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3a4ce-d6ac-4907-a64f-d7e9464cfdde admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:27.519436 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3a4ce-d6ac-4907-a64f-d7e9464cfdde admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:27.577195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255582e-3f0c-4486-89fa-efc6324e0e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:27.578183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255582e-3f0c-4486-89fa-efc6324e0e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:27.578650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255582e-3f0c-4486-89fa-efc6324e0e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:27.579051 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255582e-3f0c-4486-89fa-efc6324e0e70 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:27.579952 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255582e-3f0c-4486-89fa-efc6324e0e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:27.583035 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255582e-3f0c-4486-89fa-efc6324e0e70 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:27.603900 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1145/2296] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:14:27 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:14:27.608205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8688dee-4d2b-4bcc-ada1-e033626bcaea admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:27.621243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8688dee-4d2b-4bcc-ada1-e033626bcaea admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:27.626628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6ee56-58af-4537-b4c9-80516f9e30f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:27.627426 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6ee56-58af-4537-b4c9-80516f9e30f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:27.629040 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6ee56-58af-4537-b4c9-80516f9e30f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:27.629433 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6ee56-58af-4537-b4c9-80516f9e30f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:27.630281 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6ee56-58af-4537-b4c9-80516f9e30f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:27.632059 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6ee56-58af-4537-b4c9-80516f9e30f4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:27.644600 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1152/2297] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:14:27.649525 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255582e-3f0c-4486-89fa-efc6324e0e70 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:27.662019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255582e-3f0c-4486-89fa-efc6324e0e70 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:27.670140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913dc5e-abd3-472f-9afa-78cada2ede53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:27.671353 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913dc5e-abd3-472f-9afa-78cada2ede53 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:27.671926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913dc5e-abd3-472f-9afa-78cada2ede53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:27.672417 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913dc5e-abd3-472f-9afa-78cada2ede53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:27.674059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913dc5e-abd3-472f-9afa-78cada2ede53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:27.677837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913dc5e-abd3-472f-9afa-78cada2ede53 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:27.693332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1146/2298] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:14:27.698198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6ee56-58af-4537-b4c9-80516f9e30f4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:27.714022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6ee56-58af-4537-b4c9-80516f9e30f4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:27.721125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546e285-d916-4a20-80a0-517fd3baac57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:27.722994 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546e285-d916-4a20-80a0-517fd3baac57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:27.723739 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546e285-d916-4a20-80a0-517fd3baac57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:27.723905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546e285-d916-4a20-80a0-517fd3baac57 admin admin] PATH_INFO: `/v3/projects/b1528992e3c74c08b5c4192466f23852/users/38bdb5f8e08e49358f9f27e4f1ce167b/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:27.747078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546e285-d916-4a20-80a0-517fd3baac57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1528992e3c74c08b5c4192466f23852, user_id=38bdb5f8e08e49358f9f27e4f1ce167b, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:27.751568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546e285-d916-4a20-80a0-517fd3baac57 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:27.770287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1153/2299] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:14:27 2022] PUT /identity/v3/projects/b1528992e3c74c08b5c4192466f23852/users/38bdb5f8e08e49358f9f27e4f1ce167b/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:14:27.775518 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096c8f3-d47e-45d2-b8f9-5813eb7561e8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:27.776046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096c8f3-d47e-45d2-b8f9-5813eb7561e8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:27.776146 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096c8f3-d47e-45d2-b8f9-5813eb7561e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:27.796074 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-8096c8f3-d47e-45d2-b8f9-5813eb7561e8 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:14:27.797265 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-8096c8f3-d47e-45d2-b8f9-5813eb7561e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:14:27.862872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1147/2300] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:14:27.874099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546e285-d916-4a20-80a0-517fd3baac57 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:27.876550 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2546e285-d916-4a20-80a0-517fd3baac57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:14:27.939916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546e285-d916-4a20-80a0-517fd3baac57 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:27.944996 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ec7f0-7fbd-4be9-a37b-fc0c754682dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:27.945661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ec7f0-7fbd-4be9-a37b-fc0c754682dd service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:27.946006 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ec7f0-7fbd-4be9-a37b-fc0c754682dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:27.946294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ec7f0-7fbd-4be9-a37b-fc0c754682dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:27.956594 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ec7f0-7fbd-4be9-a37b-fc0c754682dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:27.958058 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ec7f0-7fbd-4be9-a37b-fc0c754682dd service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:27.968322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1154/2301] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:14:29.479982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacb4f2-7abb-4137-92ff-89bba0ada7d0 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:29.480856 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacb4f2-7abb-4137-92ff-89bba0ada7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:29.481312 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacb4f2-7abb-4137-92ff-89bba0ada7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:29.501560 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6dacb4f2-7abb-4137-92ff-89bba0ada7d0 None None] MFA Rules not processed for user `824915e26a724d938e5dd0a3c1f57932`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:14:29.502916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6dacb4f2-7abb-4137-92ff-89bba0ada7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:14:29.577068 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1148/2302] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:14:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:14:33.316549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2daa07-0cb5-46ba-9125-7f5067b88137 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:33.317487 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2daa07-0cb5-46ba-9125-7f5067b88137 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:33.317768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2daa07-0cb5-46ba-9125-7f5067b88137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:33.347683 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-da2daa07-0cb5-46ba-9125-7f5067b88137 None None] MFA Rules not processed for user `38bdb5f8e08e49358f9f27e4f1ce167b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:14:33.349307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-da2daa07-0cb5-46ba-9125-7f5067b88137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:14:33.436606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1155/2303] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:14:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:14:33.442192 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacb4f2-7abb-4137-92ff-89bba0ada7d0 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:33.459538 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacb4f2-7abb-4137-92ff-89bba0ada7d0 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:33.464470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b704f-7a18-4287-a3b9-f577a4c32ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:33.465156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b704f-7a18-4287-a3b9-f577a4c32ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:33.465432 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b704f-7a18-4287-a3b9-f577a4c32ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:33.465701 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b704f-7a18-4287-a3b9-f577a4c32ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:33.466542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b704f-7a18-4287-a3b9-f577a4c32ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:33.468361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b704f-7a18-4287-a3b9-f577a4c32ea9 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:33.495964 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1149/2304] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:14:33 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:14:33.499674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2daa07-0cb5-46ba-9125-7f5067b88137 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:33.511518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2daa07-0cb5-46ba-9125-7f5067b88137 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:33.568726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866894b-b401-4425-93c1-928149968015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:33.569412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866894b-b401-4425-93c1-928149968015 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:33.569695 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866894b-b401-4425-93c1-928149968015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:33.569972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866894b-b401-4425-93c1-928149968015 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:33.570688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866894b-b401-4425-93c1-928149968015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:33.572708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866894b-b401-4425-93c1-928149968015 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:33.598671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1156/2305] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:14:33 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:14:33.599818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b704f-7a18-4287-a3b9-f577a4c32ea9 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:33.610224 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b704f-7a18-4287-a3b9-f577a4c32ea9 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:33.615690 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d82bb9-afe4-4713-aec0-cd6d5607e22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:33.616334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d82bb9-afe4-4713-aec0-cd6d5607e22b admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:33.616621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d82bb9-afe4-4713-aec0-cd6d5607e22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:33.616896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d82bb9-afe4-4713-aec0-cd6d5607e22b admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:33.617627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d82bb9-afe4-4713-aec0-cd6d5607e22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:33.619294 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d82bb9-afe4-4713-aec0-cd6d5607e22b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:33.631048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1150/2306] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:14:33.635211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866894b-b401-4425-93c1-928149968015 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:33.645235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866894b-b401-4425-93c1-928149968015 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:33.649984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76d7cf-1dba-4f28-b04d-ebf657ae6e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:33.650916 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76d7cf-1dba-4f28-b04d-ebf657ae6e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:33.651198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76d7cf-1dba-4f28-b04d-ebf657ae6e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:33.651474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76d7cf-1dba-4f28-b04d-ebf657ae6e91 admin admin] PATH_INFO: `/v3/projects/7e342982d1b8446ebd34d3ec75b0ca09/users/1165d9b18b9e4778ac09458948a2488c/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:33.667512 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76d7cf-1dba-4f28-b04d-ebf657ae6e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e342982d1b8446ebd34d3ec75b0ca09, user_id=1165d9b18b9e4778ac09458948a2488c, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:33.670224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76d7cf-1dba-4f28-b04d-ebf657ae6e91 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:33.683689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1157/2307] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:14:33 2022] PUT /identity/v3/projects/7e342982d1b8446ebd34d3ec75b0ca09/users/1165d9b18b9e4778ac09458948a2488c/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:14:33.687657 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d82bb9-afe4-4713-aec0-cd6d5607e22b admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:33.697674 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d82bb9-afe4-4713-aec0-cd6d5607e22b admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:33.752755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52827eaf-59bd-4fd6-9859-a0ed8f885881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:33.753429 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52827eaf-59bd-4fd6-9859-a0ed8f885881 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:33.753734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52827eaf-59bd-4fd6-9859-a0ed8f885881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:33.754065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52827eaf-59bd-4fd6-9859-a0ed8f885881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:33.754801 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52827eaf-59bd-4fd6-9859-a0ed8f885881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:33.756436 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52827eaf-59bd-4fd6-9859-a0ed8f885881 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:33.766307 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1151/2308] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:14:33.770669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76d7cf-1dba-4f28-b04d-ebf657ae6e91 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:33.781923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76d7cf-1dba-4f28-b04d-ebf657ae6e91 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:33.788134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebc3b1-2092-401a-b02c-a3825f9b0148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:33.789125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebc3b1-2092-401a-b02c-a3825f9b0148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:33.789525 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebc3b1-2092-401a-b02c-a3825f9b0148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:33.789899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebc3b1-2092-401a-b02c-a3825f9b0148 admin admin] PATH_INFO: `/v3/projects/7e342982d1b8446ebd34d3ec75b0ca09/users/1165d9b18b9e4778ac09458948a2488c/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:33.792018 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebc3b1-2092-401a-b02c-a3825f9b0148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e342982d1b8446ebd34d3ec75b0ca09, user_id=1165d9b18b9e4778ac09458948a2488c, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:33.794780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebc3b1-2092-401a-b02c-a3825f9b0148 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:33.806553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1158/2309] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:14:33 2022] PUT /identity/v3/projects/7e342982d1b8446ebd34d3ec75b0ca09/users/1165d9b18b9e4778ac09458948a2488c/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:14:39.221334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf173b-4785-4a80-9047-158560278817 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:39.222228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf173b-4785-4a80-9047-158560278817 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:39.222511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf173b-4785-4a80-9047-158560278817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:39.265015 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6cbf173b-4785-4a80-9047-158560278817 None None] MFA Rules not processed for user `1165d9b18b9e4778ac09458948a2488c`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:14:39.266226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6cbf173b-4785-4a80-9047-158560278817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:14:39.358287 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1152/2310] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:14:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:14:39.373118 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebc3b1-2092-401a-b02c-a3825f9b0148 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:14:39.381224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-58ebc3b1-2092-401a-b02c-a3825f9b0148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:14:39.477084 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebc3b1-2092-401a-b02c-a3825f9b0148 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:14:39.483277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35e9fc-1558-4825-b573-2307bd87a4a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:14:39.484137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35e9fc-1558-4825-b573-2307bd87a4a9 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:39.484722 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35e9fc-1558-4825-b573-2307bd87a4a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:39.485000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35e9fc-1558-4825-b573-2307bd87a4a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:39.557940 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35e9fc-1558-4825-b573-2307bd87a4a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:14:39.560136 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35e9fc-1558-4825-b573-2307bd87a4a9 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:14:39.571919 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1159/2311] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:14:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:14:51.793487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa8766-db3c-4686-bea3-3fdcbfa37f43 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:51.793988 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa8766-db3c-4686-bea3-3fdcbfa37f43 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:51.794187 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa8766-db3c-4686-bea3-3fdcbfa37f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:51.812464 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6aaa8766-db3c-4686-bea3-3fdcbfa37f43 None None] MFA Rules not processed for user `86a0b6c88fe84ba0907d515fd9f38e72`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:14:51.813739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6aaa8766-db3c-4686-bea3-3fdcbfa37f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:14:51.872333 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1153/2312] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:14:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:14:57.120286 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25e0e0-0c5c-4fec-af51-28a3b280ab0d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:14:57.121606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25e0e0-0c5c-4fec-af51-28a3b280ab0d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:14:57.122333 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25e0e0-0c5c-4fec-af51-28a3b280ab0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:14:57.161145 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ee25e0e0-0c5c-4fec-af51-28a3b280ab0d None None] MFA Rules not processed for user `38bdb5f8e08e49358f9f27e4f1ce167b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:14:57.162352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ee25e0e0-0c5c-4fec-af51-28a3b280ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:14:57.180472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1160/2313] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:14:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:15:00.175624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a62ff-0241-4633-8834-3e507f33ac7e None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:00.176125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a62ff-0241-4633-8834-3e507f33ac7e None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:00.176125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a62ff-0241-4633-8834-3e507f33ac7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:00.204907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-db7a62ff-0241-4633-8834-3e507f33ac7e None None] MFA Rules not processed for user `61daaf70d25c4e1592fcb2f4feafff86`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:15:00.207227 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-db7a62ff-0241-4633-8834-3e507f33ac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:00.272713 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1154/2314] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:15:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:15:14.854725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25e0e0-0c5c-4fec-af51-28a3b280ab0d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:14.856114 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ee25e0e0-0c5c-4fec-af51-28a3b280ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:14.910223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25e0e0-0c5c-4fec-af51-28a3b280ab0d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:14.913762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f001b-4bd8-4557-a3d2-2fc79bff2964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:14.914391 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f001b-4bd8-4557-a3d2-2fc79bff2964 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:14.914674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f001b-4bd8-4557-a3d2-2fc79bff2964 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:14.914944 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f001b-4bd8-4557-a3d2-2fc79bff2964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:14.923523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f001b-4bd8-4557-a3d2-2fc79bff2964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:14.925626 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f001b-4bd8-4557-a3d2-2fc79bff2964 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:14.934598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1161/2315] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:15:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:15:20.660849 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a62ff-0241-4633-8834-3e507f33ac7e None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:20.671802 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a62ff-0241-4633-8834-3e507f33ac7e None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:20.675938 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19579dd-5a50-461e-9deb-b32e8ceb3835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:20.676601 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19579dd-5a50-461e-9deb-b32e8ceb3835 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:20.676877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19579dd-5a50-461e-9deb-b32e8ceb3835 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:20.677147 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19579dd-5a50-461e-9deb-b32e8ceb3835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:20.678977 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d19579dd-5a50-461e-9deb-b32e8ceb3835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:20.695447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19579dd-5a50-461e-9deb-b32e8ceb3835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:20.697024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19579dd-5a50-461e-9deb-b32e8ceb3835 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:20.710366 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1155/2316] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:15:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:15:21.028299 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3688c-ba1a-4db9-af5e-c6646bb36eb0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:21.028895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3688c-ba1a-4db9-af5e-c6646bb36eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:21.028895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3688c-ba1a-4db9-af5e-c6646bb36eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:21.047426 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1cf3688c-ba1a-4db9-af5e-c6646bb36eb0 None None] MFA Rules not processed for user `74cc0ddf89664a6f92c84ebb9e1ab3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:15:21.048818 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1cf3688c-ba1a-4db9-af5e-c6646bb36eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:21.103267 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1162/2317] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:15:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:15:21.139137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19579dd-5a50-461e-9deb-b32e8ceb3835 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:21.140561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d19579dd-5a50-461e-9deb-b32e8ceb3835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:21.216503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19579dd-5a50-461e-9deb-b32e8ceb3835 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:21.220364 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04e733-cfc9-49c8-8721-0c2fe1e7d02c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25519cdc25244a0b039ce3097c328d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:21.221721 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04e733-cfc9-49c8-8721-0c2fe1e7d02c service glance] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:21.222003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04e733-cfc9-49c8-8721-0c2fe1e7d02c service glance] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:21.222275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04e733-cfc9-49c8-8721-0c2fe1e7d02c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:21.224077 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-de04e733-cfc9-49c8-8721-0c2fe1e7d02c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:21.237002 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04e733-cfc9-49c8-8721-0c2fe1e7d02c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:21.238417 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04e733-cfc9-49c8-8721-0c2fe1e7d02c service glance] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:21.248891 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1156/2318] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:15:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:15:33.227698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3688c-ba1a-4db9-af5e-c6646bb36eb0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:33.229154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1cf3688c-ba1a-4db9-af5e-c6646bb36eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:33.245362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3688c-ba1a-4db9-af5e-c6646bb36eb0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:33.250816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e8bd9-a092-4374-b0f5-13ae687ee312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:33.251446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e8bd9-a092-4374-b0f5-13ae687ee312 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:33.251764 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e8bd9-a092-4374-b0f5-13ae687ee312 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:33.252042 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e8bd9-a092-4374-b0f5-13ae687ee312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:33.253752 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fc9e8bd9-a092-4374-b0f5-13ae687ee312 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:33.310203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e8bd9-a092-4374-b0f5-13ae687ee312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:33.311831 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e8bd9-a092-4374-b0f5-13ae687ee312 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:33.320772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1163/2319] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:15:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:15:34.768349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04e733-cfc9-49c8-8721-0c2fe1e7d02c service glance] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:34.780842 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04e733-cfc9-49c8-8721-0c2fe1e7d02c service glance] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:34.787250 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9c6cd-8217-49f4-940e-acfe2c680dc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:34.787927 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9c6cd-8217-49f4-940e-acfe2c680dc8 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:34.788215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9c6cd-8217-49f4-940e-acfe2c680dc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:34.788490 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9c6cd-8217-49f4-940e-acfe2c680dc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:34.790298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-92e9c6cd-8217-49f4-940e-acfe2c680dc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:34.801631 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9c6cd-8217-49f4-940e-acfe2c680dc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:34.803175 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9c6cd-8217-49f4-940e-acfe2c680dc8 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:34.811922 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1157/2320] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:15:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:15:39.295855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e8bd9-a092-4374-b0f5-13ae687ee312 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:39.305664 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e8bd9-a092-4374-b0f5-13ae687ee312 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:39.309250 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad285f7-d786-49e9-89ed-9d4005e37c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:39.309885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad285f7-d786-49e9-89ed-9d4005e37c1f service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:39.310163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad285f7-d786-49e9-89ed-9d4005e37c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:39.310436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad285f7-d786-49e9-89ed-9d4005e37c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:39.312312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5ad285f7-d786-49e9-89ed-9d4005e37c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:39.376596 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad285f7-d786-49e9-89ed-9d4005e37c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:39.378063 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad285f7-d786-49e9-89ed-9d4005e37c1f service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:39.388618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1164/2321] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:15:42.711532 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9c6cd-8217-49f4-940e-acfe2c680dc8 service nova] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:42.713076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-92e9c6cd-8217-49f4-940e-acfe2c680dc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:42.727058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9c6cd-8217-49f4-940e-acfe2c680dc8 service nova] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:42.732067 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35d590-2355-4511-a860-84458adb0345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:42.733067 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35d590-2355-4511-a860-84458adb0345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:42.733535 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35d590-2355-4511-a860-84458adb0345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:42.733887 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35d590-2355-4511-a860-84458adb0345 admin admin] PATH_INFO: `/v3/users/824915e26a724d938e5dd0a3c1f57932` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:42.735119 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35d590-2355-4511-a860-84458adb0345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=824915e26a724d938e5dd0a3c1f57932)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:42.737114 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35d590-2355-4511-a860-84458adb0345 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:42.787338 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2d35d590-2355-4511-a860-84458adb0345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '824915e26a724d938e5dd0a3c1f57932'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:42.788001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2d35d590-2355-4511-a860-84458adb0345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '824915e26a724d938e5dd0a3c1f57932'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:42.799209 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2d35d590-2355-4511-a860-84458adb0345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '824915e26a724d938e5dd0a3c1f57932'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:42.806835 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2d35d590-2355-4511-a860-84458adb0345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '824915e26a724d938e5dd0a3c1f57932'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:42.807582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2d35d590-2355-4511-a860-84458adb0345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '824915e26a724d938e5dd0a3c1f57932'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:42.821032 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1158/2322] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:15:42 2022] DELETE /identity/v3/users/824915e26a724d938e5dd0a3c1f57932 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:15:43.000202 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad285f7-d786-49e9-89ed-9d4005e37c1f service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:43.011089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad285f7-d786-49e9-89ed-9d4005e37c1f service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:43.067795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9382dac-daa0-4e59-af8a-659b31c11f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:43.068655 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9382dac-daa0-4e59-af8a-659b31c11f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:43.068932 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9382dac-daa0-4e59-af8a-659b31c11f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:43.069204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9382dac-daa0-4e59-af8a-659b31c11f44 admin admin] PATH_INFO: `/v3/projects/ea3305a913c541e4a45267497213df1c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:43.070355 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9382dac-daa0-4e59-af8a-659b31c11f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea3305a913c541e4a45267497213df1c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:43.072389 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9382dac-daa0-4e59-af8a-659b31c11f44 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:43.117300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b9382dac-daa0-4e59-af8a-659b31c11f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea3305a913c541e4a45267497213df1c', 'request_id': 'req-b9382dac-daa0-4e59-af8a-659b31c11f44'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:43.122710 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b9382dac-daa0-4e59-af8a-659b31c11f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea3305a913c541e4a45267497213df1c', 'request_id': 'req-b9382dac-daa0-4e59-af8a-659b31c11f44'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:43.130185 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b9382dac-daa0-4e59-af8a-659b31c11f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea3305a913c541e4a45267497213df1c', 'request_id': 'req-b9382dac-daa0-4e59-af8a-659b31c11f44'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:43.141982 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b9382dac-daa0-4e59-af8a-659b31c11f44 admin admin] The token cache is being invalidate because project ea3305a913c541e4a45267497213df1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:15:43.142293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b9382dac-daa0-4e59-af8a-659b31c11f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:43.142960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b9382dac-daa0-4e59-af8a-659b31c11f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:43.145329 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1165/2323] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:15:42 2022] DELETE /identity/v3/projects/ea3305a913c541e4a45267497213df1c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:15:43.150515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab353b04-a7da-4177-b578-cfdfc0bfa7df None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:43.150802 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab353b04-a7da-4177-b578-cfdfc0bfa7df None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:43.151077 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab353b04-a7da-4177-b578-cfdfc0bfa7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:43.171064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ab353b04-a7da-4177-b578-cfdfc0bfa7df None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:15:43.172306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ab353b04-a7da-4177-b578-cfdfc0bfa7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:43.229008 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1159/2324] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:15:43.236615 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575db0f-5fde-4c50-91e7-3164773b7445 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:43.236909 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575db0f-5fde-4c50-91e7-3164773b7445 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:43.237202 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575db0f-5fde-4c50-91e7-3164773b7445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:43.256172 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d575db0f-5fde-4c50-91e7-3164773b7445 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:15:43.257412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d575db0f-5fde-4c50-91e7-3164773b7445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:43.265206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1166/2325] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:15:43.269323 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab353b04-a7da-4177-b578-cfdfc0bfa7df None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:43.278881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab353b04-a7da-4177-b578-cfdfc0bfa7df None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:43.283651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44df25a-b095-4a56-9eb2-5dc22e94acfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:43.284295 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44df25a-b095-4a56-9eb2-5dc22e94acfe admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:43.284573 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44df25a-b095-4a56-9eb2-5dc22e94acfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:43.284848 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44df25a-b095-4a56-9eb2-5dc22e94acfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:43.286152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44df25a-b095-4a56-9eb2-5dc22e94acfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:15:43.286453 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44df25a-b095-4a56-9eb2-5dc22e94acfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:43.288100 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44df25a-b095-4a56-9eb2-5dc22e94acfe admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:43.299998 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1160/2326] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:15:43.305104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575db0f-5fde-4c50-91e7-3164773b7445 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:43.314121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575db0f-5fde-4c50-91e7-3164773b7445 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:43.318991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b53a2-0e29-4733-9ddb-a2b1821599df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:43.319705 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b53a2-0e29-4733-9ddb-a2b1821599df admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:43.319992 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b53a2-0e29-4733-9ddb-a2b1821599df admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:43.320262 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b53a2-0e29-4733-9ddb-a2b1821599df admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:43.320981 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b53a2-0e29-4733-9ddb-a2b1821599df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:43.322874 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b53a2-0e29-4733-9ddb-a2b1821599df admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:43.347514 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1167/2327] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:15:43 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:15:43.352322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44df25a-b095-4a56-9eb2-5dc22e94acfe admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:43.362200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44df25a-b095-4a56-9eb2-5dc22e94acfe admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:43.416690 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251bd2b-19d5-4310-958d-af92a43edfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:43.417387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251bd2b-19d5-4310-958d-af92a43edfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:43.417678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251bd2b-19d5-4310-958d-af92a43edfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:43.417931 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251bd2b-19d5-4310-958d-af92a43edfb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:43.418627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251bd2b-19d5-4310-958d-af92a43edfb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:43.420577 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251bd2b-19d5-4310-958d-af92a43edfb9 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:43.442386 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1161/2328] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:15:43 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:15:43.446435 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b53a2-0e29-4733-9ddb-a2b1821599df admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:43.456404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b53a2-0e29-4733-9ddb-a2b1821599df admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:43.460951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1f7aa-8d0a-45c4-9e32-22139be200e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:43.461596 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1f7aa-8d0a-45c4-9e32-22139be200e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:43.461872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1f7aa-8d0a-45c4-9e32-22139be200e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:43.462163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1f7aa-8d0a-45c4-9e32-22139be200e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:43.462857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1f7aa-8d0a-45c4-9e32-22139be200e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:43.464484 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1f7aa-8d0a-45c4-9e32-22139be200e9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:43.474476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1168/2329] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:15:43.478258 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251bd2b-19d5-4310-958d-af92a43edfb9 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:43.487987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251bd2b-19d5-4310-958d-af92a43edfb9 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:43.493384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc14b3-1ad5-4a8d-80c2-cb6aff19619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:43.494029 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc14b3-1ad5-4a8d-80c2-cb6aff19619f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:43.494307 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc14b3-1ad5-4a8d-80c2-cb6aff19619f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:43.494586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc14b3-1ad5-4a8d-80c2-cb6aff19619f admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:43.495305 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc14b3-1ad5-4a8d-80c2-cb6aff19619f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:43.496924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc14b3-1ad5-4a8d-80c2-cb6aff19619f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:43.508632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1162/2330] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:15:43.512542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1f7aa-8d0a-45c4-9e32-22139be200e9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:43.522284 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1f7aa-8d0a-45c4-9e32-22139be200e9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:43.526788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056cdbb-69b1-4917-bd56-8981e5390961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:43.527672 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056cdbb-69b1-4917-bd56-8981e5390961 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:43.527948 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056cdbb-69b1-4917-bd56-8981e5390961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:43.528215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056cdbb-69b1-4917-bd56-8981e5390961 admin admin] PATH_INFO: `/v3/projects/4f6c7affaae64518b68fd81adf78ab44/users/5d18f7c87344463a992d619c91a0b0b9/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:43.542934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056cdbb-69b1-4917-bd56-8981e5390961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6c7affaae64518b68fd81adf78ab44, user_id=5d18f7c87344463a992d619c91a0b0b9, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:43.545629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056cdbb-69b1-4917-bd56-8981e5390961 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:43.558476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1169/2331] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:15:43 2022] PUT /identity/v3/projects/4f6c7affaae64518b68fd81adf78ab44/users/5d18f7c87344463a992d619c91a0b0b9/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:15:43.569079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f1e81-ce28-468d-8943-939f33ba5c20 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:43.569398 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f1e81-ce28-468d-8943-939f33ba5c20 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:43.569672 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f1e81-ce28-468d-8943-939f33ba5c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:43.594677 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-759f1e81-ce28-468d-8943-939f33ba5c20 None None] MFA Rules not processed for user `5d18f7c87344463a992d619c91a0b0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:15:43.595901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-759f1e81-ce28-468d-8943-939f33ba5c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:43.658785 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1163/2332] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:15:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:15:43.670233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056cdbb-69b1-4917-bd56-8981e5390961 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:43.672003 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5056cdbb-69b1-4917-bd56-8981e5390961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:43.751665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056cdbb-69b1-4917-bd56-8981e5390961 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:43.756015 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c5757-4230-45cd-879d-08c8a13a79bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:43.756654 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c5757-4230-45cd-879d-08c8a13a79bf service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:43.756942 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c5757-4230-45cd-879d-08c8a13a79bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:43.757216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c5757-4230-45cd-879d-08c8a13a79bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:43.765350 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c5757-4230-45cd-879d-08c8a13a79bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:43.766773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c5757-4230-45cd-879d-08c8a13a79bf service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:43.775900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1170/2333] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:15:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:15:50.560951 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f1e81-ce28-468d-8943-939f33ba5c20 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:50.562470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-759f1e81-ce28-468d-8943-939f33ba5c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:50.632649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f1e81-ce28-468d-8943-939f33ba5c20 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:50.637917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73852274-e142-4310-8fee-e0dcc5ab1d9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:50.638547 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73852274-e142-4310-8fee-e0dcc5ab1d9b service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:50.638831 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73852274-e142-4310-8fee-e0dcc5ab1d9b service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:50.639101 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73852274-e142-4310-8fee-e0dcc5ab1d9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:50.640824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-73852274-e142-4310-8fee-e0dcc5ab1d9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:50.696735 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73852274-e142-4310-8fee-e0dcc5ab1d9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:50.698309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73852274-e142-4310-8fee-e0dcc5ab1d9b service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:50.707013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1164/2334] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:15:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:15:52.016541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c5757-4230-45cd-879d-08c8a13a79bf service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:52.077730 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c5757-4230-45cd-879d-08c8a13a79bf service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:52.082222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d6005-b804-4f77-b6d9-b2d0b6cab03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:52.083078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d6005-b804-4f77-b6d9-b2d0b6cab03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:52.083354 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d6005-b804-4f77-b6d9-b2d0b6cab03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:52.084438 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d6005-b804-4f77-b6d9-b2d0b6cab03e admin admin] PATH_INFO: `/v3/users/5d18f7c87344463a992d619c91a0b0b9` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:52.085712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d6005-b804-4f77-b6d9-b2d0b6cab03e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d18f7c87344463a992d619c91a0b0b9)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:52.087650 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d6005-b804-4f77-b6d9-b2d0b6cab03e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:52.131760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-703d6005-b804-4f77-b6d9-b2d0b6cab03e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d18f7c87344463a992d619c91a0b0b9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:52.142958 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-703d6005-b804-4f77-b6d9-b2d0b6cab03e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d18f7c87344463a992d619c91a0b0b9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:52.150344 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-703d6005-b804-4f77-b6d9-b2d0b6cab03e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d18f7c87344463a992d619c91a0b0b9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:52.151034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-703d6005-b804-4f77-b6d9-b2d0b6cab03e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d18f7c87344463a992d619c91a0b0b9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:52.151666 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-703d6005-b804-4f77-b6d9-b2d0b6cab03e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d18f7c87344463a992d619c91a0b0b9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:52.164265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1171/2335] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:15:52 2022] DELETE /identity/v3/users/5d18f7c87344463a992d619c91a0b0b9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:15:52.168798 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c172a-9928-4d50-acd2-8c67a67ec8be None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:52.169292 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c172a-9928-4d50-acd2-8c67a67ec8be None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:52.169412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c172a-9928-4d50-acd2-8c67a67ec8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:52.186410 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b25c172a-9928-4d50-acd2-8c67a67ec8be None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:15:52.187628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b25c172a-9928-4d50-acd2-8c67a67ec8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:52.245114 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1165/2336] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:15:52.255111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d6005-b804-4f77-b6d9-b2d0b6cab03e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:52.257234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-703d6005-b804-4f77-b6d9-b2d0b6cab03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:52.312196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d6005-b804-4f77-b6d9-b2d0b6cab03e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:52.315770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc562ffc-b138-4d0f-acca-9381476f895f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:52.316401 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc562ffc-b138-4d0f-acca-9381476f895f service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:52.316680 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc562ffc-b138-4d0f-acca-9381476f895f service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:52.316950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc562ffc-b138-4d0f-acca-9381476f895f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:52.326220 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc562ffc-b138-4d0f-acca-9381476f895f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:52.327659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc562ffc-b138-4d0f-acca-9381476f895f service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:52.336727 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1172/2337] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:15:52.605057 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c172a-9928-4d50-acd2-8c67a67ec8be None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:52.606584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b25c172a-9928-4d50-acd2-8c67a67ec8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:52.619175 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c172a-9928-4d50-acd2-8c67a67ec8be None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:52.623884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044c427-f270-4adc-aa58-303355452eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:52.624814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c427-f270-4adc-aa58-303355452eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:52.625158 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c427-f270-4adc-aa58-303355452eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:52.625497 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c427-f270-4adc-aa58-303355452eaf admin admin] PATH_INFO: `/v3/projects/4f6c7affaae64518b68fd81adf78ab44` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:52.626737 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044c427-f270-4adc-aa58-303355452eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6c7affaae64518b68fd81adf78ab44)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:52.628730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044c427-f270-4adc-aa58-303355452eaf admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:52.676661 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d044c427-f270-4adc-aa58-303355452eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6c7affaae64518b68fd81adf78ab44', 'request_id': 'req-d044c427-f270-4adc-aa58-303355452eaf'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:52.682930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d044c427-f270-4adc-aa58-303355452eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6c7affaae64518b68fd81adf78ab44', 'request_id': 'req-d044c427-f270-4adc-aa58-303355452eaf'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:52.689972 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d044c427-f270-4adc-aa58-303355452eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6c7affaae64518b68fd81adf78ab44', 'request_id': 'req-d044c427-f270-4adc-aa58-303355452eaf'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:52.701247 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d044c427-f270-4adc-aa58-303355452eaf admin admin] The token cache is being invalidate because project 4f6c7affaae64518b68fd81adf78ab44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:15:52.701533 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d044c427-f270-4adc-aa58-303355452eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:52.702151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d044c427-f270-4adc-aa58-303355452eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:15:52.703722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1166/2338] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:15:52 2022] DELETE /identity/v3/projects/4f6c7affaae64518b68fd81adf78ab44 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:15:52.708748 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffc0fe-30b4-460d-a58e-adf8589bd9f1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:52.709056 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffc0fe-30b4-460d-a58e-adf8589bd9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:52.709330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffc0fe-30b4-460d-a58e-adf8589bd9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:52.727074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-fcffc0fe-30b4-460d-a58e-adf8589bd9f1 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:15:52.728268 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fcffc0fe-30b4-460d-a58e-adf8589bd9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:52.784481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1173/2339] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:15:52.793756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389cb35-1403-429f-8407-37392b850525 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:52.794065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389cb35-1403-429f-8407-37392b850525 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:52.794327 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389cb35-1403-429f-8407-37392b850525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:52.814083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b389cb35-1403-429f-8407-37392b850525 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:15:52.815298 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b389cb35-1403-429f-8407-37392b850525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:52.823488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1167/2340] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:15:52.827709 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffc0fe-30b4-460d-a58e-adf8589bd9f1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:52.837459 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffc0fe-30b4-460d-a58e-adf8589bd9f1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:52.842063 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192f350-8acb-4882-87c1-ddeb6ddebaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:52.842854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192f350-8acb-4882-87c1-ddeb6ddebaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:52.843151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192f350-8acb-4882-87c1-ddeb6ddebaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:52.843409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192f350-8acb-4882-87c1-ddeb6ddebaa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:52.844161 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192f350-8acb-4882-87c1-ddeb6ddebaa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:15:52.844465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192f350-8acb-4882-87c1-ddeb6ddebaa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:52.846066 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192f350-8acb-4882-87c1-ddeb6ddebaa1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:52.858410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1174/2341] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:15:52.862734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389cb35-1403-429f-8407-37392b850525 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:52.873364 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389cb35-1403-429f-8407-37392b850525 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:52.878471 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d3b33-b354-45c6-b375-4ba74547f006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:52.879154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3b33-b354-45c6-b375-4ba74547f006 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:52.879464 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3b33-b354-45c6-b375-4ba74547f006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:52.879775 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3b33-b354-45c6-b375-4ba74547f006 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:52.880509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d3b33-b354-45c6-b375-4ba74547f006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:52.882419 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d3b33-b354-45c6-b375-4ba74547f006 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:52.908433 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1168/2342] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:15:52 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:15:52.913374 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192f350-8acb-4882-87c1-ddeb6ddebaa1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:52.922986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192f350-8acb-4882-87c1-ddeb6ddebaa1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:52.979002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe637b7-9267-4572-b521-1a07fdf94b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:52.979782 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe637b7-9267-4572-b521-1a07fdf94b3a admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:52.980095 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe637b7-9267-4572-b521-1a07fdf94b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:52.980373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe637b7-9267-4572-b521-1a07fdf94b3a admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:52.981052 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe637b7-9267-4572-b521-1a07fdf94b3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:52.982968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe637b7-9267-4572-b521-1a07fdf94b3a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:53.005380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1175/2343] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:15:52 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:15:53.006819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d3b33-b354-45c6-b375-4ba74547f006 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:53.017129 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d3b33-b354-45c6-b375-4ba74547f006 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:53.022299 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344899c-19e8-4995-be22-ba141612f68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:53.022969 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344899c-19e8-4995-be22-ba141612f68e admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:53.023245 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344899c-19e8-4995-be22-ba141612f68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:53.023514 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344899c-19e8-4995-be22-ba141612f68e admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:53.024363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344899c-19e8-4995-be22-ba141612f68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:53.025946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344899c-19e8-4995-be22-ba141612f68e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:53.036482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1169/2344] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:15:53.041082 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe637b7-9267-4572-b521-1a07fdf94b3a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:53.051683 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe637b7-9267-4572-b521-1a07fdf94b3a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:53.056312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273eca2-8dec-43a9-a255-464c8494f3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:53.057053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273eca2-8dec-43a9-a255-464c8494f3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:53.057347 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273eca2-8dec-43a9-a255-464c8494f3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:53.057696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273eca2-8dec-43a9-a255-464c8494f3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:53.058559 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273eca2-8dec-43a9-a255-464c8494f3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:53.060252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273eca2-8dec-43a9-a255-464c8494f3d0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:53.072651 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1176/2345] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:15:53.076859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344899c-19e8-4995-be22-ba141612f68e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:53.087493 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344899c-19e8-4995-be22-ba141612f68e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:53.093462 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79404b0-9e56-40c7-be8e-0fef4c8904f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:53.093838 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79404b0-9e56-40c7-be8e-0fef4c8904f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:53.095036 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79404b0-9e56-40c7-be8e-0fef4c8904f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:53.095318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79404b0-9e56-40c7-be8e-0fef4c8904f6 admin admin] PATH_INFO: `/v3/projects/9b4d52bed813442490e12310c9ee4661/users/5a1e1f7150c94c0cbe72d91040907766/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:53.110871 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79404b0-9e56-40c7-be8e-0fef4c8904f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4d52bed813442490e12310c9ee4661, user_id=5a1e1f7150c94c0cbe72d91040907766, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:53.113564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79404b0-9e56-40c7-be8e-0fef4c8904f6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:53.132623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1170/2346] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:15:53 2022] PUT /identity/v3/projects/9b4d52bed813442490e12310c9ee4661/users/5a1e1f7150c94c0cbe72d91040907766/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:15:53.148905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c460a-f0a6-4f96-862a-90b3d04c9366 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:53.149403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c460a-f0a6-4f96-862a-90b3d04c9366 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:53.149896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c460a-f0a6-4f96-862a-90b3d04c9366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:53.183336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-099c460a-f0a6-4f96-862a-90b3d04c9366 None None] MFA Rules not processed for user `5a1e1f7150c94c0cbe72d91040907766`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:15:53.184577 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-099c460a-f0a6-4f96-862a-90b3d04c9366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:53.248665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1177/2347] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:15:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:15:53.253253 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79404b0-9e56-40c7-be8e-0fef4c8904f6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:53.314658 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79404b0-9e56-40c7-be8e-0fef4c8904f6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:53.319372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1c8d2-09d6-4995-9a2d-12c03e1fd762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:53.320057 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1c8d2-09d6-4995-9a2d-12c03e1fd762 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:53.320338 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1c8d2-09d6-4995-9a2d-12c03e1fd762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:53.320611 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1c8d2-09d6-4995-9a2d-12c03e1fd762 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:53.321291 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1c8d2-09d6-4995-9a2d-12c03e1fd762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:53.323186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1c8d2-09d6-4995-9a2d-12c03e1fd762 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:53.348126 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1171/2348] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:15:53 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:15:53.353339 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c460a-f0a6-4f96-862a-90b3d04c9366 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:53.363892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c460a-f0a6-4f96-862a-90b3d04c9366 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:53.419741 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38442d-e360-4332-a049-25ef49a7aef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:53.420412 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38442d-e360-4332-a049-25ef49a7aef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:53.420696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38442d-e360-4332-a049-25ef49a7aef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:53.420972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38442d-e360-4332-a049-25ef49a7aef8 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:53.421663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38442d-e360-4332-a049-25ef49a7aef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:53.423628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38442d-e360-4332-a049-25ef49a7aef8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:53.445215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1178/2349] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:15:53 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:15:53.449235 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1c8d2-09d6-4995-9a2d-12c03e1fd762 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:53.460045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1c8d2-09d6-4995-9a2d-12c03e1fd762 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:53.464773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b4232-2b2c-4054-9f56-5b0e56b394bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:53.465425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b4232-2b2c-4054-9f56-5b0e56b394bf admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:53.465702 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b4232-2b2c-4054-9f56-5b0e56b394bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:53.465973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b4232-2b2c-4054-9f56-5b0e56b394bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:53.466685 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b4232-2b2c-4054-9f56-5b0e56b394bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:53.468309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b4232-2b2c-4054-9f56-5b0e56b394bf admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:53.478750 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1172/2350] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:15:53.482971 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38442d-e360-4332-a049-25ef49a7aef8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:53.493204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38442d-e360-4332-a049-25ef49a7aef8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:53.497790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adfa68-ae5c-42e6-b422-813b5aa9dd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:53.498670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adfa68-ae5c-42e6-b422-813b5aa9dd45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:53.499080 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adfa68-ae5c-42e6-b422-813b5aa9dd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:53.499359 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adfa68-ae5c-42e6-b422-813b5aa9dd45 admin admin] PATH_INFO: `/v3/projects/636ee88bf6f14794a7f86384c2aefa8a/users/fa3b4a3624cc4603895bc6fd3f6ca415/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:53.514472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adfa68-ae5c-42e6-b422-813b5aa9dd45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636ee88bf6f14794a7f86384c2aefa8a, user_id=fa3b4a3624cc4603895bc6fd3f6ca415, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:53.517199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adfa68-ae5c-42e6-b422-813b5aa9dd45 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:53.531742 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1179/2351] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:15:53 2022] PUT /identity/v3/projects/636ee88bf6f14794a7f86384c2aefa8a/users/fa3b4a3624cc4603895bc6fd3f6ca415/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:15:53.536039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b4232-2b2c-4054-9f56-5b0e56b394bf admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:53.546366 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b4232-2b2c-4054-9f56-5b0e56b394bf admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:53.600167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9bf21-80e0-4575-a9dd-13d56e26b0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:53.600737 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9bf21-80e0-4575-a9dd-13d56e26b0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:53.601012 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9bf21-80e0-4575-a9dd-13d56e26b0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:53.601284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9bf21-80e0-4575-a9dd-13d56e26b0d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:53.601993 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9bf21-80e0-4575-a9dd-13d56e26b0d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:53.603561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9bf21-80e0-4575-a9dd-13d56e26b0d1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:53.612766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1173/2352] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:15:53.617265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adfa68-ae5c-42e6-b422-813b5aa9dd45 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:53.627235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adfa68-ae5c-42e6-b422-813b5aa9dd45 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:53.632596 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342a1e3-ab12-4296-aad6-12a3d0de5ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:53.633467 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342a1e3-ab12-4296-aad6-12a3d0de5ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:53.633742 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342a1e3-ab12-4296-aad6-12a3d0de5ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:53.634015 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342a1e3-ab12-4296-aad6-12a3d0de5ee9 admin admin] PATH_INFO: `/v3/projects/636ee88bf6f14794a7f86384c2aefa8a/users/fa3b4a3624cc4603895bc6fd3f6ca415/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:53.635996 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342a1e3-ab12-4296-aad6-12a3d0de5ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636ee88bf6f14794a7f86384c2aefa8a, user_id=fa3b4a3624cc4603895bc6fd3f6ca415, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:53.638773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342a1e3-ab12-4296-aad6-12a3d0de5ee9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:53.649568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1180/2353] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:15:53 2022] PUT /identity/v3/projects/636ee88bf6f14794a7f86384c2aefa8a/users/fa3b4a3624cc4603895bc6fd3f6ca415/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:15:53.660108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320d13d-4d6a-4af5-8ce5-5c4001bb8083 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:53.660466 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320d13d-4d6a-4af5-8ce5-5c4001bb8083 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:53.660783 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320d13d-4d6a-4af5-8ce5-5c4001bb8083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:53.686543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0320d13d-4d6a-4af5-8ce5-5c4001bb8083 None None] MFA Rules not processed for user `fa3b4a3624cc4603895bc6fd3f6ca415`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:15:53.687803 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0320d13d-4d6a-4af5-8ce5-5c4001bb8083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:53.752696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1174/2354] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:15:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:15:53.764689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342a1e3-ab12-4296-aad6-12a3d0de5ee9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:53.766357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3342a1e3-ab12-4296-aad6-12a3d0de5ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:15:53.826178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342a1e3-ab12-4296-aad6-12a3d0de5ee9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:53.829814 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61447560-661c-4108-acf8-e30382314da1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:53.830461 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61447560-661c-4108-acf8-e30382314da1 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:53.830742 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61447560-661c-4108-acf8-e30382314da1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:53.831017 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61447560-661c-4108-acf8-e30382314da1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:53.839897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61447560-661c-4108-acf8-e30382314da1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:53.841326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61447560-661c-4108-acf8-e30382314da1 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:53.850672 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1181/2355] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:15:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:15:53.920835 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320d13d-4d6a-4af5-8ce5-5c4001bb8083 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:15:53.930789 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320d13d-4d6a-4af5-8ce5-5c4001bb8083 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:15:53.934382 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9399d-fd01-4821-99a7-5d3cb0fe4b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:15:53.935013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9399d-fd01-4821-99a7-5d3cb0fe4b56 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:15:53.935291 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9399d-fd01-4821-99a7-5d3cb0fe4b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:15:53.935564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9399d-fd01-4821-99a7-5d3cb0fe4b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:15:53.989349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9399d-fd01-4821-99a7-5d3cb0fe4b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:15:53.991299 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9399d-fd01-4821-99a7-5d3cb0fe4b56 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:15:53.999890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1175/2356] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:15:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:02.764432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61447560-661c-4108-acf8-e30382314da1 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:02.824052 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61447560-661c-4108-acf8-e30382314da1 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:02.828609 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487260a-f499-49b4-9ee4-f9d56c58f15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:02.829472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487260a-f499-49b4-9ee4-f9d56c58f15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:02.829752 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487260a-f499-49b4-9ee4-f9d56c58f15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:02.830021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487260a-f499-49b4-9ee4-f9d56c58f15c admin admin] PATH_INFO: `/v3/users/5a1e1f7150c94c0cbe72d91040907766` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:02.831195 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487260a-f499-49b4-9ee4-f9d56c58f15c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a1e1f7150c94c0cbe72d91040907766)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:02.833160 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487260a-f499-49b4-9ee4-f9d56c58f15c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:02.876280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a487260a-f499-49b4-9ee4-f9d56c58f15c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a1e1f7150c94c0cbe72d91040907766'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:02.888999 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a487260a-f499-49b4-9ee4-f9d56c58f15c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a1e1f7150c94c0cbe72d91040907766'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:02.895530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a487260a-f499-49b4-9ee4-f9d56c58f15c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a1e1f7150c94c0cbe72d91040907766'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:02.896215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a487260a-f499-49b4-9ee4-f9d56c58f15c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a1e1f7150c94c0cbe72d91040907766'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:02.896815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a487260a-f499-49b4-9ee4-f9d56c58f15c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a1e1f7150c94c0cbe72d91040907766'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:02.909111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1182/2357] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:16:02 2022] DELETE /identity/v3/users/5a1e1f7150c94c0cbe72d91040907766 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:02.913726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d223e8-390f-4181-a537-26f3609877ca None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:02.914226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d223e8-390f-4181-a537-26f3609877ca None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:02.914325 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d223e8-390f-4181-a537-26f3609877ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:02.931158 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a0d223e8-390f-4181-a537-26f3609877ca None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:02.932301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a0d223e8-390f-4181-a537-26f3609877ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:02.988877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1176/2358] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:02.999074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487260a-f499-49b4-9ee4-f9d56c58f15c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:03.000510 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a487260a-f499-49b4-9ee4-f9d56c58f15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:03.055387 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487260a-f499-49b4-9ee4-f9d56c58f15c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:03.059030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee5729-966e-4ed7-8501-d475fde5c237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:03.059685 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee5729-966e-4ed7-8501-d475fde5c237 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:03.059965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee5729-966e-4ed7-8501-d475fde5c237 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:03.060237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee5729-966e-4ed7-8501-d475fde5c237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:03.068847 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee5729-966e-4ed7-8501-d475fde5c237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:03.070875 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee5729-966e-4ed7-8501-d475fde5c237 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:03.079854 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1183/2359] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:03.360786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d223e8-390f-4181-a537-26f3609877ca None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:03.362225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a0d223e8-390f-4181-a537-26f3609877ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:03.374011 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d223e8-390f-4181-a537-26f3609877ca None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:03.379053 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfe219-5a54-4a59-b81f-e1bba43e2833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:03.380263 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfe219-5a54-4a59-b81f-e1bba43e2833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:03.380546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfe219-5a54-4a59-b81f-e1bba43e2833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:03.380824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfe219-5a54-4a59-b81f-e1bba43e2833 admin admin] PATH_INFO: `/v3/projects/9b4d52bed813442490e12310c9ee4661` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:03.382076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfe219-5a54-4a59-b81f-e1bba43e2833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4d52bed813442490e12310c9ee4661)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:03.384734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfe219-5a54-4a59-b81f-e1bba43e2833 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:03.429765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5bdfe219-5a54-4a59-b81f-e1bba43e2833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4d52bed813442490e12310c9ee4661', 'request_id': 'req-5bdfe219-5a54-4a59-b81f-e1bba43e2833'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:03.435139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5bdfe219-5a54-4a59-b81f-e1bba43e2833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4d52bed813442490e12310c9ee4661', 'request_id': 'req-5bdfe219-5a54-4a59-b81f-e1bba43e2833'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:03.442947 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5bdfe219-5a54-4a59-b81f-e1bba43e2833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4d52bed813442490e12310c9ee4661', 'request_id': 'req-5bdfe219-5a54-4a59-b81f-e1bba43e2833'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:03.455178 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5bdfe219-5a54-4a59-b81f-e1bba43e2833 admin admin] The token cache is being invalidate because project 9b4d52bed813442490e12310c9ee4661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:16:03.455468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5bdfe219-5a54-4a59-b81f-e1bba43e2833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:03.456128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-5bdfe219-5a54-4a59-b81f-e1bba43e2833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:03.457681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1177/2360] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:16:03 2022] DELETE /identity/v3/projects/9b4d52bed813442490e12310c9ee4661 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:03.462463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee5729-966e-4ed7-8501-d475fde5c237 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:03.472163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee5729-966e-4ed7-8501-d475fde5c237 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:03.529922 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068bc4c-84ea-4f0d-ad6f-b9ecb93bea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:03.530789 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068bc4c-84ea-4f0d-ad6f-b9ecb93bea64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:03.531163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068bc4c-84ea-4f0d-ad6f-b9ecb93bea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:03.531441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068bc4c-84ea-4f0d-ad6f-b9ecb93bea64 admin admin] PATH_INFO: `/v3/users/fa3b4a3624cc4603895bc6fd3f6ca415` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:03.532649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068bc4c-84ea-4f0d-ad6f-b9ecb93bea64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3b4a3624cc4603895bc6fd3f6ca415)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:03.534561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068bc4c-84ea-4f0d-ad6f-b9ecb93bea64 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:03.578914 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f068bc4c-84ea-4f0d-ad6f-b9ecb93bea64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3b4a3624cc4603895bc6fd3f6ca415'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:03.590792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f068bc4c-84ea-4f0d-ad6f-b9ecb93bea64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3b4a3624cc4603895bc6fd3f6ca415'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:03.597176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f068bc4c-84ea-4f0d-ad6f-b9ecb93bea64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3b4a3624cc4603895bc6fd3f6ca415'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:03.597841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f068bc4c-84ea-4f0d-ad6f-b9ecb93bea64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3b4a3624cc4603895bc6fd3f6ca415'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:03.598444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f068bc4c-84ea-4f0d-ad6f-b9ecb93bea64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3b4a3624cc4603895bc6fd3f6ca415'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:03.610641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1184/2361] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:16:03 2022] DELETE /identity/v3/users/fa3b4a3624cc4603895bc6fd3f6ca415 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:03.950458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfe219-5a54-4a59-b81f-e1bba43e2833 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:03.951982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-5bdfe219-5a54-4a59-b81f-e1bba43e2833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:03.965272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfe219-5a54-4a59-b81f-e1bba43e2833 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:04.033974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ee630-2e2b-4c31-9bf2-56892081cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:04.034832 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ee630-2e2b-4c31-9bf2-56892081cc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:04.035105 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ee630-2e2b-4c31-9bf2-56892081cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:04.035370 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ee630-2e2b-4c31-9bf2-56892081cc47 admin admin] PATH_INFO: `/v3/projects/636ee88bf6f14794a7f86384c2aefa8a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:04.036566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ee630-2e2b-4c31-9bf2-56892081cc47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=636ee88bf6f14794a7f86384c2aefa8a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:04.039196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ee630-2e2b-4c31-9bf2-56892081cc47 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:04.083214 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-043ee630-2e2b-4c31-9bf2-56892081cc47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '636ee88bf6f14794a7f86384c2aefa8a', 'request_id': 'req-043ee630-2e2b-4c31-9bf2-56892081cc47'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:04.088615 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-043ee630-2e2b-4c31-9bf2-56892081cc47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '636ee88bf6f14794a7f86384c2aefa8a', 'request_id': 'req-043ee630-2e2b-4c31-9bf2-56892081cc47'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:04.096109 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-043ee630-2e2b-4c31-9bf2-56892081cc47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '636ee88bf6f14794a7f86384c2aefa8a', 'request_id': 'req-043ee630-2e2b-4c31-9bf2-56892081cc47'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:04.107414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-043ee630-2e2b-4c31-9bf2-56892081cc47 admin admin] The token cache is being invalidate because project 636ee88bf6f14794a7f86384c2aefa8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:16:04.107733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-043ee630-2e2b-4c31-9bf2-56892081cc47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:04.108355 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-043ee630-2e2b-4c31-9bf2-56892081cc47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:04.109882 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1178/2362] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:16:03 2022] DELETE /identity/v3/projects/636ee88bf6f14794a7f86384c2aefa8a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:04.114736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af62ef-dd1a-4484-a41d-032c123651f8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:04.115205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af62ef-dd1a-4484-a41d-032c123651f8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:04.115329 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af62ef-dd1a-4484-a41d-032c123651f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:04.134513 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e8af62ef-dd1a-4484-a41d-032c123651f8 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:04.135714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e8af62ef-dd1a-4484-a41d-032c123651f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:04.191165 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1185/2363] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:04.200637 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7315e-b5f4-41d4-a041-8863693d4259 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:04.200927 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7315e-b5f4-41d4-a041-8863693d4259 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:04.201207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7315e-b5f4-41d4-a041-8863693d4259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:04.219783 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2ab7315e-b5f4-41d4-a041-8863693d4259 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:04.220960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2ab7315e-b5f4-41d4-a041-8863693d4259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:04.229754 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1179/2364] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:04.234061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af62ef-dd1a-4484-a41d-032c123651f8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:04.244468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af62ef-dd1a-4484-a41d-032c123651f8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:04.249088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211edcbc-3aa0-4b75-b82a-45e42ad0cde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:04.249762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211edcbc-3aa0-4b75-b82a-45e42ad0cde5 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:04.250072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211edcbc-3aa0-4b75-b82a-45e42ad0cde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:04.250356 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211edcbc-3aa0-4b75-b82a-45e42ad0cde5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:04.251061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211edcbc-3aa0-4b75-b82a-45e42ad0cde5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:16:04.251393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211edcbc-3aa0-4b75-b82a-45e42ad0cde5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:04.253043 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211edcbc-3aa0-4b75-b82a-45e42ad0cde5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:04.264365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1186/2365] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:16:04.268556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7315e-b5f4-41d4-a041-8863693d4259 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:04.278104 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7315e-b5f4-41d4-a041-8863693d4259 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:04.283019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2ceb2-af38-4e8e-a05e-0ee0f0923ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:04.283673 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2ceb2-af38-4e8e-a05e-0ee0f0923ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:04.283955 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2ceb2-af38-4e8e-a05e-0ee0f0923ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:04.284229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2ceb2-af38-4e8e-a05e-0ee0f0923ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:04.284903 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2ceb2-af38-4e8e-a05e-0ee0f0923ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:04.286777 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2ceb2-af38-4e8e-a05e-0ee0f0923ae8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:04.311689 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1180/2366] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:16:04 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:16:04.315619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211edcbc-3aa0-4b75-b82a-45e42ad0cde5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:04.325202 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211edcbc-3aa0-4b75-b82a-45e42ad0cde5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:04.383516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af44881-bd96-43da-838c-f601c64076b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:04.384214 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af44881-bd96-43da-838c-f601c64076b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:04.384498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af44881-bd96-43da-838c-f601c64076b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:04.384769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af44881-bd96-43da-838c-f601c64076b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:04.385490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af44881-bd96-43da-838c-f601c64076b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:04.387416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af44881-bd96-43da-838c-f601c64076b8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:04.407419 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1187/2367] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:16:04 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:16:04.411570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2ceb2-af38-4e8e-a05e-0ee0f0923ae8 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:04.423139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2ceb2-af38-4e8e-a05e-0ee0f0923ae8 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:04.428436 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbff1a-dc99-46ff-ad12-6f0aaa345f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:04.429163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbff1a-dc99-46ff-ad12-6f0aaa345f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:04.430082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbff1a-dc99-46ff-ad12-6f0aaa345f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:04.430367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbff1a-dc99-46ff-ad12-6f0aaa345f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:04.431103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbff1a-dc99-46ff-ad12-6f0aaa345f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:04.432759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbff1a-dc99-46ff-ad12-6f0aaa345f77 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:04.443309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1181/2368] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:16:04.447482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af44881-bd96-43da-838c-f601c64076b8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:04.457400 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af44881-bd96-43da-838c-f601c64076b8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:04.462722 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace0931-173f-4e11-8cee-f6ca6472a066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:04.463382 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace0931-173f-4e11-8cee-f6ca6472a066 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:04.463688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace0931-173f-4e11-8cee-f6ca6472a066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:04.463965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace0931-173f-4e11-8cee-f6ca6472a066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:04.464682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace0931-173f-4e11-8cee-f6ca6472a066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:04.466278 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace0931-173f-4e11-8cee-f6ca6472a066 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:04.476814 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1188/2369] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:16:04.481003 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbff1a-dc99-46ff-ad12-6f0aaa345f77 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:04.490677 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbff1a-dc99-46ff-ad12-6f0aaa345f77 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:04.495585 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1f388-0014-4d2c-82d3-39c8a628d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:04.496494 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1f388-0014-4d2c-82d3-39c8a628d78f admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:04.496774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1f388-0014-4d2c-82d3-39c8a628d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:04.497046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1f388-0014-4d2c-82d3-39c8a628d78f admin admin] PATH_INFO: `/v3/projects/2987c5e77a5a43159d644d40340ce433/users/a04cbadb774f4c7c96a234e4af2072e8/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:04.511907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1f388-0014-4d2c-82d3-39c8a628d78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2987c5e77a5a43159d644d40340ce433, user_id=a04cbadb774f4c7c96a234e4af2072e8, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:04.514569 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1f388-0014-4d2c-82d3-39c8a628d78f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:04.527926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1182/2370] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:16:04 2022] PUT /identity/v3/projects/2987c5e77a5a43159d644d40340ce433/users/a04cbadb774f4c7c96a234e4af2072e8/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:04.538888 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cf9e6-05a0-4413-92f5-a6fbfd9244eb None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:04.539329 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cf9e6-05a0-4413-92f5-a6fbfd9244eb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:04.539731 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cf9e6-05a0-4413-92f5-a6fbfd9244eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:04.565347 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cf9cf9e6-05a0-4413-92f5-a6fbfd9244eb None None] MFA Rules not processed for user `a04cbadb774f4c7c96a234e4af2072e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:04.566576 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cf9cf9e6-05a0-4413-92f5-a6fbfd9244eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:04.629660 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1189/2371] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:04.634626 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1f388-0014-4d2c-82d3-39c8a628d78f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:04.693189 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1f388-0014-4d2c-82d3-39c8a628d78f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:04.698337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a2a41-74ba-405d-99c9-2e79cd62159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:04.698985 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a2a41-74ba-405d-99c9-2e79cd62159e admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:04.699268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a2a41-74ba-405d-99c9-2e79cd62159e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:04.699549 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a2a41-74ba-405d-99c9-2e79cd62159e admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:04.700258 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a2a41-74ba-405d-99c9-2e79cd62159e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:04.702155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a2a41-74ba-405d-99c9-2e79cd62159e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:04.726406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1183/2372] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:16:04 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:16:04.730669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cf9e6-05a0-4413-92f5-a6fbfd9244eb None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:04.741556 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cf9e6-05a0-4413-92f5-a6fbfd9244eb None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:04.795402 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3d04a-f1e0-45bb-ab22-0ccb35ffec63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:04.796092 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3d04a-f1e0-45bb-ab22-0ccb35ffec63 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:04.796373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3d04a-f1e0-45bb-ab22-0ccb35ffec63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:04.796646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3d04a-f1e0-45bb-ab22-0ccb35ffec63 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:04.797337 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3d04a-f1e0-45bb-ab22-0ccb35ffec63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:04.799271 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3d04a-f1e0-45bb-ab22-0ccb35ffec63 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:04.817933 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1190/2373] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:16:04 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:16:04.822403 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a2a41-74ba-405d-99c9-2e79cd62159e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:04.832514 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a2a41-74ba-405d-99c9-2e79cd62159e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:04.837818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e96330-41ff-48da-9c63-fc830ba946b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:04.838477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e96330-41ff-48da-9c63-fc830ba946b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:04.838761 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e96330-41ff-48da-9c63-fc830ba946b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:04.839039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e96330-41ff-48da-9c63-fc830ba946b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:04.839801 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e96330-41ff-48da-9c63-fc830ba946b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:04.841414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e96330-41ff-48da-9c63-fc830ba946b5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:04.852942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1184/2374] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:16:04.856951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3d04a-f1e0-45bb-ab22-0ccb35ffec63 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:04.866610 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3d04a-f1e0-45bb-ab22-0ccb35ffec63 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:04.871201 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81136484-7df0-4bbd-bbe0-e6a58ea483ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:04.872108 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81136484-7df0-4bbd-bbe0-e6a58ea483ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:04.872396 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81136484-7df0-4bbd-bbe0-e6a58ea483ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:04.872720 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81136484-7df0-4bbd-bbe0-e6a58ea483ea admin admin] PATH_INFO: `/v3/projects/01b2225579344223938b65ee3485a282/users/23c7644e2269485cb2245005c894652a/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:04.887510 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81136484-7df0-4bbd-bbe0-e6a58ea483ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b2225579344223938b65ee3485a282, user_id=23c7644e2269485cb2245005c894652a, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:04.890214 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81136484-7df0-4bbd-bbe0-e6a58ea483ea admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:04.903200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1191/2375] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:16:04 2022] PUT /identity/v3/projects/01b2225579344223938b65ee3485a282/users/23c7644e2269485cb2245005c894652a/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:16:04.907314 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e96330-41ff-48da-9c63-fc830ba946b5 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:04.917020 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e96330-41ff-48da-9c63-fc830ba946b5 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:04.971977 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf28dc9-83cf-4b5a-ab10-7b424c3e2d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:04.972647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf28dc9-83cf-4b5a-ab10-7b424c3e2d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:04.972960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf28dc9-83cf-4b5a-ab10-7b424c3e2d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:04.973267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf28dc9-83cf-4b5a-ab10-7b424c3e2d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:04.974110 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf28dc9-83cf-4b5a-ab10-7b424c3e2d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:04.975751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf28dc9-83cf-4b5a-ab10-7b424c3e2d01 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:04.985896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1185/2376] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:16:04.990111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81136484-7df0-4bbd-bbe0-e6a58ea483ea admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:05.002102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81136484-7df0-4bbd-bbe0-e6a58ea483ea admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:05.006786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f42279-1b85-44bc-9676-a50b25b3950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:05.008287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f42279-1b85-44bc-9676-a50b25b3950a admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:05.008550 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f42279-1b85-44bc-9676-a50b25b3950a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:05.008812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f42279-1b85-44bc-9676-a50b25b3950a admin admin] PATH_INFO: `/v3/projects/01b2225579344223938b65ee3485a282/users/23c7644e2269485cb2245005c894652a/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:05.010816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f42279-1b85-44bc-9676-a50b25b3950a admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b2225579344223938b65ee3485a282, user_id=23c7644e2269485cb2245005c894652a, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:05.013518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f42279-1b85-44bc-9676-a50b25b3950a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:05.024090 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1192/2377] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:16:04 2022] PUT /identity/v3/projects/01b2225579344223938b65ee3485a282/users/23c7644e2269485cb2245005c894652a/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:16:05.035419 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48670a1a-bb36-41c3-8713-b0893027245c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:05.035632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48670a1a-bb36-41c3-8713-b0893027245c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:05.035932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48670a1a-bb36-41c3-8713-b0893027245c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:05.063085 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-48670a1a-bb36-41c3-8713-b0893027245c None None] MFA Rules not processed for user `23c7644e2269485cb2245005c894652a`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:05.064310 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-48670a1a-bb36-41c3-8713-b0893027245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:05.138257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1186/2378] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:05.149205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f42279-1b85-44bc-9676-a50b25b3950a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:05.150967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b8f42279-1b85-44bc-9676-a50b25b3950a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:05.209835 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f42279-1b85-44bc-9676-a50b25b3950a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:05.213613 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857cf2b-6ff4-4498-a5f3-55f3f5defd3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:05.214252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857cf2b-6ff4-4498-a5f3-55f3f5defd3c service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:05.214537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857cf2b-6ff4-4498-a5f3-55f3f5defd3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:05.214816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857cf2b-6ff4-4498-a5f3-55f3f5defd3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:05.268859 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857cf2b-6ff4-4498-a5f3-55f3f5defd3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:05.270221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857cf2b-6ff4-4498-a5f3-55f3f5defd3c service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:05.278950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1193/2379] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:09.866405 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48670a1a-bb36-41c3-8713-b0893027245c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:09.876331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48670a1a-bb36-41c3-8713-b0893027245c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:09.879903 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cea06b-7b29-443c-8f8f-db9dd0e2523f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:09.880538 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cea06b-7b29-443c-8f8f-db9dd0e2523f service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:09.880811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cea06b-7b29-443c-8f8f-db9dd0e2523f service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:09.881080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cea06b-7b29-443c-8f8f-db9dd0e2523f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:09.889877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cea06b-7b29-443c-8f8f-db9dd0e2523f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:09.891282 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cea06b-7b29-443c-8f8f-db9dd0e2523f service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:09.900507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1187/2380] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:16:14.008899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857cf2b-6ff4-4498-a5f3-55f3f5defd3c service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:14.010961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6857cf2b-6ff4-4498-a5f3-55f3f5defd3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:14.066294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857cf2b-6ff4-4498-a5f3-55f3f5defd3c service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:14.069944 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98965ab-67dd-4f7d-b0fb-f2377f4a3f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:14.070586 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98965ab-67dd-4f7d-b0fb-f2377f4a3f60 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:14.070866 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98965ab-67dd-4f7d-b0fb-f2377f4a3f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:14.071141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98965ab-67dd-4f7d-b0fb-f2377f4a3f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:14.073537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d98965ab-67dd-4f7d-b0fb-f2377f4a3f60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:14.082860 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98965ab-67dd-4f7d-b0fb-f2377f4a3f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:14.084325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98965ab-67dd-4f7d-b0fb-f2377f4a3f60 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:14.092822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1194/2381] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:14.679288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f836d-0133-460b-881e-f81b05096a3c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:14.679821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f836d-0133-460b-881e-f81b05096a3c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:14.679953 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f836d-0133-460b-881e-f81b05096a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:14.699511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b52f836d-0133-460b-881e-f81b05096a3c None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:14.700751 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b52f836d-0133-460b-881e-f81b05096a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:14.755821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1188/2382] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 17:16:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:14.803121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98965ab-67dd-4f7d-b0fb-f2377f4a3f60 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:14.804529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d98965ab-67dd-4f7d-b0fb-f2377f4a3f60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:14.872456 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98965ab-67dd-4f7d-b0fb-f2377f4a3f60 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:14.878045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be8f9a-5090-44ec-8be8-d16f7d6196d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:14.878687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be8f9a-5090-44ec-8be8-d16f7d6196d4 service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:14.878968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be8f9a-5090-44ec-8be8-d16f7d6196d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:14.879243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be8f9a-5090-44ec-8be8-d16f7d6196d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:14.888253 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be8f9a-5090-44ec-8be8-d16f7d6196d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:14.889836 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be8f9a-5090-44ec-8be8-d16f7d6196d4 service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:14.897740 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1195/2383] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:16:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:16:16.134388 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f836d-0133-460b-881e-f81b05096a3c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:16.135954 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b52f836d-0133-460b-881e-f81b05096a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:16.248413 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f836d-0133-460b-881e-f81b05096a3c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:16.256148 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16949df-0582-4f7c-8986-b2360aa6cd55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:16.257130 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16949df-0582-4f7c-8986-b2360aa6cd55 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:16.257744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16949df-0582-4f7c-8986-b2360aa6cd55 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:16.258024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16949df-0582-4f7c-8986-b2360aa6cd55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:16.260080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e16949df-0582-4f7c-8986-b2360aa6cd55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:16.273669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16949df-0582-4f7c-8986-b2360aa6cd55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:16.276916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16949df-0582-4f7c-8986-b2360aa6cd55 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:16.289492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1189/2384] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:20.602355 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be8f9a-5090-44ec-8be8-d16f7d6196d4 service swift] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:20.604643 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a2be8f9a-5090-44ec-8be8-d16f7d6196d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:20.633285 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be8f9a-5090-44ec-8be8-d16f7d6196d4 service swift] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:20.646091 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a0b00-e2b6-4c34-96f0-9176b8973d77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:20.647387 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a0b00-e2b6-4c34-96f0-9176b8973d77 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:20.647917 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a0b00-e2b6-4c34-96f0-9176b8973d77 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:20.655911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a0b00-e2b6-4c34-96f0-9176b8973d77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:20.664551 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e48a0b00-e2b6-4c34-96f0-9176b8973d77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:20.712321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a0b00-e2b6-4c34-96f0-9176b8973d77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:20.716061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a0b00-e2b6-4c34-96f0-9176b8973d77 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:20.747039 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1196/2385] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:16:21.641222 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16949df-0582-4f7c-8986-b2360aa6cd55 service nova] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:21.644667 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e16949df-0582-4f7c-8986-b2360aa6cd55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:21.820338 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16949df-0582-4f7c-8986-b2360aa6cd55 service nova] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:21.836765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4bd4b-dfcc-4610-ac3f-6b45afe0b21b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7730d6cad2ba40c19cb671268cf04d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:21.839121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4bd4b-dfcc-4610-ac3f-6b45afe0b21b service placement] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:21.839366 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4bd4b-dfcc-4610-ac3f-6b45afe0b21b service placement] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:21.839808 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4bd4b-dfcc-4610-ac3f-6b45afe0b21b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:21.842349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f7c4bd4b-dfcc-4610-ac3f-6b45afe0b21b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:21.859441 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4bd4b-dfcc-4610-ac3f-6b45afe0b21b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:21.861159 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4bd4b-dfcc-4610-ac3f-6b45afe0b21b service placement] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:21.873994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1190/2386] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:24.432317 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7c44e-ef4f-456e-b8af-0a0c1db12335 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:24.432867 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7c44e-ef4f-456e-b8af-0a0c1db12335 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:24.432867 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7c44e-ef4f-456e-b8af-0a0c1db12335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:24.468308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b9c7c44e-ef4f-456e-b8af-0a0c1db12335 None None] MFA Rules not processed for user `61daaf70d25c4e1592fcb2f4feafff86`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:24.469763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b9c7c44e-ef4f-456e-b8af-0a0c1db12335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:24.562446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1197/2387] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:24.904419 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4bd4b-dfcc-4610-ac3f-6b45afe0b21b service placement] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:24.906050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f7c4bd4b-dfcc-4610-ac3f-6b45afe0b21b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:24.921434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4bd4b-dfcc-4610-ac3f-6b45afe0b21b service placement] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:24.925454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d62f72-7b2a-4454-99c5-8998e2585e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:24.925898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d62f72-7b2a-4454-99c5-8998e2585e00 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:24.926182 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d62f72-7b2a-4454-99c5-8998e2585e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:24.926459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d62f72-7b2a-4454-99c5-8998e2585e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:24.928570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-16d62f72-7b2a-4454-99c5-8998e2585e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:24.941644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d62f72-7b2a-4454-99c5-8998e2585e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:24.943045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d62f72-7b2a-4454-99c5-8998e2585e00 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:24.953330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1191/2388] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:34.548047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bd5d3-7585-48a6-812f-025ed98da143 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:34.548570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bd5d3-7585-48a6-812f-025ed98da143 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:34.548671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bd5d3-7585-48a6-812f-025ed98da143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:34.566418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8d2bd5d3-7585-48a6-812f-025ed98da143 None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:34.567596 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8d2bd5d3-7585-48a6-812f-025ed98da143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:34.575683 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1198/2389] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 17:16:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:34.588342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d62f72-7b2a-4454-99c5-8998e2585e00 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:34.600305 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d62f72-7b2a-4454-99c5-8998e2585e00 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:34.606820 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569b428-8868-4810-8c85-77b3e915cb97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:34.608773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569b428-8868-4810-8c85-77b3e915cb97 service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:34.609078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569b428-8868-4810-8c85-77b3e915cb97 service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:34.609362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569b428-8868-4810-8c85-77b3e915cb97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:34.619131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569b428-8868-4810-8c85-77b3e915cb97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:34.620765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569b428-8868-4810-8c85-77b3e915cb97 service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:34.629440 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1192/2390] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:16:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:16:35.510221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bd5d3-7585-48a6-812f-025ed98da143 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:35.577708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bd5d3-7585-48a6-812f-025ed98da143 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:35.582383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2101b9-57d7-4404-8341-526d13d47cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:35.583266 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2101b9-57d7-4404-8341-526d13d47cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:35.583548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2101b9-57d7-4404-8341-526d13d47cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:35.583849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2101b9-57d7-4404-8341-526d13d47cd2 admin admin] PATH_INFO: `/v3/users/a04cbadb774f4c7c96a234e4af2072e8` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:35.585035 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2101b9-57d7-4404-8341-526d13d47cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04cbadb774f4c7c96a234e4af2072e8)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:35.587387 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2101b9-57d7-4404-8341-526d13d47cd2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:35.636115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5f2101b9-57d7-4404-8341-526d13d47cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04cbadb774f4c7c96a234e4af2072e8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:35.655462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5f2101b9-57d7-4404-8341-526d13d47cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04cbadb774f4c7c96a234e4af2072e8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:35.663858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5f2101b9-57d7-4404-8341-526d13d47cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04cbadb774f4c7c96a234e4af2072e8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:35.665161 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5f2101b9-57d7-4404-8341-526d13d47cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04cbadb774f4c7c96a234e4af2072e8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:35.665866 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5f2101b9-57d7-4404-8341-526d13d47cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04cbadb774f4c7c96a234e4af2072e8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:35.682311 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1199/2391] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:16:35 2022] DELETE /identity/v3/users/a04cbadb774f4c7c96a234e4af2072e8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:35.686967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bffec4-aa0b-4009-b0f9-70a6b83770e8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:35.687638 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bffec4-aa0b-4009-b0f9-70a6b83770e8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:35.687638 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bffec4-aa0b-4009-b0f9-70a6b83770e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:35.705337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-96bffec4-aa0b-4009-b0f9-70a6b83770e8 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:35.706534 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-96bffec4-aa0b-4009-b0f9-70a6b83770e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:35.766936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1193/2392] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:35.777362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2101b9-57d7-4404-8341-526d13d47cd2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:35.779336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5f2101b9-57d7-4404-8341-526d13d47cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:35.844689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2101b9-57d7-4404-8341-526d13d47cd2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:35.848245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea66033-1c52-4957-917c-4e9d7b9a634d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:35.848886 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea66033-1c52-4957-917c-4e9d7b9a634d service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:35.849161 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea66033-1c52-4957-917c-4e9d7b9a634d service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:35.849463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea66033-1c52-4957-917c-4e9d7b9a634d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:35.860524 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea66033-1c52-4957-917c-4e9d7b9a634d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:35.861983 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea66033-1c52-4957-917c-4e9d7b9a634d service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:35.874797 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1200/2393] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:36.178036 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bffec4-aa0b-4009-b0f9-70a6b83770e8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:36.179573 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-96bffec4-aa0b-4009-b0f9-70a6b83770e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:36.210300 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bffec4-aa0b-4009-b0f9-70a6b83770e8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:36.224590 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9545bb-588c-4dac-9afa-01f1c9308ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:36.225633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9545bb-588c-4dac-9afa-01f1c9308ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:36.225941 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9545bb-588c-4dac-9afa-01f1c9308ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:36.226233 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9545bb-588c-4dac-9afa-01f1c9308ced admin admin] PATH_INFO: `/v3/projects/2987c5e77a5a43159d644d40340ce433` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:36.227707 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9545bb-588c-4dac-9afa-01f1c9308ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=2987c5e77a5a43159d644d40340ce433)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:36.229861 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9545bb-588c-4dac-9afa-01f1c9308ced admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:36.279734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d9545bb-588c-4dac-9afa-01f1c9308ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2987c5e77a5a43159d644d40340ce433', 'request_id': 'req-6d9545bb-588c-4dac-9afa-01f1c9308ced'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:36.286414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d9545bb-588c-4dac-9afa-01f1c9308ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2987c5e77a5a43159d644d40340ce433', 'request_id': 'req-6d9545bb-588c-4dac-9afa-01f1c9308ced'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:36.304407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d9545bb-588c-4dac-9afa-01f1c9308ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2987c5e77a5a43159d644d40340ce433', 'request_id': 'req-6d9545bb-588c-4dac-9afa-01f1c9308ced'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:36.320392 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d9545bb-588c-4dac-9afa-01f1c9308ced admin admin] The token cache is being invalidate because project 2987c5e77a5a43159d644d40340ce433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:16:36.321224 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d9545bb-588c-4dac-9afa-01f1c9308ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:36.322093 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-6d9545bb-588c-4dac-9afa-01f1c9308ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:36.324392 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1194/2394] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:16:36 2022] DELETE /identity/v3/projects/2987c5e77a5a43159d644d40340ce433 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:16:36.327726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea66033-1c52-4957-917c-4e9d7b9a634d service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:36.339036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea66033-1c52-4957-917c-4e9d7b9a634d service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:36.441488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5682205-f4f3-4e60-922e-fcfdd9445364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:36.442871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5682205-f4f3-4e60-922e-fcfdd9445364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:36.443310 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5682205-f4f3-4e60-922e-fcfdd9445364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:36.443771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5682205-f4f3-4e60-922e-fcfdd9445364 admin admin] PATH_INFO: `/v3/users/23c7644e2269485cb2245005c894652a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:36.470640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5682205-f4f3-4e60-922e-fcfdd9445364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c7644e2269485cb2245005c894652a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:36.472621 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5682205-f4f3-4e60-922e-fcfdd9445364 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:36.580129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c5682205-f4f3-4e60-922e-fcfdd9445364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c7644e2269485cb2245005c894652a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:36.595376 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c5682205-f4f3-4e60-922e-fcfdd9445364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c7644e2269485cb2245005c894652a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:36.604626 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c5682205-f4f3-4e60-922e-fcfdd9445364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c7644e2269485cb2245005c894652a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:36.605679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c5682205-f4f3-4e60-922e-fcfdd9445364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c7644e2269485cb2245005c894652a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:36.606641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c5682205-f4f3-4e60-922e-fcfdd9445364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c7644e2269485cb2245005c894652a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:36.627719 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1201/2395] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:16:36 2022] DELETE /identity/v3/users/23c7644e2269485cb2245005c894652a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:37.108788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9545bb-588c-4dac-9afa-01f1c9308ced admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:37.110218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6d9545bb-588c-4dac-9afa-01f1c9308ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:37.125141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9545bb-588c-4dac-9afa-01f1c9308ced admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:37.194352 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c413a2-cc42-458d-abab-f7b3d6ac4c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:37.195550 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c413a2-cc42-458d-abab-f7b3d6ac4c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:37.196012 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c413a2-cc42-458d-abab-f7b3d6ac4c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:37.196470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c413a2-cc42-458d-abab-f7b3d6ac4c45 admin admin] PATH_INFO: `/v3/projects/01b2225579344223938b65ee3485a282` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:37.197921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c413a2-cc42-458d-abab-f7b3d6ac4c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b2225579344223938b65ee3485a282)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:37.200048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c413a2-cc42-458d-abab-f7b3d6ac4c45 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:37.249803 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-67c413a2-cc42-458d-abab-f7b3d6ac4c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b2225579344223938b65ee3485a282', 'request_id': 'req-67c413a2-cc42-458d-abab-f7b3d6ac4c45'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:37.255049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-67c413a2-cc42-458d-abab-f7b3d6ac4c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b2225579344223938b65ee3485a282', 'request_id': 'req-67c413a2-cc42-458d-abab-f7b3d6ac4c45'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:37.264527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-67c413a2-cc42-458d-abab-f7b3d6ac4c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b2225579344223938b65ee3485a282', 'request_id': 'req-67c413a2-cc42-458d-abab-f7b3d6ac4c45'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:37.279291 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-67c413a2-cc42-458d-abab-f7b3d6ac4c45 admin admin] The token cache is being invalidate because project 01b2225579344223938b65ee3485a282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:16:37.279761 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-67c413a2-cc42-458d-abab-f7b3d6ac4c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:37.280633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-67c413a2-cc42-458d-abab-f7b3d6ac4c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:37.286494 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1195/2396] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:16:37 2022] DELETE /identity/v3/projects/01b2225579344223938b65ee3485a282 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:37.287983 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e742f2-8341-4adc-b491-d78128148528 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:37.288614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e742f2-8341-4adc-b491-d78128148528 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:37.288614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e742f2-8341-4adc-b491-d78128148528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:37.313571 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-47e742f2-8341-4adc-b491-d78128148528 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:37.315173 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-47e742f2-8341-4adc-b491-d78128148528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:37.376729 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1202/2397] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:16:37.384807 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc37f8d-529b-4d27-a674-f1ad76856309 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:37.385093 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc37f8d-529b-4d27-a674-f1ad76856309 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:37.385370 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc37f8d-529b-4d27-a674-f1ad76856309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:37.408684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3bc37f8d-529b-4d27-a674-f1ad76856309 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:37.409900 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3bc37f8d-529b-4d27-a674-f1ad76856309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:37.421805 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1196/2398] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:16:37.423075 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e742f2-8341-4adc-b491-d78128148528 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:37.433486 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e742f2-8341-4adc-b491-d78128148528 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:37.438424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68f591-e16b-4a14-927e-32e461b7b3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:37.439077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68f591-e16b-4a14-927e-32e461b7b3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:37.439354 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68f591-e16b-4a14-927e-32e461b7b3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:37.439643 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68f591-e16b-4a14-927e-32e461b7b3b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:37.440367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68f591-e16b-4a14-927e-32e461b7b3b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:16:37.440666 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68f591-e16b-4a14-927e-32e461b7b3b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:37.442295 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68f591-e16b-4a14-927e-32e461b7b3b0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:37.453995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1203/2399] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:16:37.458411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc37f8d-529b-4d27-a674-f1ad76856309 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:37.468904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc37f8d-529b-4d27-a674-f1ad76856309 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:37.473211 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b4a5e-4acf-4378-93ef-9ece0decd51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:37.473875 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b4a5e-4acf-4378-93ef-9ece0decd51e admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:37.474153 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b4a5e-4acf-4378-93ef-9ece0decd51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:37.474425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b4a5e-4acf-4378-93ef-9ece0decd51e admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:37.475165 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b4a5e-4acf-4378-93ef-9ece0decd51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:37.477620 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b4a5e-4acf-4378-93ef-9ece0decd51e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:37.531640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1197/2400] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:16:37 2022] POST /identity/v3/projects => generated 393 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:16:37.535138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68f591-e16b-4a14-927e-32e461b7b3b0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:37.545902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68f591-e16b-4a14-927e-32e461b7b3b0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:37.622810 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1d8dd-cd8d-4f34-875a-0d777adbb094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:37.623513 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1d8dd-cd8d-4f34-875a-0d777adbb094 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:37.623820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1d8dd-cd8d-4f34-875a-0d777adbb094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:37.624097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1d8dd-cd8d-4f34-875a-0d777adbb094 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:37.624847 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1d8dd-cd8d-4f34-875a-0d777adbb094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:37.627091 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1d8dd-cd8d-4f34-875a-0d777adbb094 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:37.657814 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1204/2401] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:16:37 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:16:37.661805 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b4a5e-4acf-4378-93ef-9ece0decd51e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:37.673036 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b4a5e-4acf-4378-93ef-9ece0decd51e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:37.681116 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90486b1-9b14-4cee-bce1-2f41c64156f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:37.682240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90486b1-9b14-4cee-bce1-2f41c64156f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:37.682746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90486b1-9b14-4cee-bce1-2f41c64156f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:37.683214 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90486b1-9b14-4cee-bce1-2f41c64156f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:37.684191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90486b1-9b14-4cee-bce1-2f41c64156f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:37.686075 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90486b1-9b14-4cee-bce1-2f41c64156f2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:37.700571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1198/2402] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:16:37.705379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1d8dd-cd8d-4f34-875a-0d777adbb094 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:37.716136 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1d8dd-cd8d-4f34-875a-0d777adbb094 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:37.730931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a14b9-a0c4-42f1-a3f9-3c7cbf35dffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:37.731754 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a14b9-a0c4-42f1-a3f9-3c7cbf35dffb admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:37.732034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a14b9-a0c4-42f1-a3f9-3c7cbf35dffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:37.732324 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a14b9-a0c4-42f1-a3f9-3c7cbf35dffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:37.733089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a14b9-a0c4-42f1-a3f9-3c7cbf35dffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:37.734708 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a14b9-a0c4-42f1-a3f9-3c7cbf35dffb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:37.762601 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1205/2403] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:16:37.764502 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90486b1-9b14-4cee-bce1-2f41c64156f2 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:37.774706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90486b1-9b14-4cee-bce1-2f41c64156f2 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:37.779876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c4d1a-e21c-48d1-b2e3-8207ac4e3c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:37.780763 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c4d1a-e21c-48d1-b2e3-8207ac4e3c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:37.781088 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c4d1a-e21c-48d1-b2e3-8207ac4e3c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:37.781315 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c4d1a-e21c-48d1-b2e3-8207ac4e3c81 admin admin] PATH_INFO: `/v3/projects/3bb8fcd1865e4f50b21ceb207898483a/users/30b039d2130546ad901e0267110a16d3/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:37.797550 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c4d1a-e21c-48d1-b2e3-8207ac4e3c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb8fcd1865e4f50b21ceb207898483a, user_id=30b039d2130546ad901e0267110a16d3, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:37.800532 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c4d1a-e21c-48d1-b2e3-8207ac4e3c81 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:37.815343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1199/2404] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:16:37 2022] PUT /identity/v3/projects/3bb8fcd1865e4f50b21ceb207898483a/users/30b039d2130546ad901e0267110a16d3/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:37.828079 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c71c03-f9fb-425f-9e1e-26a39578033b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:37.828372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c71c03-f9fb-425f-9e1e-26a39578033b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:37.828648 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c71c03-f9fb-425f-9e1e-26a39578033b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:37.877437 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e4c71c03-f9fb-425f-9e1e-26a39578033b None None] MFA Rules not processed for user `30b039d2130546ad901e0267110a16d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:37.878838 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e4c71c03-f9fb-425f-9e1e-26a39578033b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:38.003666 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1206/2405] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:38.004723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c4d1a-e21c-48d1-b2e3-8207ac4e3c81 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:38.143852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c4d1a-e21c-48d1-b2e3-8207ac4e3c81 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:38.173195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a5e3d-6437-4bbe-97e6-0bf0e80c75e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:38.173979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a5e3d-6437-4bbe-97e6-0bf0e80c75e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:38.174261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a5e3d-6437-4bbe-97e6-0bf0e80c75e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:38.174539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a5e3d-6437-4bbe-97e6-0bf0e80c75e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:38.175234 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a5e3d-6437-4bbe-97e6-0bf0e80c75e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:38.177193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a5e3d-6437-4bbe-97e6-0bf0e80c75e8 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:38.285636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1200/2406] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:16:38 2022] POST /identity/v3/projects => generated 391 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:16:38.292773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c71c03-f9fb-425f-9e1e-26a39578033b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:38.306584 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c71c03-f9fb-425f-9e1e-26a39578033b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:38.376266 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d1363-61f2-44b6-a9cf-a3359019fe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:38.377076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d1363-61f2-44b6-a9cf-a3359019fe1c admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:38.377357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d1363-61f2-44b6-a9cf-a3359019fe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:38.377630 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d1363-61f2-44b6-a9cf-a3359019fe1c admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:38.378334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d1363-61f2-44b6-a9cf-a3359019fe1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:38.380311 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d1363-61f2-44b6-a9cf-a3359019fe1c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:38.402703 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1207/2407] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:16:38 2022] POST /identity/v3/users => generated 302 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:16:38.407225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a5e3d-6437-4bbe-97e6-0bf0e80c75e8 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:38.429423 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a5e3d-6437-4bbe-97e6-0bf0e80c75e8 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:38.446022 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f499ea-0516-4ce4-b16d-bd91f3f3313c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:38.447156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f499ea-0516-4ce4-b16d-bd91f3f3313c admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:38.447648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f499ea-0516-4ce4-b16d-bd91f3f3313c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:38.448590 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f499ea-0516-4ce4-b16d-bd91f3f3313c admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:38.449926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f499ea-0516-4ce4-b16d-bd91f3f3313c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:38.455058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f499ea-0516-4ce4-b16d-bd91f3f3313c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:38.485244 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1201/2408] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:16:38.489399 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d1363-61f2-44b6-a9cf-a3359019fe1c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:38.500502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d1363-61f2-44b6-a9cf-a3359019fe1c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:38.505281 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b0726-4c73-4e5d-9c13-03045c878f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:38.506193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b0726-4c73-4e5d-9c13-03045c878f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:38.506478 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b0726-4c73-4e5d-9c13-03045c878f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:38.506803 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b0726-4c73-4e5d-9c13-03045c878f4b admin admin] PATH_INFO: `/v3/projects/a4d1fe52b255485ba319341ce6eb1248/users/bc524e7793764e47b5288f4a4bfc636e/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:38.536606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b0726-4c73-4e5d-9c13-03045c878f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d1fe52b255485ba319341ce6eb1248, user_id=bc524e7793764e47b5288f4a4bfc636e, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:38.540058 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b0726-4c73-4e5d-9c13-03045c878f4b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:38.560122 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1208/2409] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:16:38 2022] PUT /identity/v3/projects/a4d1fe52b255485ba319341ce6eb1248/users/bc524e7793764e47b5288f4a4bfc636e/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:38.564188 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f499ea-0516-4ce4-b16d-bd91f3f3313c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:38.575706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f499ea-0516-4ce4-b16d-bd91f3f3313c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:38.640766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed244b49-bebb-42fb-9d88-c7e3c188ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:38.641505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed244b49-bebb-42fb-9d88-c7e3c188ad94 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:38.641837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed244b49-bebb-42fb-9d88-c7e3c188ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:38.642118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed244b49-bebb-42fb-9d88-c7e3c188ad94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:38.643033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed244b49-bebb-42fb-9d88-c7e3c188ad94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:38.644781 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed244b49-bebb-42fb-9d88-c7e3c188ad94 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:38.674771 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1202/2410] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:16:38.678906 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b0726-4c73-4e5d-9c13-03045c878f4b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:38.701651 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b0726-4c73-4e5d-9c13-03045c878f4b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:38.701651 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63480b-143b-42f6-bc22-b16d4eb7223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:38.701651 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63480b-143b-42f6-bc22-b16d4eb7223f admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:38.701651 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63480b-143b-42f6-bc22-b16d4eb7223f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:38.702177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63480b-143b-42f6-bc22-b16d4eb7223f admin admin] PATH_INFO: `/v3/projects/a4d1fe52b255485ba319341ce6eb1248/users/bc524e7793764e47b5288f4a4bfc636e/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:38.702177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63480b-143b-42f6-bc22-b16d4eb7223f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d1fe52b255485ba319341ce6eb1248, user_id=bc524e7793764e47b5288f4a4bfc636e, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:38.704381 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63480b-143b-42f6-bc22-b16d4eb7223f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:38.719071 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1209/2411] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:16:38 2022] PUT /identity/v3/projects/a4d1fe52b255485ba319341ce6eb1248/users/bc524e7793764e47b5288f4a4bfc636e/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:38.732791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d1248-7eab-4d31-b752-21516da5dbe7 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:38.733377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d1248-7eab-4d31-b752-21516da5dbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:38.733855 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d1248-7eab-4d31-b752-21516da5dbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:38.797398 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-bb1d1248-7eab-4d31-b752-21516da5dbe7 None None] MFA Rules not processed for user `bc524e7793764e47b5288f4a4bfc636e`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:38.798800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-bb1d1248-7eab-4d31-b752-21516da5dbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:38.915183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1203/2412] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:38.926324 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63480b-143b-42f6-bc22-b16d4eb7223f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:38.928065 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0f63480b-143b-42f6-bc22-b16d4eb7223f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:39.006909 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63480b-143b-42f6-bc22-b16d4eb7223f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:39.011458 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7e829-0ff4-48d6-903d-3cc2d6805cdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:39.012154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7e829-0ff4-48d6-903d-3cc2d6805cdb service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:39.012432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7e829-0ff4-48d6-903d-3cc2d6805cdb service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:39.012699 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7e829-0ff4-48d6-903d-3cc2d6805cdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:39.023031 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7e829-0ff4-48d6-903d-3cc2d6805cdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:39.025795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7e829-0ff4-48d6-903d-3cc2d6805cdb service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:39.037946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1210/2413] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:39.088063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d1248-7eab-4d31-b752-21516da5dbe7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:39.089849 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-bb1d1248-7eab-4d31-b752-21516da5dbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:39.106306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d1248-7eab-4d31-b752-21516da5dbe7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:39.110551 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e73f1-a977-442c-a60b-5347b3fa6235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:39.111506 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e73f1-a977-442c-a60b-5347b3fa6235 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:39.112064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e73f1-a977-442c-a60b-5347b3fa6235 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:39.112571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e73f1-a977-442c-a60b-5347b3fa6235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:39.172017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e73f1-a977-442c-a60b-5347b3fa6235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:39.174627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e73f1-a977-442c-a60b-5347b3fa6235 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:39.184836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1204/2414] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:42.698377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7e829-0ff4-48d6-903d-3cc2d6805cdb service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:42.767407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7e829-0ff4-48d6-903d-3cc2d6805cdb service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:42.772271 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8e0fd-914a-42ae-aa8f-ce6c64d3953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:42.773147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8e0fd-914a-42ae-aa8f-ce6c64d3953b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:42.773448 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8e0fd-914a-42ae-aa8f-ce6c64d3953b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:42.773725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8e0fd-914a-42ae-aa8f-ce6c64d3953b admin admin] PATH_INFO: `/v3/users/30b039d2130546ad901e0267110a16d3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:42.775371 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8e0fd-914a-42ae-aa8f-ce6c64d3953b admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b039d2130546ad901e0267110a16d3)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:42.777436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8e0fd-914a-42ae-aa8f-ce6c64d3953b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:42.830445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7dc8e0fd-914a-42ae-aa8f-ce6c64d3953b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b039d2130546ad901e0267110a16d3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:42.843820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7dc8e0fd-914a-42ae-aa8f-ce6c64d3953b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b039d2130546ad901e0267110a16d3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:42.851078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7dc8e0fd-914a-42ae-aa8f-ce6c64d3953b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b039d2130546ad901e0267110a16d3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:42.851884 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7dc8e0fd-914a-42ae-aa8f-ce6c64d3953b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b039d2130546ad901e0267110a16d3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:42.852489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7dc8e0fd-914a-42ae-aa8f-ce6c64d3953b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b039d2130546ad901e0267110a16d3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:42.867843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1211/2415] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:16:42 2022] DELETE /identity/v3/users/30b039d2130546ad901e0267110a16d3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:42.872988 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a0c5f-3592-47a5-9714-7ddef7d13e98 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:42.873497 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a0c5f-3592-47a5-9714-7ddef7d13e98 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:42.873611 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a0c5f-3592-47a5-9714-7ddef7d13e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:42.890270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-4d4a0c5f-3592-47a5-9714-7ddef7d13e98 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:42.891446 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4d4a0c5f-3592-47a5-9714-7ddef7d13e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:42.964787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1205/2416] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:42.972862 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8e0fd-914a-42ae-aa8f-ce6c64d3953b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:42.974266 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7dc8e0fd-914a-42ae-aa8f-ce6c64d3953b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:43.038980 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8e0fd-914a-42ae-aa8f-ce6c64d3953b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:43.044208 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8983881-ae5c-4039-bca4-d633d2e91ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:43.045026 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8983881-ae5c-4039-bca4-d633d2e91ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:43.045315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8983881-ae5c-4039-bca4-d633d2e91ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:43.045598 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8983881-ae5c-4039-bca4-d633d2e91ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:43.061682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8983881-ae5c-4039-bca4-d633d2e91ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:43.063432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8983881-ae5c-4039-bca4-d633d2e91ba8 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:43.078393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1212/2417] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:43.488892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a0c5f-3592-47a5-9714-7ddef7d13e98 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:43.490392 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4d4a0c5f-3592-47a5-9714-7ddef7d13e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:43.503244 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a0c5f-3592-47a5-9714-7ddef7d13e98 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:43.507980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:43.509675 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:43.509917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:43.510041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e admin admin] PATH_INFO: `/v3/projects/3bb8fcd1865e4f50b21ceb207898483a` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:43.511517 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb8fcd1865e4f50b21ceb207898483a)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:43.513555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:43.553655 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8983881-ae5c-4039-bca4-d633d2e91ba8 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:43.555030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a8983881-ae5c-4039-bca4-d633d2e91ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:43.561469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb8fcd1865e4f50b21ceb207898483a', 'request_id': 'req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:43.567596 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb8fcd1865e4f50b21ceb207898483a', 'request_id': 'req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:43.575458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb8fcd1865e4f50b21ceb207898483a', 'request_id': 'req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:43.586558 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e admin admin] The token cache is being invalidate because project 3bb8fcd1865e4f50b21ceb207898483a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:16:43.586847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:43.587591 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:43.589330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1206/2418] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:16:43 2022] DELETE /identity/v3/projects/3bb8fcd1865e4f50b21ceb207898483a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:43.593169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:43.594488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:43.630580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8983881-ae5c-4039-bca4-d633d2e91ba8 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:43.657521 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61d6bd-31b0-418a-9e5e-8fbfedf49d6e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:43.662125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5375bd-9f59-4b0a-b70c-c1b950fe5c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:43.663056 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5375bd-9f59-4b0a-b70c-c1b950fe5c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:43.663324 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5375bd-9f59-4b0a-b70c-c1b950fe5c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:43.663624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5375bd-9f59-4b0a-b70c-c1b950fe5c2a admin admin] PATH_INFO: `/v3/users/bc524e7793764e47b5288f4a4bfc636e` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:43.664806 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5375bd-9f59-4b0a-b70c-c1b950fe5c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc524e7793764e47b5288f4a4bfc636e)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:43.667211 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5375bd-9f59-4b0a-b70c-c1b950fe5c2a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:43.693594 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d4c40-66ae-4608-89a1-265642d5d0d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:43.694250 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d4c40-66ae-4608-89a1-265642d5d0d4 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:43.694535 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d4c40-66ae-4608-89a1-265642d5d0d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:43.694807 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d4c40-66ae-4608-89a1-265642d5d0d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:43.697321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4d7d4c40-66ae-4608-89a1-265642d5d0d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:43.713779 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2f5375bd-9f59-4b0a-b70c-c1b950fe5c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc524e7793764e47b5288f4a4bfc636e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:43.714453 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2f5375bd-9f59-4b0a-b70c-c1b950fe5c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc524e7793764e47b5288f4a4bfc636e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:43.726141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2f5375bd-9f59-4b0a-b70c-c1b950fe5c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc524e7793764e47b5288f4a4bfc636e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:43.733734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2f5375bd-9f59-4b0a-b70c-c1b950fe5c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc524e7793764e47b5288f4a4bfc636e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:43.734430 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2f5375bd-9f59-4b0a-b70c-c1b950fe5c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc524e7793764e47b5288f4a4bfc636e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:43.748939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1207/2419] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:16:43 2022] DELETE /identity/v3/users/bc524e7793764e47b5288f4a4bfc636e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:16:43.754941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d4c40-66ae-4608-89a1-265642d5d0d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:43.756606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d4c40-66ae-4608-89a1-265642d5d0d4 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:43.765829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1213/2420] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:16:44.033846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5375bd-9f59-4b0a-b70c-c1b950fe5c2a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:44.045881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2f5375bd-9f59-4b0a-b70c-c1b950fe5c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:44.100092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5375bd-9f59-4b0a-b70c-c1b950fe5c2a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:44.105430 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626efb50-e510-408c-8a44-5f65ce5ef97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:44.106335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626efb50-e510-408c-8a44-5f65ce5ef97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:44.106565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626efb50-e510-408c-8a44-5f65ce5ef97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:44.106836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626efb50-e510-408c-8a44-5f65ce5ef97e admin admin] PATH_INFO: `/v3/projects/a4d1fe52b255485ba319341ce6eb1248` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:44.108040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626efb50-e510-408c-8a44-5f65ce5ef97e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d1fe52b255485ba319341ce6eb1248)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:44.109940 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626efb50-e510-408c-8a44-5f65ce5ef97e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:44.154710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-626efb50-e510-408c-8a44-5f65ce5ef97e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d1fe52b255485ba319341ce6eb1248', 'request_id': 'req-626efb50-e510-408c-8a44-5f65ce5ef97e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:44.159919 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-626efb50-e510-408c-8a44-5f65ce5ef97e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d1fe52b255485ba319341ce6eb1248', 'request_id': 'req-626efb50-e510-408c-8a44-5f65ce5ef97e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:44.169311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-626efb50-e510-408c-8a44-5f65ce5ef97e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d1fe52b255485ba319341ce6eb1248', 'request_id': 'req-626efb50-e510-408c-8a44-5f65ce5ef97e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:44.179982 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-626efb50-e510-408c-8a44-5f65ce5ef97e admin admin] The token cache is being invalidate because project a4d1fe52b255485ba319341ce6eb1248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:16:44.180270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-626efb50-e510-408c-8a44-5f65ce5ef97e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:44.180928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-626efb50-e510-408c-8a44-5f65ce5ef97e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:44.182458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1208/2421] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:16:44 2022] DELETE /identity/v3/projects/a4d1fe52b255485ba319341ce6eb1248 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:44.187470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc6278-7313-46fb-bb0e-eadf3c65f3b3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:44.187782 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc6278-7313-46fb-bb0e-eadf3c65f3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:44.188082 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc6278-7313-46fb-bb0e-eadf3c65f3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:44.205875 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6acc6278-7313-46fb-bb0e-eadf3c65f3b3 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:44.207042 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6acc6278-7313-46fb-bb0e-eadf3c65f3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:44.264435 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1214/2422] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:44.272285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df62818-f099-48a9-afc7-210c9cdda398 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:44.272575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df62818-f099-48a9-afc7-210c9cdda398 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:44.272855 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df62818-f099-48a9-afc7-210c9cdda398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:44.291494 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2df62818-f099-48a9-afc7-210c9cdda398 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:44.292726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2df62818-f099-48a9-afc7-210c9cdda398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:44.301016 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1209/2423] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:44.305222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc6278-7313-46fb-bb0e-eadf3c65f3b3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:44.315804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc6278-7313-46fb-bb0e-eadf3c65f3b3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:44.320781 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78e351-1bc4-4fce-ab2d-5a309dfd210d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:44.322099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e351-1bc4-4fce-ab2d-5a309dfd210d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:44.322980 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e351-1bc4-4fce-ab2d-5a309dfd210d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:44.323266 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e351-1bc4-4fce-ab2d-5a309dfd210d admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:44.324036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78e351-1bc4-4fce-ab2d-5a309dfd210d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:16:44.324348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78e351-1bc4-4fce-ab2d-5a309dfd210d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:44.325957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78e351-1bc4-4fce-ab2d-5a309dfd210d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:44.339397 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1215/2424] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:16:44.343465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df62818-f099-48a9-afc7-210c9cdda398 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:44.353893 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df62818-f099-48a9-afc7-210c9cdda398 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:44.359698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb1553-ccbd-463e-8727-9ca271ccc921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:44.360515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb1553-ccbd-463e-8727-9ca271ccc921 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:44.360947 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb1553-ccbd-463e-8727-9ca271ccc921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:44.361226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb1553-ccbd-463e-8727-9ca271ccc921 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:44.362140 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb1553-ccbd-463e-8727-9ca271ccc921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:44.364069 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb1553-ccbd-463e-8727-9ca271ccc921 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:44.390568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1210/2425] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:16:44 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:16:44.394773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78e351-1bc4-4fce-ab2d-5a309dfd210d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:44.405667 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78e351-1bc4-4fce-ab2d-5a309dfd210d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:44.462792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f3334-1c22-42fb-949a-b99bc6bde292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:44.463306 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f3334-1c22-42fb-949a-b99bc6bde292 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:44.463683 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f3334-1c22-42fb-949a-b99bc6bde292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:44.463956 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f3334-1c22-42fb-949a-b99bc6bde292 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:44.464635 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f3334-1c22-42fb-949a-b99bc6bde292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:44.466602 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f3334-1c22-42fb-949a-b99bc6bde292 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:44.495178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1216/2426] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:16:44 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:16:44.496412 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb1553-ccbd-463e-8727-9ca271ccc921 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:44.506237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb1553-ccbd-463e-8727-9ca271ccc921 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:44.511646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140746cb-d3cc-4a8a-834c-f14b32b02c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:44.512359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140746cb-d3cc-4a8a-834c-f14b32b02c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:44.512568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140746cb-d3cc-4a8a-834c-f14b32b02c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:44.512840 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140746cb-d3cc-4a8a-834c-f14b32b02c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:44.513561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140746cb-d3cc-4a8a-834c-f14b32b02c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:44.515289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140746cb-d3cc-4a8a-834c-f14b32b02c7e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:44.526986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1211/2427] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:16:44.532900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f3334-1c22-42fb-949a-b99bc6bde292 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:44.543295 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f3334-1c22-42fb-949a-b99bc6bde292 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:44.548221 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db912c62-bfe6-48d6-9787-d82775f987eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:44.548968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db912c62-bfe6-48d6-9787-d82775f987eb admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:44.549257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db912c62-bfe6-48d6-9787-d82775f987eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:44.549534 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db912c62-bfe6-48d6-9787-d82775f987eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:44.550286 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db912c62-bfe6-48d6-9787-d82775f987eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:44.551944 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db912c62-bfe6-48d6-9787-d82775f987eb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:44.561804 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1217/2428] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:16:44.565843 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140746cb-d3cc-4a8a-834c-f14b32b02c7e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:44.576411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140746cb-d3cc-4a8a-834c-f14b32b02c7e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:44.580953 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f33972-cb2e-450e-bba3-d5c6fd71ed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:44.581813 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33972-cb2e-450e-bba3-d5c6fd71ed15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:44.582198 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33972-cb2e-450e-bba3-d5c6fd71ed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:44.582477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33972-cb2e-450e-bba3-d5c6fd71ed15 admin admin] PATH_INFO: `/v3/projects/22d468ebf6ba4a06b2709970576a4925/users/d281ce2722dc490a94dd11c70da10d8d/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:44.596989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f33972-cb2e-450e-bba3-d5c6fd71ed15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d468ebf6ba4a06b2709970576a4925, user_id=d281ce2722dc490a94dd11c70da10d8d, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:44.599647 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f33972-cb2e-450e-bba3-d5c6fd71ed15 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:44.612653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1212/2429] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:16:44 2022] PUT /identity/v3/projects/22d468ebf6ba4a06b2709970576a4925/users/d281ce2722dc490a94dd11c70da10d8d/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:44.624227 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95351ca-df82-49c4-9514-cba7aaec89e9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:44.624523 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95351ca-df82-49c4-9514-cba7aaec89e9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:44.624806 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95351ca-df82-49c4-9514-cba7aaec89e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:44.652764 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c95351ca-df82-49c4-9514-cba7aaec89e9 None None] MFA Rules not processed for user `d281ce2722dc490a94dd11c70da10d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:44.654233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c95351ca-df82-49c4-9514-cba7aaec89e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:44.717067 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1218/2430] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:44.728680 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f33972-cb2e-450e-bba3-d5c6fd71ed15 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:44.730343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b1f33972-cb2e-450e-bba3-d5c6fd71ed15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:44.792641 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f33972-cb2e-450e-bba3-d5c6fd71ed15 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:44.796505 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1be2d-51e3-4449-b046-39a08d1b70a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:44.797143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1be2d-51e3-4449-b046-39a08d1b70a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:44.797424 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1be2d-51e3-4449-b046-39a08d1b70a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:44.797698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1be2d-51e3-4449-b046-39a08d1b70a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:44.806551 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1be2d-51e3-4449-b046-39a08d1b70a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:44.808025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1be2d-51e3-4449-b046-39a08d1b70a6 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:44.816720 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1213/2431] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:44.835893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95351ca-df82-49c4-9514-cba7aaec89e9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:44.897056 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95351ca-df82-49c4-9514-cba7aaec89e9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:44.901977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c2dde-a63e-4e35-a456-259736ead8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:44.902824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c2dde-a63e-4e35-a456-259736ead8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:44.903365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c2dde-a63e-4e35-a456-259736ead8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:44.903659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c2dde-a63e-4e35-a456-259736ead8eb admin admin] PATH_INFO: `/v3/users/d281ce2722dc490a94dd11c70da10d8d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:44.904830 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c2dde-a63e-4e35-a456-259736ead8eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d281ce2722dc490a94dd11c70da10d8d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:44.906728 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c2dde-a63e-4e35-a456-259736ead8eb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:44.953105 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4b9c2dde-a63e-4e35-a456-259736ead8eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd281ce2722dc490a94dd11c70da10d8d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:44.965126 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4b9c2dde-a63e-4e35-a456-259736ead8eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd281ce2722dc490a94dd11c70da10d8d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:44.971581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4b9c2dde-a63e-4e35-a456-259736ead8eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd281ce2722dc490a94dd11c70da10d8d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:44.972313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4b9c2dde-a63e-4e35-a456-259736ead8eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd281ce2722dc490a94dd11c70da10d8d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:44.972928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4b9c2dde-a63e-4e35-a456-259736ead8eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd281ce2722dc490a94dd11c70da10d8d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:44.986758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1219/2432] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:16:44 2022] DELETE /identity/v3/users/d281ce2722dc490a94dd11c70da10d8d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:44.991215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6617ca-2506-457b-8082-979ef0eba4e6 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:44.991564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6617ca-2506-457b-8082-979ef0eba4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:44.991870 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6617ca-2506-457b-8082-979ef0eba4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:45.010752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ad6617ca-2506-457b-8082-979ef0eba4e6 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:45.011977 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ad6617ca-2506-457b-8082-979ef0eba4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:45.073895 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1214/2433] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:45.086799 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c2dde-a63e-4e35-a456-259736ead8eb admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:45.092362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4b9c2dde-a63e-4e35-a456-259736ead8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:45.154924 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c2dde-a63e-4e35-a456-259736ead8eb admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:45.158421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f00181-0b84-470a-96b0-c2a899700e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:45.159053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f00181-0b84-470a-96b0-c2a899700e14 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:45.159334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f00181-0b84-470a-96b0-c2a899700e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:45.159620 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f00181-0b84-470a-96b0-c2a899700e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:45.168941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f00181-0b84-470a-96b0-c2a899700e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:45.170365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f00181-0b84-470a-96b0-c2a899700e14 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:45.179439 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1220/2434] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:16:45.435705 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6617ca-2506-457b-8082-979ef0eba4e6 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:45.437116 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ad6617ca-2506-457b-8082-979ef0eba4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:45.448991 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6617ca-2506-457b-8082-979ef0eba4e6 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:45.453642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7be14-1d23-43bf-9122-0d3645ba86ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:45.454529 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7be14-1d23-43bf-9122-0d3645ba86ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:45.454808 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7be14-1d23-43bf-9122-0d3645ba86ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:45.455079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7be14-1d23-43bf-9122-0d3645ba86ce admin admin] PATH_INFO: `/v3/projects/22d468ebf6ba4a06b2709970576a4925` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:45.464111 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7be14-1d23-43bf-9122-0d3645ba86ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d468ebf6ba4a06b2709970576a4925)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:45.466069 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7be14-1d23-43bf-9122-0d3645ba86ce admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:45.511409 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c9e7be14-1d23-43bf-9122-0d3645ba86ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d468ebf6ba4a06b2709970576a4925', 'request_id': 'req-c9e7be14-1d23-43bf-9122-0d3645ba86ce'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:45.517125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c9e7be14-1d23-43bf-9122-0d3645ba86ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d468ebf6ba4a06b2709970576a4925', 'request_id': 'req-c9e7be14-1d23-43bf-9122-0d3645ba86ce'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:45.525470 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c9e7be14-1d23-43bf-9122-0d3645ba86ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d468ebf6ba4a06b2709970576a4925', 'request_id': 'req-c9e7be14-1d23-43bf-9122-0d3645ba86ce'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:45.537691 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c9e7be14-1d23-43bf-9122-0d3645ba86ce admin admin] The token cache is being invalidate because project 22d468ebf6ba4a06b2709970576a4925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:16:45.538031 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c9e7be14-1d23-43bf-9122-0d3645ba86ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:45.538701 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-c9e7be14-1d23-43bf-9122-0d3645ba86ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:45.540851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1215/2435] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:16:45 2022] DELETE /identity/v3/projects/22d468ebf6ba4a06b2709970576a4925 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:45.545853 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf8e3b-570e-4ce2-8a73-4f30b4c790d1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:45.546139 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf8e3b-570e-4ce2-8a73-4f30b4c790d1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:45.546418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf8e3b-570e-4ce2-8a73-4f30b4c790d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:45.566159 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-93cf8e3b-570e-4ce2-8a73-4f30b4c790d1 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:45.567418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-93cf8e3b-570e-4ce2-8a73-4f30b4c790d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:45.627514 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1221/2436] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:45.635593 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf9ba3-b84a-47a7-b1ef-e173e538242c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:45.635917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf9ba3-b84a-47a7-b1ef-e173e538242c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:45.636198 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf9ba3-b84a-47a7-b1ef-e173e538242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:45.655819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-cddf9ba3-b84a-47a7-b1ef-e173e538242c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:45.657028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-cddf9ba3-b84a-47a7-b1ef-e173e538242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:45.666609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1216/2437] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:45.670171 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf8e3b-570e-4ce2-8a73-4f30b4c790d1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:45.679858 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf8e3b-570e-4ce2-8a73-4f30b4c790d1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:45.686016 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac9aba-fadc-4179-9320-24eb4c3dce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:45.686791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac9aba-fadc-4179-9320-24eb4c3dce9b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:45.687084 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac9aba-fadc-4179-9320-24eb4c3dce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:45.687360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac9aba-fadc-4179-9320-24eb4c3dce9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:45.688125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac9aba-fadc-4179-9320-24eb4c3dce9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:16:45.688428 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac9aba-fadc-4179-9320-24eb4c3dce9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:45.690054 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac9aba-fadc-4179-9320-24eb4c3dce9b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:45.705206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1222/2438] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:16:45.706278 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf9ba3-b84a-47a7-b1ef-e173e538242c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:45.716230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf9ba3-b84a-47a7-b1ef-e173e538242c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:45.721338 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f3ca3-92c5-4131-8e3b-d861cc821b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:45.721698 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f3ca3-92c5-4131-8e3b-d861cc821b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:45.721981 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f3ca3-92c5-4131-8e3b-d861cc821b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:45.722255 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f3ca3-92c5-4131-8e3b-d861cc821b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:45.722953 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f3ca3-92c5-4131-8e3b-d861cc821b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:45.724880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f3ca3-92c5-4131-8e3b-d861cc821b81 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:45.754062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1217/2439] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:16:45 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:16:45.755230 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac9aba-fadc-4179-9320-24eb4c3dce9b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:45.766480 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac9aba-fadc-4179-9320-24eb4c3dce9b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:45.825956 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c8a3e-34b1-4af0-8591-8e71b0ceb1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:45.826631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c8a3e-34b1-4af0-8591-8e71b0ceb1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:45.826911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c8a3e-34b1-4af0-8591-8e71b0ceb1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:45.827184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c8a3e-34b1-4af0-8591-8e71b0ceb1c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:45.827907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c8a3e-34b1-4af0-8591-8e71b0ceb1c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:45.829827 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c8a3e-34b1-4af0-8591-8e71b0ceb1c4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:45.853610 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1223/2440] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:16:45 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:16:45.855866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f3ca3-92c5-4131-8e3b-d861cc821b81 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:45.866500 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f3ca3-92c5-4131-8e3b-d861cc821b81 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:45.872513 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d819705-feb8-4550-883f-861c35398f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:45.873333 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d819705-feb8-4550-883f-861c35398f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:45.873731 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d819705-feb8-4550-883f-861c35398f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:45.874112 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d819705-feb8-4550-883f-861c35398f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:45.874946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d819705-feb8-4550-883f-861c35398f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:45.877089 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d819705-feb8-4550-883f-861c35398f45 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:45.891753 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1218/2441] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:16:45.893038 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c8a3e-34b1-4af0-8591-8e71b0ceb1c4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:45.904429 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c8a3e-34b1-4af0-8591-8e71b0ceb1c4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:45.909343 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fa5e2-99cb-4651-8260-c0ff683577c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:45.910111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fa5e2-99cb-4651-8260-c0ff683577c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:45.910362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fa5e2-99cb-4651-8260-c0ff683577c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:45.910618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fa5e2-99cb-4651-8260-c0ff683577c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:45.911371 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fa5e2-99cb-4651-8260-c0ff683577c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:45.913014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fa5e2-99cb-4651-8260-c0ff683577c0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:45.923041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1224/2442] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:16:45.927336 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d819705-feb8-4550-883f-861c35398f45 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:45.937693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d819705-feb8-4550-883f-861c35398f45 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:45.942232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59587da8-58ac-4cfa-ba7b-1ecd192e9a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:45.943122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59587da8-58ac-4cfa-ba7b-1ecd192e9a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:45.943430 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59587da8-58ac-4cfa-ba7b-1ecd192e9a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:45.943742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59587da8-58ac-4cfa-ba7b-1ecd192e9a49 admin admin] PATH_INFO: `/v3/projects/41df599951694a9e83843121bc6c588b/users/37b50624c74b445d8f36d09d8c69a9f2/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:45.958861 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59587da8-58ac-4cfa-ba7b-1ecd192e9a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41df599951694a9e83843121bc6c588b, user_id=37b50624c74b445d8f36d09d8c69a9f2, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:45.962570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59587da8-58ac-4cfa-ba7b-1ecd192e9a49 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:45.975118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1219/2443] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:16:45 2022] PUT /identity/v3/projects/41df599951694a9e83843121bc6c588b/users/37b50624c74b445d8f36d09d8c69a9f2/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:45.985398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f8000-d442-4e28-983c-f86e3a854aff None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:45.985691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f8000-d442-4e28-983c-f86e3a854aff None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:45.985971 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f8000-d442-4e28-983c-f86e3a854aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:46.012901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-276f8000-d442-4e28-983c-f86e3a854aff None None] MFA Rules not processed for user `37b50624c74b445d8f36d09d8c69a9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:46.014083 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-276f8000-d442-4e28-983c-f86e3a854aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:46.075223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1225/2444] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:46.079850 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59587da8-58ac-4cfa-ba7b-1ecd192e9a49 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:46.152591 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59587da8-58ac-4cfa-ba7b-1ecd192e9a49 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:46.165916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc647d-712e-4e27-8c8e-6a7338293abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:46.166774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc647d-712e-4e27-8c8e-6a7338293abf admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:46.167096 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc647d-712e-4e27-8c8e-6a7338293abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:46.167365 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc647d-712e-4e27-8c8e-6a7338293abf admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:46.168094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc647d-712e-4e27-8c8e-6a7338293abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:46.170049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc647d-712e-4e27-8c8e-6a7338293abf admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:46.201675 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1220/2445] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:16:46 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:16:46.202745 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f8000-d442-4e28-983c-f86e3a854aff None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:46.220160 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f8000-d442-4e28-983c-f86e3a854aff None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:46.281478 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fc51c-28d3-4148-9604-2a7fd6adf563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:46.282240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fc51c-28d3-4148-9604-2a7fd6adf563 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:46.282584 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fc51c-28d3-4148-9604-2a7fd6adf563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:46.282983 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fc51c-28d3-4148-9604-2a7fd6adf563 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:46.283837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fc51c-28d3-4148-9604-2a7fd6adf563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:46.285966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fc51c-28d3-4148-9604-2a7fd6adf563 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:46.308542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1226/2446] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:16:46 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:16:46.312495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc647d-712e-4e27-8c8e-6a7338293abf admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:46.323910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc647d-712e-4e27-8c8e-6a7338293abf admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:46.329212 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb16425-1615-41fa-8109-72d300908b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:46.330139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb16425-1615-41fa-8109-72d300908b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:46.330466 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb16425-1615-41fa-8109-72d300908b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:46.331006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb16425-1615-41fa-8109-72d300908b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:46.331847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb16425-1615-41fa-8109-72d300908b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:46.333618 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb16425-1615-41fa-8109-72d300908b2f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:46.345234 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1221/2447] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:16:46.349325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fc51c-28d3-4148-9604-2a7fd6adf563 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:46.360104 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fc51c-28d3-4148-9604-2a7fd6adf563 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:46.364876 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119901c5-8bce-4076-94cb-c5604b91ce25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:46.365750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119901c5-8bce-4076-94cb-c5604b91ce25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:46.366080 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119901c5-8bce-4076-94cb-c5604b91ce25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:46.366356 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119901c5-8bce-4076-94cb-c5604b91ce25 admin admin] PATH_INFO: `/v3/projects/712f945173d04ac388f16147b0904874/users/29fa2bbacbe74104bb6ffa6680fec3a4/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:46.381202 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119901c5-8bce-4076-94cb-c5604b91ce25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=712f945173d04ac388f16147b0904874, user_id=29fa2bbacbe74104bb6ffa6680fec3a4, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:46.384486 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119901c5-8bce-4076-94cb-c5604b91ce25 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:46.397269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1227/2448] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:16:46 2022] PUT /identity/v3/projects/712f945173d04ac388f16147b0904874/users/29fa2bbacbe74104bb6ffa6680fec3a4/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:46.401422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb16425-1615-41fa-8109-72d300908b2f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:46.411440 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb16425-1615-41fa-8109-72d300908b2f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:46.472938 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda208e3-29d1-4dda-8d90-b6978cff47dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:46.473704 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda208e3-29d1-4dda-8d90-b6978cff47dd admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:46.474059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda208e3-29d1-4dda-8d90-b6978cff47dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:46.474408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda208e3-29d1-4dda-8d90-b6978cff47dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:46.475211 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda208e3-29d1-4dda-8d90-b6978cff47dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:46.476902 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda208e3-29d1-4dda-8d90-b6978cff47dd admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:46.492217 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1222/2449] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:16:46.494185 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119901c5-8bce-4076-94cb-c5604b91ce25 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:46.506592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119901c5-8bce-4076-94cb-c5604b91ce25 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:46.512153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3eb5e1-2977-4ef7-9839-f1ab111d9c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:46.513132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eb5e1-2977-4ef7-9839-f1ab111d9c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:46.513366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eb5e1-2977-4ef7-9839-f1ab111d9c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:46.513639 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eb5e1-2977-4ef7-9839-f1ab111d9c05 admin admin] PATH_INFO: `/v3/projects/712f945173d04ac388f16147b0904874/users/29fa2bbacbe74104bb6ffa6680fec3a4/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:46.515894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3eb5e1-2977-4ef7-9839-f1ab111d9c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=712f945173d04ac388f16147b0904874, user_id=29fa2bbacbe74104bb6ffa6680fec3a4, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:46.518623 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3eb5e1-2977-4ef7-9839-f1ab111d9c05 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:46.531871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1228/2450] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:16:46 2022] PUT /identity/v3/projects/712f945173d04ac388f16147b0904874/users/29fa2bbacbe74104bb6ffa6680fec3a4/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:46.543750 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73585e6-8d68-49dc-9ac0-87a8657e4a52 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:46.544148 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73585e6-8d68-49dc-9ac0-87a8657e4a52 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:46.544531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73585e6-8d68-49dc-9ac0-87a8657e4a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:46.578435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c73585e6-8d68-49dc-9ac0-87a8657e4a52 None None] MFA Rules not processed for user `29fa2bbacbe74104bb6ffa6680fec3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:46.579980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c73585e6-8d68-49dc-9ac0-87a8657e4a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:46.662360 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1223/2451] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:46.674436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3eb5e1-2977-4ef7-9839-f1ab111d9c05 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:46.676210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-eb3eb5e1-2977-4ef7-9839-f1ab111d9c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:46.735795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3eb5e1-2977-4ef7-9839-f1ab111d9c05 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:46.740682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aec9ce-f8be-4393-a09d-d57f2ce768bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:46.741330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aec9ce-f8be-4393-a09d-d57f2ce768bf service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:46.741606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aec9ce-f8be-4393-a09d-d57f2ce768bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:46.741878 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aec9ce-f8be-4393-a09d-d57f2ce768bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:46.805160 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aec9ce-f8be-4393-a09d-d57f2ce768bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:46.806839 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aec9ce-f8be-4393-a09d-d57f2ce768bf service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:46.816566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1229/2452] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:49.351833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73585e6-8d68-49dc-9ac0-87a8657e4a52 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:49.416667 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73585e6-8d68-49dc-9ac0-87a8657e4a52 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:49.421914 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d61ef9-1bd3-4427-8bf5-91559fda8fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:49.422803 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d61ef9-1bd3-4427-8bf5-91559fda8fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:49.423081 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d61ef9-1bd3-4427-8bf5-91559fda8fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:49.423359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d61ef9-1bd3-4427-8bf5-91559fda8fca admin admin] PATH_INFO: `/v3/users/37b50624c74b445d8f36d09d8c69a9f2` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:49.424591 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d61ef9-1bd3-4427-8bf5-91559fda8fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b50624c74b445d8f36d09d8c69a9f2)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:49.426550 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d61ef9-1bd3-4427-8bf5-91559fda8fca admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:49.474019 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-78d61ef9-1bd3-4427-8bf5-91559fda8fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b50624c74b445d8f36d09d8c69a9f2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:49.474691 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-78d61ef9-1bd3-4427-8bf5-91559fda8fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b50624c74b445d8f36d09d8c69a9f2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:49.487168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-78d61ef9-1bd3-4427-8bf5-91559fda8fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b50624c74b445d8f36d09d8c69a9f2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:49.494377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-78d61ef9-1bd3-4427-8bf5-91559fda8fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b50624c74b445d8f36d09d8c69a9f2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:49.495116 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-78d61ef9-1bd3-4427-8bf5-91559fda8fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b50624c74b445d8f36d09d8c69a9f2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:49.511402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1224/2453] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:16:49 2022] DELETE /identity/v3/users/37b50624c74b445d8f36d09d8c69a9f2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:49.516163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93729be8-30a4-4114-9abc-332711cba8d4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:49.517014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93729be8-30a4-4114-9abc-332711cba8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:49.517290 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93729be8-30a4-4114-9abc-332711cba8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:49.535907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-93729be8-30a4-4114-9abc-332711cba8d4 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:49.537053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-93729be8-30a4-4114-9abc-332711cba8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:49.599310 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1230/2454] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:16:49.609060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d61ef9-1bd3-4427-8bf5-91559fda8fca admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:49.610549 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-78d61ef9-1bd3-4427-8bf5-91559fda8fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:49.667659 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d61ef9-1bd3-4427-8bf5-91559fda8fca admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:49.671406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1514c0-0d31-49ea-a7d6-37fe2c2a67a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:49.672091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1514c0-0d31-49ea-a7d6-37fe2c2a67a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:49.672375 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1514c0-0d31-49ea-a7d6-37fe2c2a67a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:49.672651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1514c0-0d31-49ea-a7d6-37fe2c2a67a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:49.682452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1514c0-0d31-49ea-a7d6-37fe2c2a67a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:49.683921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1514c0-0d31-49ea-a7d6-37fe2c2a67a4 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:49.694222 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1225/2455] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:49.965101 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93729be8-30a4-4114-9abc-332711cba8d4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:49.966539 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-93729be8-30a4-4114-9abc-332711cba8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:49.985403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93729be8-30a4-4114-9abc-332711cba8d4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:49.990288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5e7c7-138f-4fae-8e68-3958da11762f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:49.990907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5e7c7-138f-4fae-8e68-3958da11762f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:49.991188 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5e7c7-138f-4fae-8e68-3958da11762f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:49.991458 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5e7c7-138f-4fae-8e68-3958da11762f admin admin] PATH_INFO: `/v3/projects/41df599951694a9e83843121bc6c588b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:49.992719 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5e7c7-138f-4fae-8e68-3958da11762f admin admin] RBAC: Authorizing `identity:delete_project(project_id=41df599951694a9e83843121bc6c588b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:49.994962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5e7c7-138f-4fae-8e68-3958da11762f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:50.056824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d4e5e7c7-138f-4fae-8e68-3958da11762f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41df599951694a9e83843121bc6c588b', 'request_id': 'req-d4e5e7c7-138f-4fae-8e68-3958da11762f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:50.064936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d4e5e7c7-138f-4fae-8e68-3958da11762f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41df599951694a9e83843121bc6c588b', 'request_id': 'req-d4e5e7c7-138f-4fae-8e68-3958da11762f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:50.076718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d4e5e7c7-138f-4fae-8e68-3958da11762f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41df599951694a9e83843121bc6c588b', 'request_id': 'req-d4e5e7c7-138f-4fae-8e68-3958da11762f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:50.100113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d4e5e7c7-138f-4fae-8e68-3958da11762f admin admin] The token cache is being invalidate because project 41df599951694a9e83843121bc6c588b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:16:50.100400 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d4e5e7c7-138f-4fae-8e68-3958da11762f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:50.101059 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d4e5e7c7-138f-4fae-8e68-3958da11762f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:50.102772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1231/2456] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:16:49 2022] DELETE /identity/v3/projects/41df599951694a9e83843121bc6c588b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:50.106825 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1514c0-0d31-49ea-a7d6-37fe2c2a67a4 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:50.108499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5e7c7-138f-4fae-8e68-3958da11762f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:50.108653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-fb1514c0-0d31-49ea-a7d6-37fe2c2a67a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:50.109672 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d4e5e7c7-138f-4fae-8e68-3958da11762f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:50.180294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5e7c7-138f-4fae-8e68-3958da11762f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:50.185544 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1514c0-0d31-49ea-a7d6-37fe2c2a67a4 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:50.185734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fe5fd-e413-4ba7-8c9e-4949534ce731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:50.186612 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fe5fd-e413-4ba7-8c9e-4949534ce731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:50.186894 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fe5fd-e413-4ba7-8c9e-4949534ce731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:50.187167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fe5fd-e413-4ba7-8c9e-4949534ce731 admin admin] PATH_INFO: `/v3/users/29fa2bbacbe74104bb6ffa6680fec3a4` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:50.188388 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fe5fd-e413-4ba7-8c9e-4949534ce731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29fa2bbacbe74104bb6ffa6680fec3a4)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:50.190326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fe5fd-e413-4ba7-8c9e-4949534ce731 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:50.237004 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fe4fe5fd-e413-4ba7-8c9e-4949534ce731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29fa2bbacbe74104bb6ffa6680fec3a4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:50.250909 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fe4fe5fd-e413-4ba7-8c9e-4949534ce731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29fa2bbacbe74104bb6ffa6680fec3a4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:50.255416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1011d7-828a-43dd-a795-76468893df2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:50.256218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1011d7-828a-43dd-a795-76468893df2e service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:50.256601 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1011d7-828a-43dd-a795-76468893df2e service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:50.256980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1011d7-828a-43dd-a795-76468893df2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:50.258381 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fe4fe5fd-e413-4ba7-8c9e-4949534ce731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29fa2bbacbe74104bb6ffa6680fec3a4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:50.259059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0b1011d7-828a-43dd-a795-76468893df2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:50.259957 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fe4fe5fd-e413-4ba7-8c9e-4949534ce731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29fa2bbacbe74104bb6ffa6680fec3a4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:50.260662 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fe4fe5fd-e413-4ba7-8c9e-4949534ce731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29fa2bbacbe74104bb6ffa6680fec3a4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:50.272273 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1011d7-828a-43dd-a795-76468893df2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:50.274149 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1011d7-828a-43dd-a795-76468893df2e service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:50.275366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1232/2457] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:16:50 2022] DELETE /identity/v3/users/29fa2bbacbe74104bb6ffa6680fec3a4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:50.285841 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1226/2458] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:50.920353 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fe5fd-e413-4ba7-8c9e-4949534ce731 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:50.922216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fe4fe5fd-e413-4ba7-8c9e-4949534ce731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:51.018274 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fe5fd-e413-4ba7-8c9e-4949534ce731 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:51.032030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caeaa43-1893-48b6-9264-7edae04212a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:51.033380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caeaa43-1893-48b6-9264-7edae04212a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:51.033669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caeaa43-1893-48b6-9264-7edae04212a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:51.036162 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caeaa43-1893-48b6-9264-7edae04212a3 admin admin] PATH_INFO: `/v3/projects/712f945173d04ac388f16147b0904874` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:51.039651 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caeaa43-1893-48b6-9264-7edae04212a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=712f945173d04ac388f16147b0904874)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:51.044146 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caeaa43-1893-48b6-9264-7edae04212a3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:51.147978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2caeaa43-1893-48b6-9264-7edae04212a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712f945173d04ac388f16147b0904874', 'request_id': 'req-2caeaa43-1893-48b6-9264-7edae04212a3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:51.175059 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2caeaa43-1893-48b6-9264-7edae04212a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712f945173d04ac388f16147b0904874', 'request_id': 'req-2caeaa43-1893-48b6-9264-7edae04212a3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:51.188583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2caeaa43-1893-48b6-9264-7edae04212a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712f945173d04ac388f16147b0904874', 'request_id': 'req-2caeaa43-1893-48b6-9264-7edae04212a3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:51.208583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2caeaa43-1893-48b6-9264-7edae04212a3 admin admin] The token cache is being invalidate because project 712f945173d04ac388f16147b0904874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:16:51.209010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2caeaa43-1893-48b6-9264-7edae04212a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:51.209945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2caeaa43-1893-48b6-9264-7edae04212a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:16:51.213553 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1233/2459] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:16:50 2022] DELETE /identity/v3/projects/712f945173d04ac388f16147b0904874 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:16:51.217804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138ac98-c81e-4f37-b26c-4aa602b68684 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:51.218358 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138ac98-c81e-4f37-b26c-4aa602b68684 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:51.218472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138ac98-c81e-4f37-b26c-4aa602b68684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:51.240299 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7138ac98-c81e-4f37-b26c-4aa602b68684 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:51.241620 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7138ac98-c81e-4f37-b26c-4aa602b68684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:51.304495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1227/2460] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:51.313521 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35bf33-bbb2-4fab-b5ca-f3d0d8131ab1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:51.314824 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35bf33-bbb2-4fab-b5ca-f3d0d8131ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:51.315112 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35bf33-bbb2-4fab-b5ca-f3d0d8131ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:51.335593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3d35bf33-bbb2-4fab-b5ca-f3d0d8131ab1 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:51.336892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3d35bf33-bbb2-4fab-b5ca-f3d0d8131ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:51.345782 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1234/2461] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:51.350563 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138ac98-c81e-4f37-b26c-4aa602b68684 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:51.362095 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138ac98-c81e-4f37-b26c-4aa602b68684 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:51.367313 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3456b8-586e-4450-acbc-0de95c349c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:51.368044 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3456b8-586e-4450-acbc-0de95c349c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:51.368328 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3456b8-586e-4450-acbc-0de95c349c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:51.368605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3456b8-586e-4450-acbc-0de95c349c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:51.369537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3456b8-586e-4450-acbc-0de95c349c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:16:51.369963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3456b8-586e-4450-acbc-0de95c349c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:51.371573 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3456b8-586e-4450-acbc-0de95c349c29 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:51.387009 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1228/2462] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:16:51.388119 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35bf33-bbb2-4fab-b5ca-f3d0d8131ab1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:51.397328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35bf33-bbb2-4fab-b5ca-f3d0d8131ab1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:51.403705 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d18e2-4bd0-4762-9532-f9dac233ef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:51.404381 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d18e2-4bd0-4762-9532-f9dac233ef62 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:51.404664 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d18e2-4bd0-4762-9532-f9dac233ef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:51.404928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d18e2-4bd0-4762-9532-f9dac233ef62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:51.405624 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d18e2-4bd0-4762-9532-f9dac233ef62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:51.407591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d18e2-4bd0-4762-9532-f9dac233ef62 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:51.433234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1235/2463] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:16:51 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:16:51.437528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3456b8-586e-4450-acbc-0de95c349c29 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:51.448186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3456b8-586e-4450-acbc-0de95c349c29 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:51.500957 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffe484-9bcf-4d3e-9331-e0eb03388013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:51.501613 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffe484-9bcf-4d3e-9331-e0eb03388013 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:51.501898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffe484-9bcf-4d3e-9331-e0eb03388013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:51.502173 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffe484-9bcf-4d3e-9331-e0eb03388013 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:51.502844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffe484-9bcf-4d3e-9331-e0eb03388013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:51.504784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffe484-9bcf-4d3e-9331-e0eb03388013 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:51.523802 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1229/2464] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:16:51 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:16:51.528216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d18e2-4bd0-4762-9532-f9dac233ef62 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:51.538818 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d18e2-4bd0-4762-9532-f9dac233ef62 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:51.544088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5de939-e34b-4180-89d1-88c46ebdf001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:51.544755 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5de939-e34b-4180-89d1-88c46ebdf001 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:51.545045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5de939-e34b-4180-89d1-88c46ebdf001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:51.545430 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5de939-e34b-4180-89d1-88c46ebdf001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:51.546212 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5de939-e34b-4180-89d1-88c46ebdf001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:51.547844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5de939-e34b-4180-89d1-88c46ebdf001 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:51.559678 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1236/2465] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:16:51.563898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffe484-9bcf-4d3e-9331-e0eb03388013 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:51.573609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffe484-9bcf-4d3e-9331-e0eb03388013 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:51.578904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742dbea-6f80-4de8-b62d-42e2dc7a5442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:51.579561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742dbea-6f80-4de8-b62d-42e2dc7a5442 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:51.579876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742dbea-6f80-4de8-b62d-42e2dc7a5442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:51.580152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742dbea-6f80-4de8-b62d-42e2dc7a5442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:51.580875 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742dbea-6f80-4de8-b62d-42e2dc7a5442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:51.582456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742dbea-6f80-4de8-b62d-42e2dc7a5442 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:51.594289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1230/2466] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:16:51.598756 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5de939-e34b-4180-89d1-88c46ebdf001 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:51.609041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5de939-e34b-4180-89d1-88c46ebdf001 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:51.613780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbc1b5-b02d-45d2-9569-159599329d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:51.614686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbc1b5-b02d-45d2-9569-159599329d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:51.614965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbc1b5-b02d-45d2-9569-159599329d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:51.615240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbc1b5-b02d-45d2-9569-159599329d64 admin admin] PATH_INFO: `/v3/projects/5aa25e0911ed43369fa7045a323b172c/users/a49b466e7b9a47a2b5b6edbeebdbc9ac/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:51.630184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbc1b5-b02d-45d2-9569-159599329d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa25e0911ed43369fa7045a323b172c, user_id=a49b466e7b9a47a2b5b6edbeebdbc9ac, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:51.632887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbc1b5-b02d-45d2-9569-159599329d64 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:51.646904 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1237/2467] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:16:51 2022] PUT /identity/v3/projects/5aa25e0911ed43369fa7045a323b172c/users/a49b466e7b9a47a2b5b6edbeebdbc9ac/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:16:51.658304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d057935-fe40-47a5-8c1d-52122e821143 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:51.658643 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d057935-fe40-47a5-8c1d-52122e821143 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:51.658931 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d057935-fe40-47a5-8c1d-52122e821143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:51.684992 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0d057935-fe40-47a5-8c1d-52122e821143 None None] MFA Rules not processed for user `a49b466e7b9a47a2b5b6edbeebdbc9ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:51.686237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0d057935-fe40-47a5-8c1d-52122e821143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:51.749348 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1231/2468] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:16:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:51.760446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbc1b5-b02d-45d2-9569-159599329d64 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:51.762795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d2cbc1b5-b02d-45d2-9569-159599329d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:51.818315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbc1b5-b02d-45d2-9569-159599329d64 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:51.821880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec74964-7485-4cc1-a91a-e36556599ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:51.822517 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec74964-7485-4cc1-a91a-e36556599ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:51.822801 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec74964-7485-4cc1-a91a-e36556599ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:51.823074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec74964-7485-4cc1-a91a-e36556599ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:51.832000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec74964-7485-4cc1-a91a-e36556599ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:51.833445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec74964-7485-4cc1-a91a-e36556599ac6 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:51.842734 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1238/2469] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:16:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:16:52.451572 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eff96-4cc2-4d90-bb7a-c31806750852 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:52.452050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eff96-4cc2-4d90-bb7a-c31806750852 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:52.452271 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eff96-4cc2-4d90-bb7a-c31806750852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:52.469941 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-e74eff96-4cc2-4d90-bb7a-c31806750852 None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:16:52.471144 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e74eff96-4cc2-4d90-bb7a-c31806750852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:52.525726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1232/2470] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 17 17:16:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:16:52.538974 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec74964-7485-4cc1-a91a-e36556599ac6 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:16:52.540403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8ec74964-7485-4cc1-a91a-e36556599ac6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:16:52.607936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec74964-7485-4cc1-a91a-e36556599ac6 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:16:52.612709 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fb4c9-2652-460f-af42-ccf4cd78a39b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:16:52.613341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fb4c9-2652-460f-af42-ccf4cd78a39b service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:16:52.613618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fb4c9-2652-460f-af42-ccf4cd78a39b service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:16:52.613888 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fb4c9-2652-460f-af42-ccf4cd78a39b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:16:52.622591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fb4c9-2652-460f-af42-ccf4cd78a39b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:16:52.624241 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fb4c9-2652-460f-af42-ccf4cd78a39b service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:16:52.631834 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1239/2471] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:16:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:17:10.304165 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eff96-4cc2-4d90-bb7a-c31806750852 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:10.369030 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eff96-4cc2-4d90-bb7a-c31806750852 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:10.374316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfeab2a-29f4-4975-867d-378a4541e0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:10.375180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfeab2a-29f4-4975-867d-378a4541e0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:10.375623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfeab2a-29f4-4975-867d-378a4541e0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:10.375907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfeab2a-29f4-4975-867d-378a4541e0fe admin admin] PATH_INFO: `/v3/users/a49b466e7b9a47a2b5b6edbeebdbc9ac` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:10.377113 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfeab2a-29f4-4975-867d-378a4541e0fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49b466e7b9a47a2b5b6edbeebdbc9ac)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:10.379046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfeab2a-29f4-4975-867d-378a4541e0fe admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:10.422702 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4dfeab2a-29f4-4975-867d-378a4541e0fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49b466e7b9a47a2b5b6edbeebdbc9ac'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:10.423345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4dfeab2a-29f4-4975-867d-378a4541e0fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49b466e7b9a47a2b5b6edbeebdbc9ac'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:10.435309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4dfeab2a-29f4-4975-867d-378a4541e0fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49b466e7b9a47a2b5b6edbeebdbc9ac'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:10.441919 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4dfeab2a-29f4-4975-867d-378a4541e0fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49b466e7b9a47a2b5b6edbeebdbc9ac'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:10.442591 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-4dfeab2a-29f4-4975-867d-378a4541e0fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49b466e7b9a47a2b5b6edbeebdbc9ac'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:10.454031 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1233/2472] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:17:10 2022] DELETE /identity/v3/users/a49b466e7b9a47a2b5b6edbeebdbc9ac => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:10.458511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3efa04-a0e3-4d85-809c-e753b018bd8e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:10.459021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3efa04-a0e3-4d85-809c-e753b018bd8e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:10.459174 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3efa04-a0e3-4d85-809c-e753b018bd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:10.476563 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-dc3efa04-a0e3-4d85-809c-e753b018bd8e None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:10.477771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-dc3efa04-a0e3-4d85-809c-e753b018bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:10.543881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1240/2473] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:17:10.553818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfeab2a-29f4-4975-867d-378a4541e0fe admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:10.555252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4dfeab2a-29f4-4975-867d-378a4541e0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:10.614035 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfeab2a-29f4-4975-867d-378a4541e0fe admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:10.617704 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2616b-9d3f-4234-b8f7-c8ccb6a00106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:10.618339 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2616b-9d3f-4234-b8f7-c8ccb6a00106 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:10.618624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2616b-9d3f-4234-b8f7-c8ccb6a00106 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:10.618898 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2616b-9d3f-4234-b8f7-c8ccb6a00106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:10.628756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2616b-9d3f-4234-b8f7-c8ccb6a00106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:10.630177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2616b-9d3f-4234-b8f7-c8ccb6a00106 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:10.640147 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1234/2474] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:10.907765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3efa04-a0e3-4d85-809c-e753b018bd8e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:10.909235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-dc3efa04-a0e3-4d85-809c-e753b018bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:10.922269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3efa04-a0e3-4d85-809c-e753b018bd8e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:10.927851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f08fc-c634-42cf-93a8-91256e9d3147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:10.929464 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f08fc-c634-42cf-93a8-91256e9d3147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:10.929814 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f08fc-c634-42cf-93a8-91256e9d3147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:10.930157 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f08fc-c634-42cf-93a8-91256e9d3147 admin admin] PATH_INFO: `/v3/projects/5aa25e0911ed43369fa7045a323b172c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:10.931460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f08fc-c634-42cf-93a8-91256e9d3147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa25e0911ed43369fa7045a323b172c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:10.934834 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f08fc-c634-42cf-93a8-91256e9d3147 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:10.982084 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-463f08fc-c634-42cf-93a8-91256e9d3147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa25e0911ed43369fa7045a323b172c', 'request_id': 'req-463f08fc-c634-42cf-93a8-91256e9d3147'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:10.987273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-463f08fc-c634-42cf-93a8-91256e9d3147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa25e0911ed43369fa7045a323b172c', 'request_id': 'req-463f08fc-c634-42cf-93a8-91256e9d3147'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:10.994515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-463f08fc-c634-42cf-93a8-91256e9d3147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa25e0911ed43369fa7045a323b172c', 'request_id': 'req-463f08fc-c634-42cf-93a8-91256e9d3147'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:11.007716 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-463f08fc-c634-42cf-93a8-91256e9d3147 admin admin] The token cache is being invalidate because project 5aa25e0911ed43369fa7045a323b172c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:17:11.008002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-463f08fc-c634-42cf-93a8-91256e9d3147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:11.008629 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-463f08fc-c634-42cf-93a8-91256e9d3147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:11.010310 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1241/2475] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:17:10 2022] DELETE /identity/v3/projects/5aa25e0911ed43369fa7045a323b172c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:11.015878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fe2ac-edc7-469d-ae6c-d4cb0e56ef0f None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:11.016260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fe2ac-edc7-469d-ae6c-d4cb0e56ef0f None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:11.016589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fe2ac-edc7-469d-ae6c-d4cb0e56ef0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:11.035309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-9e3fe2ac-edc7-469d-ae6c-d4cb0e56ef0f None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:11.036645 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9e3fe2ac-edc7-469d-ae6c-d4cb0e56ef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:11.101882 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1235/2476] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:17:11.164070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88340329-1c98-45c0-b7d1-1c93f4e6bda3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:11.164363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88340329-1c98-45c0-b7d1-1c93f4e6bda3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:11.164641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88340329-1c98-45c0-b7d1-1c93f4e6bda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:11.183070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-88340329-1c98-45c0-b7d1-1c93f4e6bda3 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:11.184910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-88340329-1c98-45c0-b7d1-1c93f4e6bda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:11.192965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1242/2477] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:11.197240 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fe2ac-edc7-469d-ae6c-d4cb0e56ef0f None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:11.206718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fe2ac-edc7-469d-ae6c-d4cb0e56ef0f None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:11.211226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fa58e-6964-4873-8bcc-27d7c36c198c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:11.211901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fa58e-6964-4873-8bcc-27d7c36c198c admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:11.212182 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fa58e-6964-4873-8bcc-27d7c36c198c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:11.212459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fa58e-6964-4873-8bcc-27d7c36c198c admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:11.213175 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fa58e-6964-4873-8bcc-27d7c36c198c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:17:11.213478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fa58e-6964-4873-8bcc-27d7c36c198c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:11.215080 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fa58e-6964-4873-8bcc-27d7c36c198c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:11.230196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1236/2478] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:17:11.232472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88340329-1c98-45c0-b7d1-1c93f4e6bda3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:11.241997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88340329-1c98-45c0-b7d1-1c93f4e6bda3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:11.247324 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad830d12-7b70-4dd3-b766-1caebe0ae89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:11.248013 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad830d12-7b70-4dd3-b766-1caebe0ae89e admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:11.248295 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad830d12-7b70-4dd3-b766-1caebe0ae89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:11.248568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad830d12-7b70-4dd3-b766-1caebe0ae89e admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:11.249257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad830d12-7b70-4dd3-b766-1caebe0ae89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:11.251163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad830d12-7b70-4dd3-b766-1caebe0ae89e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:11.280317 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1243/2479] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:17:11 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:11.281827 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fa58e-6964-4873-8bcc-27d7c36c198c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:11.292592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fa58e-6964-4873-8bcc-27d7c36c198c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:11.349520 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d853ce-eb84-4ac7-94e0-73c1db82f21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:11.350209 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d853ce-eb84-4ac7-94e0-73c1db82f21c admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:11.350385 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d853ce-eb84-4ac7-94e0-73c1db82f21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:11.350838 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d853ce-eb84-4ac7-94e0-73c1db82f21c admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:11.351733 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d853ce-eb84-4ac7-94e0-73c1db82f21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:11.353704 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d853ce-eb84-4ac7-94e0-73c1db82f21c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:11.380869 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1237/2480] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:17:11 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:11.382021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad830d12-7b70-4dd3-b766-1caebe0ae89e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:11.392463 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad830d12-7b70-4dd3-b766-1caebe0ae89e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:11.397207 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832f19c-e62d-4dda-83cf-168ebc7e26b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:11.397862 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832f19c-e62d-4dda-83cf-168ebc7e26b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:11.398135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832f19c-e62d-4dda-83cf-168ebc7e26b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:11.398404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832f19c-e62d-4dda-83cf-168ebc7e26b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:11.399149 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832f19c-e62d-4dda-83cf-168ebc7e26b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:11.400820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832f19c-e62d-4dda-83cf-168ebc7e26b4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:11.411392 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1244/2481] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:17:11.415572 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d853ce-eb84-4ac7-94e0-73c1db82f21c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:11.426100 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d853ce-eb84-4ac7-94e0-73c1db82f21c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:11.430795 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f08e0-ad10-4fc4-b31c-fc99b240d50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:11.431436 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f08e0-ad10-4fc4-b31c-fc99b240d50b admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:11.431753 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f08e0-ad10-4fc4-b31c-fc99b240d50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:11.432029 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f08e0-ad10-4fc4-b31c-fc99b240d50b admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:11.432743 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f08e0-ad10-4fc4-b31c-fc99b240d50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:11.434941 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f08e0-ad10-4fc4-b31c-fc99b240d50b admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:11.448045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1238/2482] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:17:11.449327 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832f19c-e62d-4dda-83cf-168ebc7e26b4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:11.459576 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832f19c-e62d-4dda-83cf-168ebc7e26b4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:11.464469 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2dd27-a7b6-4f95-95a5-eeab3422c91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:11.465390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2dd27-a7b6-4f95-95a5-eeab3422c91c admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:11.465663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2dd27-a7b6-4f95-95a5-eeab3422c91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:11.465991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2dd27-a7b6-4f95-95a5-eeab3422c91c admin admin] PATH_INFO: `/v3/projects/21c32c98238c44e7a3581a668e1a5ea3/users/b62f5ec1700d4a86aab654c9f2eb0201/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:11.481484 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2dd27-a7b6-4f95-95a5-eeab3422c91c admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c32c98238c44e7a3581a668e1a5ea3, user_id=b62f5ec1700d4a86aab654c9f2eb0201, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:11.484488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2dd27-a7b6-4f95-95a5-eeab3422c91c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:11.497620 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1245/2483] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:11 2022] PUT /identity/v3/projects/21c32c98238c44e7a3581a668e1a5ea3/users/b62f5ec1700d4a86aab654c9f2eb0201/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:11.502632 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af46bf-fa66-4c4d-ba95-a779a0dd1db2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:11.502944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af46bf-fa66-4c4d-ba95-a779a0dd1db2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:11.503225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af46bf-fa66-4c4d-ba95-a779a0dd1db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:11.521497 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-68af46bf-fa66-4c4d-ba95-a779a0dd1db2 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:11.522683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-68af46bf-fa66-4c4d-ba95-a779a0dd1db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:11.583686 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1239/2484] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:11.594255 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2dd27-a7b6-4f95-95a5-eeab3422c91c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:11.596083 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-92e2dd27-a7b6-4f95-95a5-eeab3422c91c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:11.658169 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2dd27-a7b6-4f95-95a5-eeab3422c91c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:11.661841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ed638-6a19-43af-8570-e5e58d691459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:11.662479 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ed638-6a19-43af-8570-e5e58d691459 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:11.662757 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ed638-6a19-43af-8570-e5e58d691459 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:11.663158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ed638-6a19-43af-8570-e5e58d691459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:11.671954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ed638-6a19-43af-8570-e5e58d691459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:11.673382 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ed638-6a19-43af-8570-e5e58d691459 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:11.682456 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1246/2485] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:15.162419 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af46bf-fa66-4c4d-ba95-a779a0dd1db2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:15.172880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af46bf-fa66-4c4d-ba95-a779a0dd1db2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:15.178624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b4921-d424-41f7-b37c-41fcf94821f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:15.179279 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b4921-d424-41f7-b37c-41fcf94821f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:15.179769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b4921-d424-41f7-b37c-41fcf94821f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:15.180046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b4921-d424-41f7-b37c-41fcf94821f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:15.181967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4f4b4921-d424-41f7-b37c-41fcf94821f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:15.195859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b4921-d424-41f7-b37c-41fcf94821f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:15.197307 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b4921-d424-41f7-b37c-41fcf94821f0 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:15.211238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1240/2486] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:15.734726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81c239-0817-4854-8ba2-30b59f1a1ce4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:15.735313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81c239-0817-4854-8ba2-30b59f1a1ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:15.735313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81c239-0817-4854-8ba2-30b59f1a1ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:15.765167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3f81c239-0817-4854-8ba2-30b59f1a1ce4 None None] MFA Rules not processed for user `b62f5ec1700d4a86aab654c9f2eb0201`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:15.766389 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3f81c239-0817-4854-8ba2-30b59f1a1ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:15.838995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1247/2487] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:15.842814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b4921-d424-41f7-b37c-41fcf94821f0 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:15.852847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b4921-d424-41f7-b37c-41fcf94821f0 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:15.860332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a052ac-3e9a-4cba-97e6-19d2bb714044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:15.861048 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a052ac-3e9a-4cba-97e6-19d2bb714044 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:15.861335 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a052ac-3e9a-4cba-97e6-19d2bb714044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:15.861616 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a052ac-3e9a-4cba-97e6-19d2bb714044 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:15.862327 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a052ac-3e9a-4cba-97e6-19d2bb714044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:15.864391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a052ac-3e9a-4cba-97e6-19d2bb714044 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:15.894978 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1241/2488] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:17:15 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:15.899684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81c239-0817-4854-8ba2-30b59f1a1ce4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:15.913360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81c239-0817-4854-8ba2-30b59f1a1ce4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:15.980152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a001cc-5dd5-4f44-b39e-727893396c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:15.982143 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a001cc-5dd5-4f44-b39e-727893396c21 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:15.982611 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a001cc-5dd5-4f44-b39e-727893396c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:15.983205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a001cc-5dd5-4f44-b39e-727893396c21 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:15.984114 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a001cc-5dd5-4f44-b39e-727893396c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:15.986289 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a001cc-5dd5-4f44-b39e-727893396c21 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:16.010306 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1248/2489] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:17:15 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:17:16.014510 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a052ac-3e9a-4cba-97e6-19d2bb714044 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:16.025400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a052ac-3e9a-4cba-97e6-19d2bb714044 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:16.031075 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79d54f-7db1-4d2c-9f11-f4b1ee40ca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:16.031776 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79d54f-7db1-4d2c-9f11-f4b1ee40ca04 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:16.032060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79d54f-7db1-4d2c-9f11-f4b1ee40ca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:16.032337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79d54f-7db1-4d2c-9f11-f4b1ee40ca04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:16.033064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79d54f-7db1-4d2c-9f11-f4b1ee40ca04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:16.034690 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79d54f-7db1-4d2c-9f11-f4b1ee40ca04 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:16.049768 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1242/2490] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:16.057053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a001cc-5dd5-4f44-b39e-727893396c21 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:16.070769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a001cc-5dd5-4f44-b39e-727893396c21 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:16.075532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6783ce-fe44-4fae-8a75-9a514e7e4446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:16.076448 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6783ce-fe44-4fae-8a75-9a514e7e4446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:16.076757 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6783ce-fe44-4fae-8a75-9a514e7e4446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:16.077028 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6783ce-fe44-4fae-8a75-9a514e7e4446 admin admin] PATH_INFO: `/v3/projects/36139a33d392483580afe4b25335bfc1/users/a4a067e8b43e440f9349fc44d207549c/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:16.098832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6783ce-fe44-4fae-8a75-9a514e7e4446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36139a33d392483580afe4b25335bfc1, user_id=a4a067e8b43e440f9349fc44d207549c, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:16.101946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6783ce-fe44-4fae-8a75-9a514e7e4446 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:16.119931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1249/2491] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:16 2022] PUT /identity/v3/projects/36139a33d392483580afe4b25335bfc1/users/a4a067e8b43e440f9349fc44d207549c/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:16.123123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79d54f-7db1-4d2c-9f11-f4b1ee40ca04 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:16.134398 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79d54f-7db1-4d2c-9f11-f4b1ee40ca04 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:16.204357 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4d572-a51d-4222-a507-a2bbfef79cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:16.205030 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4d572-a51d-4222-a507-a2bbfef79cce admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:16.205598 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4d572-a51d-4222-a507-a2bbfef79cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:16.205948 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4d572-a51d-4222-a507-a2bbfef79cce admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:16.206754 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4d572-a51d-4222-a507-a2bbfef79cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:16.208528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4d572-a51d-4222-a507-a2bbfef79cce admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:16.220785 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1243/2492] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:16.224544 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6783ce-fe44-4fae-8a75-9a514e7e4446 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:16.236311 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6783ce-fe44-4fae-8a75-9a514e7e4446 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:16.241887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a56f3-cd09-498c-a5bb-14c0eafbd411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:16.242884 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a56f3-cd09-498c-a5bb-14c0eafbd411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:16.243165 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a56f3-cd09-498c-a5bb-14c0eafbd411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:16.243436 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a56f3-cd09-498c-a5bb-14c0eafbd411 admin admin] PATH_INFO: `/v3/projects/36139a33d392483580afe4b25335bfc1/users/a4a067e8b43e440f9349fc44d207549c/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:16.245504 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a56f3-cd09-498c-a5bb-14c0eafbd411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36139a33d392483580afe4b25335bfc1, user_id=a4a067e8b43e440f9349fc44d207549c, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:16.248737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a56f3-cd09-498c-a5bb-14c0eafbd411 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:16.261530 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1250/2493] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:16 2022] PUT /identity/v3/projects/36139a33d392483580afe4b25335bfc1/users/a4a067e8b43e440f9349fc44d207549c/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:19.176557 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4d572-a51d-4222-a507-a2bbfef79cce admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:19.179578 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-65d4d572-a51d-4222-a507-a2bbfef79cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:19.201648 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4d572-a51d-4222-a507-a2bbfef79cce admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:19.300382 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dad820-808d-4446-8227-35422ecad2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:19.301792 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dad820-808d-4446-8227-35422ecad2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:19.302376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dad820-808d-4446-8227-35422ecad2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:19.302920 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dad820-808d-4446-8227-35422ecad2c7 admin admin] PATH_INFO: `/v3/users/74cc0ddf89664a6f92c84ebb9e1ab3a2` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:19.304377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dad820-808d-4446-8227-35422ecad2c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74cc0ddf89664a6f92c84ebb9e1ab3a2)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:19.307056 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dad820-808d-4446-8227-35422ecad2c7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:19.369616 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-85dad820-808d-4446-8227-35422ecad2c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74cc0ddf89664a6f92c84ebb9e1ab3a2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:19.370319 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-85dad820-808d-4446-8227-35422ecad2c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74cc0ddf89664a6f92c84ebb9e1ab3a2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:19.387192 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-85dad820-808d-4446-8227-35422ecad2c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74cc0ddf89664a6f92c84ebb9e1ab3a2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:19.395567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-85dad820-808d-4446-8227-35422ecad2c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74cc0ddf89664a6f92c84ebb9e1ab3a2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:19.397168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-85dad820-808d-4446-8227-35422ecad2c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74cc0ddf89664a6f92c84ebb9e1ab3a2'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:19.416416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1244/2494] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:17:19 2022] DELETE /identity/v3/users/74cc0ddf89664a6f92c84ebb9e1ab3a2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:19.954053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a56f3-cd09-498c-a5bb-14c0eafbd411 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:19.956427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-811a56f3-cd09-498c-a5bb-14c0eafbd411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:19.979381 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a56f3-cd09-498c-a5bb-14c0eafbd411 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:20.056686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c00e3-b8d2-4e88-b754-c4babf241e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:20.057564 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c00e3-b8d2-4e88-b754-c4babf241e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:20.057843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c00e3-b8d2-4e88-b754-c4babf241e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:20.058115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c00e3-b8d2-4e88-b754-c4babf241e6d admin admin] PATH_INFO: `/v3/projects/87f2aabc0cda49538fa0fd9d5db6bf51` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:20.059755 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c00e3-b8d2-4e88-b754-c4babf241e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=87f2aabc0cda49538fa0fd9d5db6bf51)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:20.061929 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c00e3-b8d2-4e88-b754-c4babf241e6d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:20.121032 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c21c00e3-b8d2-4e88-b754-c4babf241e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f2aabc0cda49538fa0fd9d5db6bf51', 'request_id': 'req-c21c00e3-b8d2-4e88-b754-c4babf241e6d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:20.127545 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c21c00e3-b8d2-4e88-b754-c4babf241e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f2aabc0cda49538fa0fd9d5db6bf51', 'request_id': 'req-c21c00e3-b8d2-4e88-b754-c4babf241e6d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:20.139562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c21c00e3-b8d2-4e88-b754-c4babf241e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f2aabc0cda49538fa0fd9d5db6bf51', 'request_id': 'req-c21c00e3-b8d2-4e88-b754-c4babf241e6d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:20.156837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c21c00e3-b8d2-4e88-b754-c4babf241e6d admin admin] The token cache is being invalidate because project 87f2aabc0cda49538fa0fd9d5db6bf51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:17:20.157390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c21c00e3-b8d2-4e88-b754-c4babf241e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:20.158227 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c21c00e3-b8d2-4e88-b754-c4babf241e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:20.160422 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1251/2495] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:17:19 2022] DELETE /identity/v3/projects/87f2aabc0cda49538fa0fd9d5db6bf51 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:20.165425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18f0ef-5f20-404e-8822-83b174f36b49 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:20.165938 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18f0ef-5f20-404e-8822-83b174f36b49 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:20.166391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18f0ef-5f20-404e-8822-83b174f36b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:20.193260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ba18f0ef-5f20-404e-8822-83b174f36b49 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:20.199929 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ba18f0ef-5f20-404e-8822-83b174f36b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:20.274857 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1245/2496] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:20.283411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b386f-74dd-43e1-aaf7-adb4b2ac8e4d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:20.283826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b386f-74dd-43e1-aaf7-adb4b2ac8e4d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:20.284291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b386f-74dd-43e1-aaf7-adb4b2ac8e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:20.313796 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-dc0b386f-74dd-43e1-aaf7-adb4b2ac8e4d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:20.315045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-dc0b386f-74dd-43e1-aaf7-adb4b2ac8e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:20.328429 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1252/2497] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:20.335503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18f0ef-5f20-404e-8822-83b174f36b49 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:20.357701 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18f0ef-5f20-404e-8822-83b174f36b49 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:20.364718 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6c70f-9868-4692-8d3b-12b91b5daa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:20.366173 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6c70f-9868-4692-8d3b-12b91b5daa5a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:20.367406 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6c70f-9868-4692-8d3b-12b91b5daa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:20.367960 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6c70f-9868-4692-8d3b-12b91b5daa5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:20.368890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6c70f-9868-4692-8d3b-12b91b5daa5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:17:20.369203 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6c70f-9868-4692-8d3b-12b91b5daa5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:20.371655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6c70f-9868-4692-8d3b-12b91b5daa5a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:20.393624 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1246/2498] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:17:20.399639 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b386f-74dd-43e1-aaf7-adb4b2ac8e4d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:20.425593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b386f-74dd-43e1-aaf7-adb4b2ac8e4d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:20.486847 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc61bee-23e1-4c2c-88ce-70d99b5437ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:20.487889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc61bee-23e1-4c2c-88ce-70d99b5437ea admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:20.488279 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc61bee-23e1-4c2c-88ce-70d99b5437ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:20.488658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc61bee-23e1-4c2c-88ce-70d99b5437ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:20.489742 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc61bee-23e1-4c2c-88ce-70d99b5437ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:20.492759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc61bee-23e1-4c2c-88ce-70d99b5437ea admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:20.562774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1253/2499] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:17:20 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:20.566428 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6c70f-9868-4692-8d3b-12b91b5daa5a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:20.583433 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6c70f-9868-4692-8d3b-12b91b5daa5a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:20.712244 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009c9d3-b7a9-4955-a27d-e8736c801079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:20.720708 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009c9d3-b7a9-4955-a27d-e8736c801079 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:20.721173 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009c9d3-b7a9-4955-a27d-e8736c801079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:20.721461 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009c9d3-b7a9-4955-a27d-e8736c801079 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:20.722199 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009c9d3-b7a9-4955-a27d-e8736c801079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:20.724235 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009c9d3-b7a9-4955-a27d-e8736c801079 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:20.756920 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1247/2500] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:17:20 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:17:20.762918 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc61bee-23e1-4c2c-88ce-70d99b5437ea admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:20.787358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc61bee-23e1-4c2c-88ce-70d99b5437ea admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:20.796527 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f345a-fdec-41da-b53c-b44977c4d411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:20.797154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f345a-fdec-41da-b53c-b44977c4d411 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:20.797431 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f345a-fdec-41da-b53c-b44977c4d411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:20.797703 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f345a-fdec-41da-b53c-b44977c4d411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:20.798544 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f345a-fdec-41da-b53c-b44977c4d411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:20.805560 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f345a-fdec-41da-b53c-b44977c4d411 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:20.819862 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1254/2501] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:20.823427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009c9d3-b7a9-4955-a27d-e8736c801079 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:20.849973 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009c9d3-b7a9-4955-a27d-e8736c801079 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:20.861725 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa6e1b-922d-48cf-bfa5-7ea0582cbd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:20.862415 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa6e1b-922d-48cf-bfa5-7ea0582cbd84 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:20.864901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa6e1b-922d-48cf-bfa5-7ea0582cbd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:20.865196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa6e1b-922d-48cf-bfa5-7ea0582cbd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:20.866496 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa6e1b-922d-48cf-bfa5-7ea0582cbd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:20.869827 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa6e1b-922d-48cf-bfa5-7ea0582cbd84 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:20.907860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1248/2502] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:20.908088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f345a-fdec-41da-b53c-b44977c4d411 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:20.920508 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f345a-fdec-41da-b53c-b44977c4d411 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:20.927815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a29292-c5c6-4c3c-a366-db6c68d98546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:20.928304 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a29292-c5c6-4c3c-a366-db6c68d98546 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:20.928717 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a29292-c5c6-4c3c-a366-db6c68d98546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:20.929069 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a29292-c5c6-4c3c-a366-db6c68d98546 admin admin] PATH_INFO: `/v3/projects/4fb89f649b6a4e70885150deda6f4409/users/dc062aadbfa54ca981f518400571fd23/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:20.951410 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a29292-c5c6-4c3c-a366-db6c68d98546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb89f649b6a4e70885150deda6f4409, user_id=dc062aadbfa54ca981f518400571fd23, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:20.954541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a29292-c5c6-4c3c-a366-db6c68d98546 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:20.973435 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1255/2503] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:20 2022] PUT /identity/v3/projects/4fb89f649b6a4e70885150deda6f4409/users/dc062aadbfa54ca981f518400571fd23/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:20.984871 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2b1ee-0614-48f4-a909-b96bdd3ecae3 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:20.985212 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2b1ee-0614-48f4-a909-b96bdd3ecae3 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:20.985443 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2b1ee-0614-48f4-a909-b96bdd3ecae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:21.022333 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-75a2b1ee-0614-48f4-a909-b96bdd3ecae3 None None] MFA Rules not processed for user `dc062aadbfa54ca981f518400571fd23`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:21.024170 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-75a2b1ee-0614-48f4-a909-b96bdd3ecae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:21.114753 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1249/2504] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:21.126640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a29292-c5c6-4c3c-a366-db6c68d98546 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:21.128520 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-56a29292-c5c6-4c3c-a366-db6c68d98546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:21.229645 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a29292-c5c6-4c3c-a366-db6c68d98546 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:21.238322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e2876-7439-4c06-917a-73717e7bf9e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:21.238947 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e2876-7439-4c06-917a-73717e7bf9e9 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:21.239233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e2876-7439-4c06-917a-73717e7bf9e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:21.240404 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e2876-7439-4c06-917a-73717e7bf9e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:21.249920 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e2876-7439-4c06-917a-73717e7bf9e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:21.252029 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e2876-7439-4c06-917a-73717e7bf9e9 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:21.268237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1256/2505] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:21.546331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf80ee-76ff-4081-899e-177cc1d2bbe8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:21.547316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf80ee-76ff-4081-899e-177cc1d2bbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:21.547771 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf80ee-76ff-4081-899e-177cc1d2bbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:21.612610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7eaf80ee-76ff-4081-899e-177cc1d2bbe8 None None] MFA Rules not processed for user `a4a067e8b43e440f9349fc44d207549c`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:21.614264 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7eaf80ee-76ff-4081-899e-177cc1d2bbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:21.770937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1250/2506] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:21.793398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e2876-7439-4c06-917a-73717e7bf9e9 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:21.796018 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c25e2876-7439-4c06-917a-73717e7bf9e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:21.905595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e2876-7439-4c06-917a-73717e7bf9e9 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:21.909856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b079c-bc26-493c-9758-b78197ac0499 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25519cdc25244a0b039ce3097c328d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:21.910676 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b079c-bc26-493c-9758-b78197ac0499 service glance] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:21.910794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b079c-bc26-493c-9758-b78197ac0499 service glance] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:21.911049 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b079c-bc26-493c-9758-b78197ac0499 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:21.920521 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0b6b079c-bc26-493c-9758-b78197ac0499 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:21.993646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b079c-bc26-493c-9758-b78197ac0499 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:21.996536 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b079c-bc26-493c-9758-b78197ac0499 service glance] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:22.009394 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1257/2507] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:22.165118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3704fa-6455-49de-ba7f-25717fcbc0d2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:22.165405 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3704fa-6455-49de-ba7f-25717fcbc0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:22.165677 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3704fa-6455-49de-ba7f-25717fcbc0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:22.196787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7f3704fa-6455-49de-ba7f-25717fcbc0d2 None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:22.197277 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7f3704fa-6455-49de-ba7f-25717fcbc0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:22.269076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1251/2508] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 17:17:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:22.298280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b079c-bc26-493c-9758-b78197ac0499 service glance] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:22.300293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0b6b079c-bc26-493c-9758-b78197ac0499 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:22.378422 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b079c-bc26-493c-9758-b78197ac0499 service glance] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:22.383593 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d40a0b-0585-4630-8215-f3a9e68d97a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:22.384565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d40a0b-0585-4630-8215-f3a9e68d97a5 service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:22.384857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d40a0b-0585-4630-8215-f3a9e68d97a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:22.385136 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d40a0b-0585-4630-8215-f3a9e68d97a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:22.394677 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d40a0b-0585-4630-8215-f3a9e68d97a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:22.396453 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d40a0b-0585-4630-8215-f3a9e68d97a5 service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:22.406470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1258/2509] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:17:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:17:24.391507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3704fa-6455-49de-ba7f-25717fcbc0d2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:24.479184 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3704fa-6455-49de-ba7f-25717fcbc0d2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:24.484939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f3593-557f-4f13-b04d-1116b2cd22ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:24.485904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f3593-557f-4f13-b04d-1116b2cd22ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:24.486251 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f3593-557f-4f13-b04d-1116b2cd22ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:24.486596 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f3593-557f-4f13-b04d-1116b2cd22ad admin admin] PATH_INFO: `/v3/users/dc062aadbfa54ca981f518400571fd23` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:24.487882 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f3593-557f-4f13-b04d-1116b2cd22ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc062aadbfa54ca981f518400571fd23)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:24.489975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f3593-557f-4f13-b04d-1116b2cd22ad admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:24.558377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a10f3593-557f-4f13-b04d-1116b2cd22ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc062aadbfa54ca981f518400571fd23'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:24.559658 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a10f3593-557f-4f13-b04d-1116b2cd22ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc062aadbfa54ca981f518400571fd23'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:24.575723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a10f3593-557f-4f13-b04d-1116b2cd22ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc062aadbfa54ca981f518400571fd23'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:24.586445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a10f3593-557f-4f13-b04d-1116b2cd22ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc062aadbfa54ca981f518400571fd23'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:24.587892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a10f3593-557f-4f13-b04d-1116b2cd22ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc062aadbfa54ca981f518400571fd23'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:24.611689 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1252/2510] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:17:24 2022] DELETE /identity/v3/users/dc062aadbfa54ca981f518400571fd23 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:24.616665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897893f-0ff6-4932-9ff2-1e66041bbae1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:24.617619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897893f-0ff6-4932-9ff2-1e66041bbae1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:24.618786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897893f-0ff6-4932-9ff2-1e66041bbae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:24.646585 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e897893f-0ff6-4932-9ff2-1e66041bbae1 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:24.648218 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e897893f-0ff6-4932-9ff2-1e66041bbae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:24.737143 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1259/2511] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:17:24.747485 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f3593-557f-4f13-b04d-1116b2cd22ad admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:24.749435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a10f3593-557f-4f13-b04d-1116b2cd22ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:24.823196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f3593-557f-4f13-b04d-1116b2cd22ad admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:24.829231 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d9619-29b4-4e80-9842-d9406c005bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:24.830724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d9619-29b4-4e80-9842-d9406c005bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:24.831195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d9619-29b4-4e80-9842-d9406c005bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:24.831553 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d9619-29b4-4e80-9842-d9406c005bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:24.848580 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d9619-29b4-4e80-9842-d9406c005bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:24.850279 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d9619-29b4-4e80-9842-d9406c005bb7 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:24.885628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1253/2512] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:25.432689 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897893f-0ff6-4932-9ff2-1e66041bbae1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:25.434351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e897893f-0ff6-4932-9ff2-1e66041bbae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:25.452363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897893f-0ff6-4932-9ff2-1e66041bbae1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:25.467852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f5be8-1f0c-4663-abd6-9c0eb74c0cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:25.469533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f5be8-1f0c-4663-abd6-9c0eb74c0cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:25.469978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f5be8-1f0c-4663-abd6-9c0eb74c0cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:25.470658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f5be8-1f0c-4663-abd6-9c0eb74c0cce admin admin] PATH_INFO: `/v3/projects/4fb89f649b6a4e70885150deda6f4409` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:25.472294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f5be8-1f0c-4663-abd6-9c0eb74c0cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fb89f649b6a4e70885150deda6f4409)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:25.474391 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f5be8-1f0c-4663-abd6-9c0eb74c0cce admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:25.576068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ea3f5be8-1f0c-4663-abd6-9c0eb74c0cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb89f649b6a4e70885150deda6f4409', 'request_id': 'req-ea3f5be8-1f0c-4663-abd6-9c0eb74c0cce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:25.584823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ea3f5be8-1f0c-4663-abd6-9c0eb74c0cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb89f649b6a4e70885150deda6f4409', 'request_id': 'req-ea3f5be8-1f0c-4663-abd6-9c0eb74c0cce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:25.603924 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ea3f5be8-1f0c-4663-abd6-9c0eb74c0cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb89f649b6a4e70885150deda6f4409', 'request_id': 'req-ea3f5be8-1f0c-4663-abd6-9c0eb74c0cce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:25.618429 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ea3f5be8-1f0c-4663-abd6-9c0eb74c0cce admin admin] The token cache is being invalidate because project 4fb89f649b6a4e70885150deda6f4409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:17:25.619464 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ea3f5be8-1f0c-4663-abd6-9c0eb74c0cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:25.620346 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ea3f5be8-1f0c-4663-abd6-9c0eb74c0cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:25.628160 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcd1cb-00ea-4aff-a6d3-ae3f1327684c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:25.628699 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcd1cb-00ea-4aff-a6d3-ae3f1327684c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:25.628699 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcd1cb-00ea-4aff-a6d3-ae3f1327684c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:25.629613 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1260/2513] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:17:25 2022] DELETE /identity/v3/projects/4fb89f649b6a4e70885150deda6f4409 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:25.674949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b4dcd1cb-00ea-4aff-a6d3-ae3f1327684c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:25.676222 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b4dcd1cb-00ea-4aff-a6d3-ae3f1327684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:25.870092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1254/2514] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:25.879060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b733c-73b3-47c7-8bf1-82c172f03f38 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:25.879904 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b733c-73b3-47c7-8bf1-82c172f03f38 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:25.880390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b733c-73b3-47c7-8bf1-82c172f03f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:25.928358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-039b733c-73b3-47c7-8bf1-82c172f03f38 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:25.930347 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-039b733c-73b3-47c7-8bf1-82c172f03f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:25.960550 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1261/2515] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:25.968041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcd1cb-00ea-4aff-a6d3-ae3f1327684c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:25.984913 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcd1cb-00ea-4aff-a6d3-ae3f1327684c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:25.997004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd4948-f660-4ddb-b0a6-5c4d6c474306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:25.997740 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd4948-f660-4ddb-b0a6-5c4d6c474306 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:25.998061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd4948-f660-4ddb-b0a6-5c4d6c474306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:25.998348 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd4948-f660-4ddb-b0a6-5c4d6c474306 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:25.999166 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd4948-f660-4ddb-b0a6-5c4d6c474306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:17:25.999488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd4948-f660-4ddb-b0a6-5c4d6c474306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:26.001191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd4948-f660-4ddb-b0a6-5c4d6c474306 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:26.050489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1255/2516] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:17:26.052398 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b733c-73b3-47c7-8bf1-82c172f03f38 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:26.064194 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b733c-73b3-47c7-8bf1-82c172f03f38 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:26.078125 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e397a-7411-47fa-a3e1-a71e14e33673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:26.078818 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e397a-7411-47fa-a3e1-a71e14e33673 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:26.079099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e397a-7411-47fa-a3e1-a71e14e33673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:26.079376 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e397a-7411-47fa-a3e1-a71e14e33673 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:26.080124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e397a-7411-47fa-a3e1-a71e14e33673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:26.082053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e397a-7411-47fa-a3e1-a71e14e33673 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:26.137984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1262/2517] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:17:26 2022] POST /identity/v3/projects => generated 363 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:26.142108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd4948-f660-4ddb-b0a6-5c4d6c474306 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:26.187588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd4948-f660-4ddb-b0a6-5c4d6c474306 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:26.340226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451349a-6191-4303-9012-267135668484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:26.340802 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451349a-6191-4303-9012-267135668484 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:26.341082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451349a-6191-4303-9012-267135668484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:26.341362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451349a-6191-4303-9012-267135668484 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:26.342347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451349a-6191-4303-9012-267135668484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:26.345057 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451349a-6191-4303-9012-267135668484 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:26.398822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1256/2518] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:17:26 2022] POST /identity/v3/users => generated 282 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:26.403018 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e397a-7411-47fa-a3e1-a71e14e33673 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:26.427269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e397a-7411-47fa-a3e1-a71e14e33673 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:26.440652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2632c2-9822-47e3-b475-84629410a6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:26.441348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2632c2-9822-47e3-b475-84629410a6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:26.441628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2632c2-9822-47e3-b475-84629410a6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:26.441907 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2632c2-9822-47e3-b475-84629410a6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:26.442685 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2632c2-9822-47e3-b475-84629410a6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:26.444358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2632c2-9822-47e3-b475-84629410a6f1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:26.473300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1263/2519] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:26.478695 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451349a-6191-4303-9012-267135668484 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:26.492045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451349a-6191-4303-9012-267135668484 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:26.506083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c7d09-e76c-4596-81c2-e438db2c26bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:26.507036 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c7d09-e76c-4596-81c2-e438db2c26bb admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:26.507468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c7d09-e76c-4596-81c2-e438db2c26bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:26.507833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c7d09-e76c-4596-81c2-e438db2c26bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:26.508824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c7d09-e76c-4596-81c2-e438db2c26bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:26.511565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c7d09-e76c-4596-81c2-e438db2c26bb admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:26.533737 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1257/2520] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:26.537825 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2632c2-9822-47e3-b475-84629410a6f1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:26.555251 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2632c2-9822-47e3-b475-84629410a6f1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:26.564980 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e4dce-f760-4ca1-87f5-c8ae838f93cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:26.566157 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e4dce-f760-4ca1-87f5-c8ae838f93cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:26.566599 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e4dce-f760-4ca1-87f5-c8ae838f93cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:26.567037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e4dce-f760-4ca1-87f5-c8ae838f93cc admin admin] PATH_INFO: `/v3/projects/cbd7f0e7f6d8416b8097974276c53508/users/3b995253b88a4b81bd4240a7dda05e3e/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:26.600554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e4dce-f760-4ca1-87f5-c8ae838f93cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd7f0e7f6d8416b8097974276c53508, user_id=3b995253b88a4b81bd4240a7dda05e3e, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:26.603714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e4dce-f760-4ca1-87f5-c8ae838f93cc admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:26.636679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1264/2521] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:26 2022] PUT /identity/v3/projects/cbd7f0e7f6d8416b8097974276c53508/users/3b995253b88a4b81bd4240a7dda05e3e/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:17:26.647381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f7c4b-7127-4ffb-9a81-76bdba06cbda None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:26.647955 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f7c4b-7127-4ffb-9a81-76bdba06cbda None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:26.648090 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f7c4b-7127-4ffb-9a81-76bdba06cbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:26.708390 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0d9f7c4b-7127-4ffb-9a81-76bdba06cbda None None] MFA Rules not processed for user `3b995253b88a4b81bd4240a7dda05e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:26.710473 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0d9f7c4b-7127-4ffb-9a81-76bdba06cbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:26.854764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1258/2522] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:26.857231 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e4dce-f760-4ca1-87f5-c8ae838f93cc admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:26.948212 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e4dce-f760-4ca1-87f5-c8ae838f93cc admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:26.954950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27a9b8-a2c4-4882-9e9d-534b12beaa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:26.955906 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27a9b8-a2c4-4882-9e9d-534b12beaa65 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:26.956360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27a9b8-a2c4-4882-9e9d-534b12beaa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:26.956798 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27a9b8-a2c4-4882-9e9d-534b12beaa65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:26.957641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27a9b8-a2c4-4882-9e9d-534b12beaa65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:26.959755 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27a9b8-a2c4-4882-9e9d-534b12beaa65 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:27.034312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1265/2523] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:17:26 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:27.038138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f7c4b-7127-4ffb-9a81-76bdba06cbda None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:27.062105 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f7c4b-7127-4ffb-9a81-76bdba06cbda None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:27.162963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babf08a-1191-40b8-8dc7-b0c91d3a26f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:27.164031 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babf08a-1191-40b8-8dc7-b0c91d3a26f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:27.164520 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babf08a-1191-40b8-8dc7-b0c91d3a26f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:27.164985 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babf08a-1191-40b8-8dc7-b0c91d3a26f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:27.165848 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babf08a-1191-40b8-8dc7-b0c91d3a26f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:27.168239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babf08a-1191-40b8-8dc7-b0c91d3a26f2 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:27.207016 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1259/2524] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:17:27 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:27.210758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27a9b8-a2c4-4882-9e9d-534b12beaa65 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:27.227946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27a9b8-a2c4-4882-9e9d-534b12beaa65 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:27.244857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a1e97-cc3a-4993-b51a-96fa74471b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:27.246606 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a1e97-cc3a-4993-b51a-96fa74471b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:27.247318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a1e97-cc3a-4993-b51a-96fa74471b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:27.247892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a1e97-cc3a-4993-b51a-96fa74471b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:27.249174 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a1e97-cc3a-4993-b51a-96fa74471b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:27.250971 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a1e97-cc3a-4993-b51a-96fa74471b60 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:27.285190 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babf08a-1191-40b8-8dc7-b0c91d3a26f2 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:27.304333 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babf08a-1191-40b8-8dc7-b0c91d3a26f2 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:27.305683 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1266/2525] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:27.320659 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d914-24f4-4378-b6ca-dd0c224f5cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:27.321813 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d914-24f4-4378-b6ca-dd0c224f5cda admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:27.322271 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d914-24f4-4378-b6ca-dd0c224f5cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:27.322765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d914-24f4-4378-b6ca-dd0c224f5cda admin admin] PATH_INFO: `/v3/projects/85d9166ededc4ab1b35277e87a086b2c/users/3ff92c82da464919bb3f6c33265d51ce/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:27.347010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69d914-24f4-4378-b6ca-dd0c224f5cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d9166ededc4ab1b35277e87a086b2c, user_id=3ff92c82da464919bb3f6c33265d51ce, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:27.351550 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69d914-24f4-4378-b6ca-dd0c224f5cda admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:27.373844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1260/2526] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:27 2022] PUT /identity/v3/projects/85d9166ededc4ab1b35277e87a086b2c/users/3ff92c82da464919bb3f6c33265d51ce/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:27.377481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a1e97-cc3a-4993-b51a-96fa74471b60 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:27.393149 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a1e97-cc3a-4993-b51a-96fa74471b60 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:27.431891 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb1ae5-eac0-4218-b535-6bfc741540f8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:27.432180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb1ae5-eac0-4218-b535-6bfc741540f8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:27.432454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb1ae5-eac0-4218-b535-6bfc741540f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:27.463083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1ceb1ae5-eac0-4218-b535-6bfc741540f8 None None] MFA Rules not processed for user `38bdb5f8e08e49358f9f27e4f1ce167b`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:27.465387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1ceb1ae5-eac0-4218-b535-6bfc741540f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:27.539097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e5abd-08f8-4dfe-aa35-e62687ca7afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:27.540083 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e5abd-08f8-4dfe-aa35-e62687ca7afd admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:27.540579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e5abd-08f8-4dfe-aa35-e62687ca7afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:27.541146 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e5abd-08f8-4dfe-aa35-e62687ca7afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:27.548257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e5abd-08f8-4dfe-aa35-e62687ca7afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:27.552910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e5abd-08f8-4dfe-aa35-e62687ca7afd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:27.575425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1267/2527] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:27.576766 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e5abd-08f8-4dfe-aa35-e62687ca7afd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:27.595705 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e5abd-08f8-4dfe-aa35-e62687ca7afd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:27.599577 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1261/2528] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:27.616722 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937e740-8ee2-4ef5-9c44-4738e495ea42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:27.618482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937e740-8ee2-4ef5-9c44-4738e495ea42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:27.618774 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937e740-8ee2-4ef5-9c44-4738e495ea42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:27.619059 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937e740-8ee2-4ef5-9c44-4738e495ea42 admin admin] PATH_INFO: `/v3/projects/85d9166ededc4ab1b35277e87a086b2c/users/3ff92c82da464919bb3f6c33265d51ce/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:27.623945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937e740-8ee2-4ef5-9c44-4738e495ea42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d9166ededc4ab1b35277e87a086b2c, user_id=3ff92c82da464919bb3f6c33265d51ce, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:27.626648 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937e740-8ee2-4ef5-9c44-4738e495ea42 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:27.649767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1268/2529] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:27 2022] PUT /identity/v3/projects/85d9166ededc4ab1b35277e87a086b2c/users/3ff92c82da464919bb3f6c33265d51ce/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:27.668382 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69350376-c017-48d9-ac3a-d204b47f6ea2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:27.675516 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69350376-c017-48d9-ac3a-d204b47f6ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:27.676171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69350376-c017-48d9-ac3a-d204b47f6ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:27.760291 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-69350376-c017-48d9-ac3a-d204b47f6ea2 None None] MFA Rules not processed for user `3ff92c82da464919bb3f6c33265d51ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:27.764521 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-69350376-c017-48d9-ac3a-d204b47f6ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:27.901907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1262/2530] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:27 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:27.913711 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937e740-8ee2-4ef5-9c44-4738e495ea42 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:27.915707 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b937e740-8ee2-4ef5-9c44-4738e495ea42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:28.014668 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937e740-8ee2-4ef5-9c44-4738e495ea42 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:28.028419 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0301efd-ab12-4b2e-9e2d-2071cefda4e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:28.029245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0301efd-ab12-4b2e-9e2d-2071cefda4e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:28.029644 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0301efd-ab12-4b2e-9e2d-2071cefda4e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:28.030029 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0301efd-ab12-4b2e-9e2d-2071cefda4e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:28.056334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0301efd-ab12-4b2e-9e2d-2071cefda4e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:28.058720 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0301efd-ab12-4b2e-9e2d-2071cefda4e0 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:28.076630 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1269/2531] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:27 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:28.267179 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69350376-c017-48d9-ac3a-d204b47f6ea2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:28.286812 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69350376-c017-48d9-ac3a-d204b47f6ea2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:28.310478 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577842c5-e6d7-491e-9fd4-43f91cf1ffb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:28.311780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577842c5-e6d7-491e-9fd4-43f91cf1ffb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:28.313641 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577842c5-e6d7-491e-9fd4-43f91cf1ffb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:28.314120 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577842c5-e6d7-491e-9fd4-43f91cf1ffb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:28.457987 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577842c5-e6d7-491e-9fd4-43f91cf1ffb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:28.459456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577842c5-e6d7-491e-9fd4-43f91cf1ffb8 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:28.498713 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1263/2532] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:28 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:31.669243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0301efd-ab12-4b2e-9e2d-2071cefda4e0 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:31.754685 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0301efd-ab12-4b2e-9e2d-2071cefda4e0 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:31.761422 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ac8cd-18ea-4714-89f2-134925b0fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:31.762934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ac8cd-18ea-4714-89f2-134925b0fcf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:31.763383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ac8cd-18ea-4714-89f2-134925b0fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:31.763895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ac8cd-18ea-4714-89f2-134925b0fcf3 admin admin] PATH_INFO: `/v3/users/3b995253b88a4b81bd4240a7dda05e3e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:31.765315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ac8cd-18ea-4714-89f2-134925b0fcf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b995253b88a4b81bd4240a7dda05e3e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:31.767760 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ac8cd-18ea-4714-89f2-134925b0fcf3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:31.874844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-404ac8cd-18ea-4714-89f2-134925b0fcf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b995253b88a4b81bd4240a7dda05e3e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:31.900207 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-404ac8cd-18ea-4714-89f2-134925b0fcf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b995253b88a4b81bd4240a7dda05e3e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:31.908243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-404ac8cd-18ea-4714-89f2-134925b0fcf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b995253b88a4b81bd4240a7dda05e3e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:31.909177 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-404ac8cd-18ea-4714-89f2-134925b0fcf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b995253b88a4b81bd4240a7dda05e3e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:31.910712 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-404ac8cd-18ea-4714-89f2-134925b0fcf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b995253b88a4b81bd4240a7dda05e3e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:31.929709 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1270/2533] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:17:31 2022] DELETE /identity/v3/users/3b995253b88a4b81bd4240a7dda05e3e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:31.935121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a21efe-5fdd-45c5-afeb-010dc552f27d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:31.935722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a21efe-5fdd-45c5-afeb-010dc552f27d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:31.935722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a21efe-5fdd-45c5-afeb-010dc552f27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:31.958491 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d6a21efe-5fdd-45c5-afeb-010dc552f27d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:31.960600 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d6a21efe-5fdd-45c5-afeb-010dc552f27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:32.048185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1264/2534] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:32.054184 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ac8cd-18ea-4714-89f2-134925b0fcf3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:32.055596 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-404ac8cd-18ea-4714-89f2-134925b0fcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:32.172545 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ac8cd-18ea-4714-89f2-134925b0fcf3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:32.175207 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf8eb0-b866-4248-895a-94db040fcfb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:32.176023 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf8eb0-b866-4248-895a-94db040fcfb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:32.176416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf8eb0-b866-4248-895a-94db040fcfb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:32.176796 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf8eb0-b866-4248-895a-94db040fcfb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:32.203856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf8eb0-b866-4248-895a-94db040fcfb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:32.205959 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf8eb0-b866-4248-895a-94db040fcfb7 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:32.220320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1271/2535] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:32.630210 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a21efe-5fdd-45c5-afeb-010dc552f27d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:32.632044 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d6a21efe-5fdd-45c5-afeb-010dc552f27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:32.655149 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a21efe-5fdd-45c5-afeb-010dc552f27d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:32.663159 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa00aab-b4f9-4712-90ec-864312c01fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:32.664061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa00aab-b4f9-4712-90ec-864312c01fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:32.669824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa00aab-b4f9-4712-90ec-864312c01fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:32.680248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa00aab-b4f9-4712-90ec-864312c01fe1 admin admin] PATH_INFO: `/v3/projects/cbd7f0e7f6d8416b8097974276c53508` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:32.682390 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa00aab-b4f9-4712-90ec-864312c01fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd7f0e7f6d8416b8097974276c53508)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:32.685967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa00aab-b4f9-4712-90ec-864312c01fe1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:32.790021 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9fa00aab-b4f9-4712-90ec-864312c01fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd7f0e7f6d8416b8097974276c53508', 'request_id': 'req-9fa00aab-b4f9-4712-90ec-864312c01fe1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:32.797208 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9fa00aab-b4f9-4712-90ec-864312c01fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd7f0e7f6d8416b8097974276c53508', 'request_id': 'req-9fa00aab-b4f9-4712-90ec-864312c01fe1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:32.816870 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9fa00aab-b4f9-4712-90ec-864312c01fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd7f0e7f6d8416b8097974276c53508', 'request_id': 'req-9fa00aab-b4f9-4712-90ec-864312c01fe1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:32.832907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9fa00aab-b4f9-4712-90ec-864312c01fe1 admin admin] The token cache is being invalidate because project cbd7f0e7f6d8416b8097974276c53508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:17:32.833311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9fa00aab-b4f9-4712-90ec-864312c01fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:32.834039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-9fa00aab-b4f9-4712-90ec-864312c01fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:32.838589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1265/2536] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:17:32 2022] DELETE /identity/v3/projects/cbd7f0e7f6d8416b8097974276c53508 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:32.840470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf8eb0-b866-4248-895a-94db040fcfb7 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:32.856679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf8eb0-b866-4248-895a-94db040fcfb7 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:32.961064 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7091737-2b79-488b-8ed4-567e425fda7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:32.962290 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7091737-2b79-488b-8ed4-567e425fda7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:32.962806 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7091737-2b79-488b-8ed4-567e425fda7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:32.963306 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7091737-2b79-488b-8ed4-567e425fda7a admin admin] PATH_INFO: `/v3/users/3ff92c82da464919bb3f6c33265d51ce` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:32.965019 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7091737-2b79-488b-8ed4-567e425fda7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff92c82da464919bb3f6c33265d51ce)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:32.967297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7091737-2b79-488b-8ed4-567e425fda7a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:33.043187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b7091737-2b79-488b-8ed4-567e425fda7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff92c82da464919bb3f6c33265d51ce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:33.071697 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b7091737-2b79-488b-8ed4-567e425fda7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff92c82da464919bb3f6c33265d51ce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:33.082935 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b7091737-2b79-488b-8ed4-567e425fda7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff92c82da464919bb3f6c33265d51ce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:33.084389 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b7091737-2b79-488b-8ed4-567e425fda7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff92c82da464919bb3f6c33265d51ce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:33.085036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b7091737-2b79-488b-8ed4-567e425fda7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff92c82da464919bb3f6c33265d51ce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:33.113827 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1272/2537] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:17:32 2022] DELETE /identity/v3/users/3ff92c82da464919bb3f6c33265d51ce => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:33.477776 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa00aab-b4f9-4712-90ec-864312c01fe1 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:33.482623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-9fa00aab-b4f9-4712-90ec-864312c01fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:33.517544 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa00aab-b4f9-4712-90ec-864312c01fe1 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:33.645323 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e8b21-3358-4e8c-8109-384c7318627a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:33.646346 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e8b21-3358-4e8c-8109-384c7318627a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:33.646905 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e8b21-3358-4e8c-8109-384c7318627a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:33.647352 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e8b21-3358-4e8c-8109-384c7318627a admin admin] PATH_INFO: `/v3/projects/85d9166ededc4ab1b35277e87a086b2c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:33.648813 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e8b21-3358-4e8c-8109-384c7318627a admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d9166ededc4ab1b35277e87a086b2c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:33.650904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e8b21-3358-4e8c-8109-384c7318627a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:33.713485 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ca8e8b21-3358-4e8c-8109-384c7318627a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d9166ededc4ab1b35277e87a086b2c', 'request_id': 'req-ca8e8b21-3358-4e8c-8109-384c7318627a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:33.720078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ca8e8b21-3358-4e8c-8109-384c7318627a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d9166ededc4ab1b35277e87a086b2c', 'request_id': 'req-ca8e8b21-3358-4e8c-8109-384c7318627a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:33.734759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ca8e8b21-3358-4e8c-8109-384c7318627a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d9166ededc4ab1b35277e87a086b2c', 'request_id': 'req-ca8e8b21-3358-4e8c-8109-384c7318627a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:33.754257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ca8e8b21-3358-4e8c-8109-384c7318627a admin admin] The token cache is being invalidate because project 85d9166ededc4ab1b35277e87a086b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:17:33.754983 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ca8e8b21-3358-4e8c-8109-384c7318627a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:33.755921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ca8e8b21-3358-4e8c-8109-384c7318627a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:33.758309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1266/2538] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:17:33 2022] DELETE /identity/v3/projects/85d9166ededc4ab1b35277e87a086b2c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:33.763090 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8a8f8-16ee-4d84-bc39-15609bd787a7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:33.763383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8a8f8-16ee-4d84-bc39-15609bd787a7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:33.763686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8a8f8-16ee-4d84-bc39-15609bd787a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:33.791070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c6b8a8f8-16ee-4d84-bc39-15609bd787a7 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:33.793317 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c6b8a8f8-16ee-4d84-bc39-15609bd787a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:33.867082 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1273/2539] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:17:33.877784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0eeb78-0f8f-441d-b4b9-40033c5ffb1b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:33.878094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0eeb78-0f8f-441d-b4b9-40033c5ffb1b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:33.878495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0eeb78-0f8f-441d-b4b9-40033c5ffb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:33.901933 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-0f0eeb78-0f8f-441d-b4b9-40033c5ffb1b None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:33.903489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-0f0eeb78-0f8f-441d-b4b9-40033c5ffb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:33.912468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1267/2540] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:33.916442 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8a8f8-16ee-4d84-bc39-15609bd787a7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:33.929256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8a8f8-16ee-4d84-bc39-15609bd787a7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:33.946590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8face-1a0c-4561-a92a-0b101ba46a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:33.947393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8face-1a0c-4561-a92a-0b101ba46a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:33.947827 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8face-1a0c-4561-a92a-0b101ba46a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:33.948702 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8face-1a0c-4561-a92a-0b101ba46a2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:33.949558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8face-1a0c-4561-a92a-0b101ba46a2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:17:33.949968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8face-1a0c-4561-a92a-0b101ba46a2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:33.957614 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8face-1a0c-4561-a92a-0b101ba46a2e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:33.976554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1274/2541] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:17:33.979859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0eeb78-0f8f-441d-b4b9-40033c5ffb1b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:33.994163 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0eeb78-0f8f-441d-b4b9-40033c5ffb1b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:33.999761 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0485f4-af6b-4bdf-9f71-693ce2d11952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:34.000429 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0485f4-af6b-4bdf-9f71-693ce2d11952 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:34.000711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0485f4-af6b-4bdf-9f71-693ce2d11952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:34.000985 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0485f4-af6b-4bdf-9f71-693ce2d11952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:34.001928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0485f4-af6b-4bdf-9f71-693ce2d11952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:34.004017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0485f4-af6b-4bdf-9f71-693ce2d11952 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:34.043715 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1268/2542] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:17:33 2022] POST /identity/v3/projects => generated 401 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:17:34.045154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8face-1a0c-4561-a92a-0b101ba46a2e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:34.059955 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8face-1a0c-4561-a92a-0b101ba46a2e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:34.135335 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6893999-3c6c-4fec-a076-8e7bd8fd336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:34.136224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6893999-3c6c-4fec-a076-8e7bd8fd336f admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:34.136509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6893999-3c6c-4fec-a076-8e7bd8fd336f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:34.136790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6893999-3c6c-4fec-a076-8e7bd8fd336f admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:34.137489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6893999-3c6c-4fec-a076-8e7bd8fd336f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:34.139445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6893999-3c6c-4fec-a076-8e7bd8fd336f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:34.171999 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1275/2543] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:17:34 2022] POST /identity/v3/users => generated 301 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:34.173250 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0485f4-af6b-4bdf-9f71-693ce2d11952 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:34.184437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0485f4-af6b-4bdf-9f71-693ce2d11952 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:34.189486 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78058d-31c4-44f6-8131-94e33924d625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:34.190155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78058d-31c4-44f6-8131-94e33924d625 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:34.190438 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78058d-31c4-44f6-8131-94e33924d625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:34.190714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78058d-31c4-44f6-8131-94e33924d625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:34.191437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78058d-31c4-44f6-8131-94e33924d625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:34.193206 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78058d-31c4-44f6-8131-94e33924d625 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:34.205808 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1269/2544] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:34.209691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6893999-3c6c-4fec-a076-8e7bd8fd336f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:34.222296 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6893999-3c6c-4fec-a076-8e7bd8fd336f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:34.227562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b786490-0cc8-4733-aa8b-04661d3b5130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:34.228475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b786490-0cc8-4733-aa8b-04661d3b5130 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:34.228934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b786490-0cc8-4733-aa8b-04661d3b5130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:34.229226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b786490-0cc8-4733-aa8b-04661d3b5130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:34.231205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b786490-0cc8-4733-aa8b-04661d3b5130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:34.232896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b786490-0cc8-4733-aa8b-04661d3b5130 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:34.247554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1276/2545] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:34.248750 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78058d-31c4-44f6-8131-94e33924d625 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:34.261749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78058d-31c4-44f6-8131-94e33924d625 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:34.267414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4a9c8-4da6-41c7-a594-c3fb91f79b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:34.268664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4a9c8-4da6-41c7-a594-c3fb91f79b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:34.269136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4a9c8-4da6-41c7-a594-c3fb91f79b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:34.269576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4a9c8-4da6-41c7-a594-c3fb91f79b51 admin admin] PATH_INFO: `/v3/projects/0989300e82624c85bd4566af5cb2bab0/users/885b6dd656b746e09140f926c8ca3904/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:34.285367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4a9c8-4da6-41c7-a594-c3fb91f79b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0989300e82624c85bd4566af5cb2bab0, user_id=885b6dd656b746e09140f926c8ca3904, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:34.288102 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4a9c8-4da6-41c7-a594-c3fb91f79b51 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:34.305420 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1270/2546] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:34 2022] PUT /identity/v3/projects/0989300e82624c85bd4566af5cb2bab0/users/885b6dd656b746e09140f926c8ca3904/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:17:34.315972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc828248-207d-4321-bfaf-852d399939c0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:34.316305 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc828248-207d-4321-bfaf-852d399939c0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:34.316608 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc828248-207d-4321-bfaf-852d399939c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:34.353434 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-dc828248-207d-4321-bfaf-852d399939c0 None None] MFA Rules not processed for user `885b6dd656b746e09140f926c8ca3904`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:34.355562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-dc828248-207d-4321-bfaf-852d399939c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:34.436890 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1277/2547] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:34.441714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4a9c8-4da6-41c7-a594-c3fb91f79b51 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:34.511977 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4a9c8-4da6-41c7-a594-c3fb91f79b51 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:34.519721 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0708ec6-ba4c-4e75-b2b5-ab3bf6a96032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:34.520383 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0708ec6-ba4c-4e75-b2b5-ab3bf6a96032 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:34.521285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0708ec6-ba4c-4e75-b2b5-ab3bf6a96032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:34.521572 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0708ec6-ba4c-4e75-b2b5-ab3bf6a96032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:34.522281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0708ec6-ba4c-4e75-b2b5-ab3bf6a96032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:34.524238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0708ec6-ba4c-4e75-b2b5-ab3bf6a96032 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:34.596847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1271/2548] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:17:34 2022] POST /identity/v3/projects => generated 401 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:34.600938 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc828248-207d-4321-bfaf-852d399939c0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:34.611942 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc828248-207d-4321-bfaf-852d399939c0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:34.678374 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ea7a5-c62a-407d-ba0c-93815d2ace83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:34.679103 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ea7a5-c62a-407d-ba0c-93815d2ace83 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:34.679403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ea7a5-c62a-407d-ba0c-93815d2ace83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:34.679685 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ea7a5-c62a-407d-ba0c-93815d2ace83 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:34.680383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ea7a5-c62a-407d-ba0c-93815d2ace83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:34.682337 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ea7a5-c62a-407d-ba0c-93815d2ace83 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:34.705315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1278/2549] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:17:34 2022] POST /identity/v3/users => generated 307 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:17:34.709455 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0708ec6-ba4c-4e75-b2b5-ab3bf6a96032 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:34.722796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0708ec6-ba4c-4e75-b2b5-ab3bf6a96032 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:34.728174 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e3c06-a12a-48bf-b24b-dcb0ca44f674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:34.728840 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3c06-a12a-48bf-b24b-dcb0ca44f674 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:34.731377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3c06-a12a-48bf-b24b-dcb0ca44f674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:34.731377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3c06-a12a-48bf-b24b-dcb0ca44f674 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:34.731377 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e3c06-a12a-48bf-b24b-dcb0ca44f674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:34.732331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e3c06-a12a-48bf-b24b-dcb0ca44f674 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:34.748101 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1272/2550] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:17:34.749307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ea7a5-c62a-407d-ba0c-93815d2ace83 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:34.759707 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ea7a5-c62a-407d-ba0c-93815d2ace83 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:34.764584 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206d5fa-902d-4c40-9039-4ec3e16960aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:34.765401 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206d5fa-902d-4c40-9039-4ec3e16960aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:34.765679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206d5fa-902d-4c40-9039-4ec3e16960aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:34.765949 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206d5fa-902d-4c40-9039-4ec3e16960aa admin admin] PATH_INFO: `/v3/projects/1dbe04e997de4196866d2f9d5477adf4/users/834b26b50f50430fbbe1c3d503814f05/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:34.783123 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206d5fa-902d-4c40-9039-4ec3e16960aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dbe04e997de4196866d2f9d5477adf4, user_id=834b26b50f50430fbbe1c3d503814f05, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:34.785820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206d5fa-902d-4c40-9039-4ec3e16960aa admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:34.803331 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1279/2551] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:34 2022] PUT /identity/v3/projects/1dbe04e997de4196866d2f9d5477adf4/users/834b26b50f50430fbbe1c3d503814f05/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:17:34.807020 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e3c06-a12a-48bf-b24b-dcb0ca44f674 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:34.818650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e3c06-a12a-48bf-b24b-dcb0ca44f674 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:34.883980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260ea56-c229-446d-8612-5c0b34f84151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:34.884950 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260ea56-c229-446d-8612-5c0b34f84151 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:34.885399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260ea56-c229-446d-8612-5c0b34f84151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:34.885912 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260ea56-c229-446d-8612-5c0b34f84151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:34.886901 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260ea56-c229-446d-8612-5c0b34f84151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:34.888532 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260ea56-c229-446d-8612-5c0b34f84151 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:34.899131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1273/2552] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:34.904073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206d5fa-902d-4c40-9039-4ec3e16960aa admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:34.918144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206d5fa-902d-4c40-9039-4ec3e16960aa admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:34.923080 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59aa964-ffbc-429e-92ad-c797defa83c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:34.924077 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aa964-ffbc-429e-92ad-c797defa83c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:34.924432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aa964-ffbc-429e-92ad-c797defa83c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:34.925060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aa964-ffbc-429e-92ad-c797defa83c4 admin admin] PATH_INFO: `/v3/projects/1dbe04e997de4196866d2f9d5477adf4/users/834b26b50f50430fbbe1c3d503814f05/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:34.927307 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59aa964-ffbc-429e-92ad-c797defa83c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dbe04e997de4196866d2f9d5477adf4, user_id=834b26b50f50430fbbe1c3d503814f05, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:34.930127 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59aa964-ffbc-429e-92ad-c797defa83c4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:34.941591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1280/2553] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:34 2022] PUT /identity/v3/projects/1dbe04e997de4196866d2f9d5477adf4/users/834b26b50f50430fbbe1c3d503814f05/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:34.953743 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1c499-8d9e-4cb2-893c-fd06181b0fb2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:34.954386 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1c499-8d9e-4cb2-893c-fd06181b0fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:34.954861 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1c499-8d9e-4cb2-893c-fd06181b0fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:34.987318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-dbc1c499-8d9e-4cb2-893c-fd06181b0fb2 None None] MFA Rules not processed for user `834b26b50f50430fbbe1c3d503814f05`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:34.988815 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-dbc1c499-8d9e-4cb2-893c-fd06181b0fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:35.094060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1274/2554] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:34 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:35.106641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59aa964-ffbc-429e-92ad-c797defa83c4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:35.110226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b59aa964-ffbc-429e-92ad-c797defa83c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:35.203390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59aa964-ffbc-429e-92ad-c797defa83c4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:35.207195 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4dbec-b192-4300-a22f-43e3a516edce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:35.207930 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4dbec-b192-4300-a22f-43e3a516edce service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:35.208208 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4dbec-b192-4300-a22f-43e3a516edce service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:35.208479 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4dbec-b192-4300-a22f-43e3a516edce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:35.220448 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4dbec-b192-4300-a22f-43e3a516edce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:35.222253 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4dbec-b192-4300-a22f-43e3a516edce service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:35.235474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1281/2555] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:35.253289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f30d6-4681-4241-9c3d-dee02ca3f63d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:35.253577 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f30d6-4681-4241-9c3d-dee02ca3f63d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:35.253853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f30d6-4681-4241-9c3d-dee02ca3f63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:35.279540 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-469f30d6-4681-4241-9c3d-dee02ca3f63d None None] MFA Rules not processed for user `b62f5ec1700d4a86aab654c9f2eb0201`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:35.280904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-469f30d6-4681-4241-9c3d-dee02ca3f63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:35.362578 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4dbec-b192-4300-a22f-43e3a516edce service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:35.392247 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4dbec-b192-4300-a22f-43e3a516edce service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:35.398109 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b73e3-94a3-4859-986d-eaadac8a76e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:35.404222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b73e3-94a3-4859-986d-eaadac8a76e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:35.404782 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b73e3-94a3-4859-986d-eaadac8a76e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:35.405631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b73e3-94a3-4859-986d-eaadac8a76e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:35.466016 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1275/2556] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:35.508458 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b73e3-94a3-4859-986d-eaadac8a76e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:35.509950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b73e3-94a3-4859-986d-eaadac8a76e5 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:35.519870 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1282/2557] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:37.941413 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0061501-8c05-4c6c-bf54-29ca0f9b3c0d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:37.942303 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0061501-8c05-4c6c-bf54-29ca0f9b3c0d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:37.942851 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0061501-8c05-4c6c-bf54-29ca0f9b3c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:37.971917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a0061501-8c05-4c6c-bf54-29ca0f9b3c0d None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:37.973356 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a0061501-8c05-4c6c-bf54-29ca0f9b3c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:38.059916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1276/2558] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 17:17:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:38.077758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b73e3-94a3-4859-986d-eaadac8a76e5 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:38.079790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ef9b73e3-94a3-4859-986d-eaadac8a76e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:38.266141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b73e3-94a3-4859-986d-eaadac8a76e5 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:38.271503 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e1a24-f8c1-46fc-9a6e-ee9abc662d88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:38.272684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e1a24-f8c1-46fc-9a6e-ee9abc662d88 service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:38.272684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e1a24-f8c1-46fc-9a6e-ee9abc662d88 service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:38.273214 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e1a24-f8c1-46fc-9a6e-ee9abc662d88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:38.294537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e1a24-f8c1-46fc-9a6e-ee9abc662d88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:38.298676 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e1a24-f8c1-46fc-9a6e-ee9abc662d88 service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:38.323730 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1283/2559] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:17:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:17:39.956473 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0061501-8c05-4c6c-bf54-29ca0f9b3c0d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:40.024604 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0061501-8c05-4c6c-bf54-29ca0f9b3c0d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:40.030294 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97e0b5-401b-4e05-84a2-5c6592630415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:40.031252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97e0b5-401b-4e05-84a2-5c6592630415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:40.031531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97e0b5-401b-4e05-84a2-5c6592630415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:40.031939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97e0b5-401b-4e05-84a2-5c6592630415 admin admin] PATH_INFO: `/v3/users/885b6dd656b746e09140f926c8ca3904` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:40.033221 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97e0b5-401b-4e05-84a2-5c6592630415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=885b6dd656b746e09140f926c8ca3904)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:40.035218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97e0b5-401b-4e05-84a2-5c6592630415 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:40.084773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ba97e0b5-401b-4e05-84a2-5c6592630415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885b6dd656b746e09140f926c8ca3904'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:40.085431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ba97e0b5-401b-4e05-84a2-5c6592630415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885b6dd656b746e09140f926c8ca3904'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:40.102359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ba97e0b5-401b-4e05-84a2-5c6592630415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885b6dd656b746e09140f926c8ca3904'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:40.110091 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ba97e0b5-401b-4e05-84a2-5c6592630415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885b6dd656b746e09140f926c8ca3904'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:40.110767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ba97e0b5-401b-4e05-84a2-5c6592630415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885b6dd656b746e09140f926c8ca3904'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:40.124778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1277/2560] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:17:39 2022] DELETE /identity/v3/users/885b6dd656b746e09140f926c8ca3904 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:40.129705 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda666c-4d5e-4a25-a10c-645b56c4c91e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:40.130289 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda666c-4d5e-4a25-a10c-645b56c4c91e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:40.130401 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda666c-4d5e-4a25-a10c-645b56c4c91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:40.150143 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bdda666c-4d5e-4a25-a10c-645b56c4c91e None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:40.154595 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bdda666c-4d5e-4a25-a10c-645b56c4c91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:40.282409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1284/2561] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:40.292173 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97e0b5-401b-4e05-84a2-5c6592630415 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:40.293743 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ba97e0b5-401b-4e05-84a2-5c6592630415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:40.384623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97e0b5-401b-4e05-84a2-5c6592630415 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:40.389690 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe11907-e20f-421b-8f82-11d9276ab6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:40.390458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe11907-e20f-421b-8f82-11d9276ab6fc service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:40.390818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe11907-e20f-421b-8f82-11d9276ab6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:40.396320 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe11907-e20f-421b-8f82-11d9276ab6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:40.408040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe11907-e20f-421b-8f82-11d9276ab6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:40.418890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe11907-e20f-421b-8f82-11d9276ab6fc service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:40.433166 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1278/2562] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:40.765546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda666c-4d5e-4a25-a10c-645b56c4c91e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:40.767399 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bdda666c-4d5e-4a25-a10c-645b56c4c91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:40.797901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda666c-4d5e-4a25-a10c-645b56c4c91e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:40.812773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285ebf7-ee48-492a-8cff-623e889d569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:40.814078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285ebf7-ee48-492a-8cff-623e889d569a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:40.814376 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285ebf7-ee48-492a-8cff-623e889d569a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:40.814813 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285ebf7-ee48-492a-8cff-623e889d569a admin admin] PATH_INFO: `/v3/projects/0989300e82624c85bd4566af5cb2bab0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:40.816641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285ebf7-ee48-492a-8cff-623e889d569a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0989300e82624c85bd4566af5cb2bab0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:40.818852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285ebf7-ee48-492a-8cff-623e889d569a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:40.967649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0285ebf7-ee48-492a-8cff-623e889d569a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0989300e82624c85bd4566af5cb2bab0', 'request_id': 'req-0285ebf7-ee48-492a-8cff-623e889d569a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:40.974782 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0285ebf7-ee48-492a-8cff-623e889d569a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0989300e82624c85bd4566af5cb2bab0', 'request_id': 'req-0285ebf7-ee48-492a-8cff-623e889d569a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:40.992074 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0285ebf7-ee48-492a-8cff-623e889d569a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0989300e82624c85bd4566af5cb2bab0', 'request_id': 'req-0285ebf7-ee48-492a-8cff-623e889d569a'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:41.011272 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0285ebf7-ee48-492a-8cff-623e889d569a admin admin] The token cache is being invalidate because project 0989300e82624c85bd4566af5cb2bab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:17:41.011682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0285ebf7-ee48-492a-8cff-623e889d569a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:41.012375 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0285ebf7-ee48-492a-8cff-623e889d569a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:41.017255 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1285/2563] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:17:40 2022] DELETE /identity/v3/projects/0989300e82624c85bd4566af5cb2bab0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:41.018115 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe11907-e20f-421b-8f82-11d9276ab6fc service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:41.030740 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe11907-e20f-421b-8f82-11d9276ab6fc service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:41.146390 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad651a5-29fe-46ee-9d86-b7974f0ded1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:41.147385 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad651a5-29fe-46ee-9d86-b7974f0ded1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:41.148592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad651a5-29fe-46ee-9d86-b7974f0ded1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:41.148883 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad651a5-29fe-46ee-9d86-b7974f0ded1a admin admin] PATH_INFO: `/v3/users/834b26b50f50430fbbe1c3d503814f05` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:41.151824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad651a5-29fe-46ee-9d86-b7974f0ded1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=834b26b50f50430fbbe1c3d503814f05)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:41.153949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad651a5-29fe-46ee-9d86-b7974f0ded1a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:41.216765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2ad651a5-29fe-46ee-9d86-b7974f0ded1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '834b26b50f50430fbbe1c3d503814f05'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:41.217794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2ad651a5-29fe-46ee-9d86-b7974f0ded1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '834b26b50f50430fbbe1c3d503814f05'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:41.234136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2ad651a5-29fe-46ee-9d86-b7974f0ded1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '834b26b50f50430fbbe1c3d503814f05'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:41.243810 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2ad651a5-29fe-46ee-9d86-b7974f0ded1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '834b26b50f50430fbbe1c3d503814f05'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:41.245745 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2ad651a5-29fe-46ee-9d86-b7974f0ded1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '834b26b50f50430fbbe1c3d503814f05'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:41.258908 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1279/2564] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:17:41 2022] DELETE /identity/v3/users/834b26b50f50430fbbe1c3d503814f05 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:17:41.828199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285ebf7-ee48-492a-8cff-623e889d569a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:41.829911 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0285ebf7-ee48-492a-8cff-623e889d569a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:41.856336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285ebf7-ee48-492a-8cff-623e889d569a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:41.949849 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3245e6-10ff-4095-8514-9866948a1e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:41.951176 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3245e6-10ff-4095-8514-9866948a1e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:41.953879 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3245e6-10ff-4095-8514-9866948a1e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:41.954244 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3245e6-10ff-4095-8514-9866948a1e06 admin admin] PATH_INFO: `/v3/projects/1dbe04e997de4196866d2f9d5477adf4` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:41.955566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3245e6-10ff-4095-8514-9866948a1e06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dbe04e997de4196866d2f9d5477adf4)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:41.957570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3245e6-10ff-4095-8514-9866948a1e06 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:42.010684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4d3245e6-10ff-4095-8514-9866948a1e06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dbe04e997de4196866d2f9d5477adf4', 'request_id': 'req-4d3245e6-10ff-4095-8514-9866948a1e06'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:42.016892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4d3245e6-10ff-4095-8514-9866948a1e06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dbe04e997de4196866d2f9d5477adf4', 'request_id': 'req-4d3245e6-10ff-4095-8514-9866948a1e06'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:42.025219 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4d3245e6-10ff-4095-8514-9866948a1e06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dbe04e997de4196866d2f9d5477adf4', 'request_id': 'req-4d3245e6-10ff-4095-8514-9866948a1e06'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:42.037193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4d3245e6-10ff-4095-8514-9866948a1e06 admin admin] The token cache is being invalidate because project 1dbe04e997de4196866d2f9d5477adf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:17:42.037489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4d3245e6-10ff-4095-8514-9866948a1e06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:42.038142 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4d3245e6-10ff-4095-8514-9866948a1e06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:42.039974 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1286/2565] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:17:41 2022] DELETE /identity/v3/projects/1dbe04e997de4196866d2f9d5477adf4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:42.045355 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d202d-7efd-4ab0-aaaa-b8d862cf965d None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:42.045949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d202d-7efd-4ab0-aaaa-b8d862cf965d None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:42.045949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d202d-7efd-4ab0-aaaa-b8d862cf965d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:42.067291 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ef5d202d-7efd-4ab0-aaaa-b8d862cf965d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:42.068625 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ef5d202d-7efd-4ab0-aaaa-b8d862cf965d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:42.140978 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1280/2566] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:42.148446 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e072251-a75e-4628-8378-5e819066f4cd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:42.148736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e072251-a75e-4628-8378-5e819066f4cd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:42.149018 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e072251-a75e-4628-8378-5e819066f4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:42.174850 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5e072251-a75e-4628-8378-5e819066f4cd None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:42.176115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5e072251-a75e-4628-8378-5e819066f4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:42.184928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1287/2567] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:42.189311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d202d-7efd-4ab0-aaaa-b8d862cf965d None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:42.206004 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d202d-7efd-4ab0-aaaa-b8d862cf965d None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:42.210669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd41f8-aff0-4ba1-ab2a-ed0c1b6e16cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:42.211334 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd41f8-aff0-4ba1-ab2a-ed0c1b6e16cb admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:42.211638 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd41f8-aff0-4ba1-ab2a-ed0c1b6e16cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:42.211922 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd41f8-aff0-4ba1-ab2a-ed0c1b6e16cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:42.212752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd41f8-aff0-4ba1-ab2a-ed0c1b6e16cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:17:42.213130 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd41f8-aff0-4ba1-ab2a-ed0c1b6e16cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:42.215916 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd41f8-aff0-4ba1-ab2a-ed0c1b6e16cb admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:42.236714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1281/2568] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:17:42.241187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e072251-a75e-4628-8378-5e819066f4cd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:42.257840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e072251-a75e-4628-8378-5e819066f4cd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:42.272621 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824e213-e249-4d90-8b1e-a3535091cc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:42.273311 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824e213-e249-4d90-8b1e-a3535091cc92 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:42.273592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824e213-e249-4d90-8b1e-a3535091cc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:42.273863 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824e213-e249-4d90-8b1e-a3535091cc92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:42.274679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824e213-e249-4d90-8b1e-a3535091cc92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:42.277309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824e213-e249-4d90-8b1e-a3535091cc92 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:42.311641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1288/2569] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:17:42 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:42.315845 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd41f8-aff0-4ba1-ab2a-ed0c1b6e16cb admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:42.326935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd41f8-aff0-4ba1-ab2a-ed0c1b6e16cb admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:42.388303 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342fdb5-8789-4574-ae8b-5fbf056228be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:42.388976 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342fdb5-8789-4574-ae8b-5fbf056228be admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:42.389261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342fdb5-8789-4574-ae8b-5fbf056228be admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:42.389544 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342fdb5-8789-4574-ae8b-5fbf056228be admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:42.390248 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342fdb5-8789-4574-ae8b-5fbf056228be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:42.392191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342fdb5-8789-4574-ae8b-5fbf056228be admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:42.415650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1282/2570] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:17:42 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:42.418382 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824e213-e249-4d90-8b1e-a3535091cc92 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:42.428915 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824e213-e249-4d90-8b1e-a3535091cc92 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:42.435021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ba9a0-197f-4baa-9c57-de29ef49503d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:42.435738 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ba9a0-197f-4baa-9c57-de29ef49503d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:42.436024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ba9a0-197f-4baa-9c57-de29ef49503d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:42.436299 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ba9a0-197f-4baa-9c57-de29ef49503d admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:42.437088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ba9a0-197f-4baa-9c57-de29ef49503d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:42.438704 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ba9a0-197f-4baa-9c57-de29ef49503d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:42.450501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1289/2571] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:42.454739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342fdb5-8789-4574-ae8b-5fbf056228be admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:42.466060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342fdb5-8789-4574-ae8b-5fbf056228be admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:42.470637 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f4753-976b-4488-85c8-e41755ff4779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:42.471306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f4753-976b-4488-85c8-e41755ff4779 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:42.471590 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f4753-976b-4488-85c8-e41755ff4779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:42.472038 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f4753-976b-4488-85c8-e41755ff4779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:42.472773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f4753-976b-4488-85c8-e41755ff4779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:42.474365 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f4753-976b-4488-85c8-e41755ff4779 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:42.485620 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1283/2572] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:42.489856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ba9a0-197f-4baa-9c57-de29ef49503d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:42.500807 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ba9a0-197f-4baa-9c57-de29ef49503d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:42.505488 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2151f-56e5-4a54-b579-3564a4b42fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:42.506374 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2151f-56e5-4a54-b579-3564a4b42fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:42.506658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2151f-56e5-4a54-b579-3564a4b42fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:42.506936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2151f-56e5-4a54-b579-3564a4b42fb4 admin admin] PATH_INFO: `/v3/projects/be5fa842e29944f5957064f633e275ad/users/5f670681f05045a9bedda88d89df815c/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:42.522752 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2151f-56e5-4a54-b579-3564a4b42fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be5fa842e29944f5957064f633e275ad, user_id=5f670681f05045a9bedda88d89df815c, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:42.525549 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2151f-56e5-4a54-b579-3564a4b42fb4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:42.541237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1290/2573] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:42 2022] PUT /identity/v3/projects/be5fa842e29944f5957064f633e275ad/users/5f670681f05045a9bedda88d89df815c/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:17:42.546363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10855-2b69-4073-b800-edb10264c016 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:42.546661 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10855-2b69-4073-b800-edb10264c016 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:42.546941 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10855-2b69-4073-b800-edb10264c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:42.566089 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-84f10855-2b69-4073-b800-edb10264c016 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:42.567459 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-84f10855-2b69-4073-b800-edb10264c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:42.630402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1284/2574] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:42.639693 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2151f-56e5-4a54-b579-3564a4b42fb4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:42.641662 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1ae2151f-56e5-4a54-b579-3564a4b42fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:42.711234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2151f-56e5-4a54-b579-3564a4b42fb4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:42.716132 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc07ce6-d3d6-47a9-9bbb-ee0414ed3c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:42.716743 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc07ce6-d3d6-47a9-9bbb-ee0414ed3c24 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:42.717152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc07ce6-d3d6-47a9-9bbb-ee0414ed3c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:42.717432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc07ce6-d3d6-47a9-9bbb-ee0414ed3c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:42.743856 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc07ce6-d3d6-47a9-9bbb-ee0414ed3c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:42.745822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc07ce6-d3d6-47a9-9bbb-ee0414ed3c24 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:42.772611 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1291/2575] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:44.167462 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9533a-e3c8-4df3-8677-b40b85d0b0c8 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:44.170017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9533a-e3c8-4df3-8677-b40b85d0b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:44.170017 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9533a-e3c8-4df3-8677-b40b85d0b0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:44.214775 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-1ca9533a-e3c8-4df3-8677-b40b85d0b0c8 None None] MFA Rules not processed for user `5f670681f05045a9bedda88d89df815c`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:44.216327 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1ca9533a-e3c8-4df3-8677-b40b85d0b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:44.331358 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1285/2576] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:44.335581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc07ce6-d3d6-47a9-9bbb-ee0414ed3c24 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:44.349280 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc07ce6-d3d6-47a9-9bbb-ee0414ed3c24 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:44.368875 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af60cd3-34b6-4c50-a55e-8e6d4dd82ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:44.369649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af60cd3-34b6-4c50-a55e-8e6d4dd82ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:44.370021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af60cd3-34b6-4c50-a55e-8e6d4dd82ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:44.370649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af60cd3-34b6-4c50-a55e-8e6d4dd82ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:44.371372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af60cd3-34b6-4c50-a55e-8e6d4dd82ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:44.379735 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af60cd3-34b6-4c50-a55e-8e6d4dd82ce9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:44.435801 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1292/2577] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:17:44 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:17:44.439308 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9533a-e3c8-4df3-8677-b40b85d0b0c8 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:44.456967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9533a-e3c8-4df3-8677-b40b85d0b0c8 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:44.527531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a355c5-da71-4ebc-8b00-61dd1cca12cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:44.528937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a355c5-da71-4ebc-8b00-61dd1cca12cd admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:44.529226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a355c5-da71-4ebc-8b00-61dd1cca12cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:44.530154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a355c5-da71-4ebc-8b00-61dd1cca12cd admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:44.530864 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a355c5-da71-4ebc-8b00-61dd1cca12cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:44.532866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a355c5-da71-4ebc-8b00-61dd1cca12cd admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:44.554561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1286/2578] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:17:44 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:44.559133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af60cd3-34b6-4c50-a55e-8e6d4dd82ce9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:44.571235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af60cd3-34b6-4c50-a55e-8e6d4dd82ce9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:44.584076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62541ec-c702-45a4-a252-3f2ffd6b70df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:44.584860 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62541ec-c702-45a4-a252-3f2ffd6b70df admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:44.585222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62541ec-c702-45a4-a252-3f2ffd6b70df admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:44.585634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62541ec-c702-45a4-a252-3f2ffd6b70df admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:44.586454 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62541ec-c702-45a4-a252-3f2ffd6b70df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:44.588872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62541ec-c702-45a4-a252-3f2ffd6b70df admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:44.600988 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1293/2579] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:44.606119 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a355c5-da71-4ebc-8b00-61dd1cca12cd admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:44.626343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a355c5-da71-4ebc-8b00-61dd1cca12cd admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:44.638455 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b619463-7f6e-4066-8038-d3024de4eda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:44.639930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b619463-7f6e-4066-8038-d3024de4eda6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:44.640517 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b619463-7f6e-4066-8038-d3024de4eda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:44.642102 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b619463-7f6e-4066-8038-d3024de4eda6 admin admin] PATH_INFO: `/v3/projects/83ac822d13d44babadfa7d4791a4f5d1/users/23108d254bc54be88a29d7f9f032ca6f/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:44.663366 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b619463-7f6e-4066-8038-d3024de4eda6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ac822d13d44babadfa7d4791a4f5d1, user_id=23108d254bc54be88a29d7f9f032ca6f, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:44.666293 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b619463-7f6e-4066-8038-d3024de4eda6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:44.685260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1287/2580] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:44 2022] PUT /identity/v3/projects/83ac822d13d44babadfa7d4791a4f5d1/users/23108d254bc54be88a29d7f9f032ca6f/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:44.689756 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62541ec-c702-45a4-a252-3f2ffd6b70df admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:44.711335 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62541ec-c702-45a4-a252-3f2ffd6b70df admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:44.843685 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d5ba7-c966-44e1-b10a-0c2d190d05a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:44.844364 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d5ba7-c966-44e1-b10a-0c2d190d05a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:44.844650 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d5ba7-c966-44e1-b10a-0c2d190d05a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:44.844920 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d5ba7-c966-44e1-b10a-0c2d190d05a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:44.845688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d5ba7-c966-44e1-b10a-0c2d190d05a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:44.847243 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d5ba7-c966-44e1-b10a-0c2d190d05a0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:44.862556 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1294/2581] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:17:44.863871 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b619463-7f6e-4066-8038-d3024de4eda6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:44.874844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b619463-7f6e-4066-8038-d3024de4eda6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:44.879592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8986e7-80bc-4ec9-b3b2-f9ae0a21f18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:44.880539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8986e7-80bc-4ec9-b3b2-f9ae0a21f18d admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:44.880814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8986e7-80bc-4ec9-b3b2-f9ae0a21f18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:44.881082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8986e7-80bc-4ec9-b3b2-f9ae0a21f18d admin admin] PATH_INFO: `/v3/projects/83ac822d13d44babadfa7d4791a4f5d1/users/23108d254bc54be88a29d7f9f032ca6f/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:44.883229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8986e7-80bc-4ec9-b3b2-f9ae0a21f18d admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ac822d13d44babadfa7d4791a4f5d1, user_id=23108d254bc54be88a29d7f9f032ca6f, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:44.886552 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8986e7-80bc-4ec9-b3b2-f9ae0a21f18d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:44.897476 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1288/2582] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:44 2022] PUT /identity/v3/projects/83ac822d13d44babadfa7d4791a4f5d1/users/23108d254bc54be88a29d7f9f032ca6f/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:45.842455 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1411e04-7649-4a27-8b3f-e2ad2c17d9ae None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:45.843229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1411e04-7649-4a27-8b3f-e2ad2c17d9ae None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:45.843229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1411e04-7649-4a27-8b3f-e2ad2c17d9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:45.892900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e1411e04-7649-4a27-8b3f-e2ad2c17d9ae None None] MFA Rules not processed for user `23108d254bc54be88a29d7f9f032ca6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:45.894222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e1411e04-7649-4a27-8b3f-e2ad2c17d9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:46.005546 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1295/2583] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:46.017696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8986e7-80bc-4ec9-b3b2-f9ae0a21f18d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:46.019527 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ef8986e7-80bc-4ec9-b3b2-f9ae0a21f18d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:46.110496 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8986e7-80bc-4ec9-b3b2-f9ae0a21f18d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:46.114187 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab698d-4fa1-4bf5-80f1-328242c784ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:46.114824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab698d-4fa1-4bf5-80f1-328242c784ed service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:46.115101 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab698d-4fa1-4bf5-80f1-328242c784ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:46.115526 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab698d-4fa1-4bf5-80f1-328242c784ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:46.174993 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab698d-4fa1-4bf5-80f1-328242c784ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:46.176463 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab698d-4fa1-4bf5-80f1-328242c784ed service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:46.189771 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1289/2584] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:47.578498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1411e04-7649-4a27-8b3f-e2ad2c17d9ae None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:47.580090 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e1411e04-7649-4a27-8b3f-e2ad2c17d9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:47.594055 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1411e04-7649-4a27-8b3f-e2ad2c17d9ae None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:47.597717 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c8799-aa88-4d83-bdd5-be62859182ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:47.598376 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c8799-aa88-4d83-bdd5-be62859182ed service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:47.598657 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c8799-aa88-4d83-bdd5-be62859182ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:47.598930 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c8799-aa88-4d83-bdd5-be62859182ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:47.609686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c8799-aa88-4d83-bdd5-be62859182ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:47.611014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c8799-aa88-4d83-bdd5-be62859182ed service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:47.623763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1296/2585] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:50.783242 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab698d-4fa1-4bf5-80f1-328242c784ed service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:50.843151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab698d-4fa1-4bf5-80f1-328242c784ed service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:50.846882 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bf38e-2ea4-4988-8164-4ddf047503ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:50.847544 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf38e-2ea4-4988-8164-4ddf047503ab service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:50.847875 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf38e-2ea4-4988-8164-4ddf047503ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:50.848343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf38e-2ea4-4988-8164-4ddf047503ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:50.850192 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-102bf38e-2ea4-4988-8164-4ddf047503ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:50.920159 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bf38e-2ea4-4988-8164-4ddf047503ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:50.921925 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bf38e-2ea4-4988-8164-4ddf047503ab service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:50.933374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1290/2586] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:55.584592 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c8799-aa88-4d83-bdd5-be62859182ed service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:55.585965 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-883c8799-aa88-4d83-bdd5-be62859182ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:55.604883 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c8799-aa88-4d83-bdd5-be62859182ed service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:55.615479 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19431e97-39df-40eb-b82b-cc5d52cdb333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:55.617720 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19431e97-39df-40eb-b82b-cc5d52cdb333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:55.618079 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19431e97-39df-40eb-b82b-cc5d52cdb333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:55.620842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19431e97-39df-40eb-b82b-cc5d52cdb333 admin admin] PATH_INFO: `/v3/users/86a0b6c88fe84ba0907d515fd9f38e72` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:55.622238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19431e97-39df-40eb-b82b-cc5d52cdb333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a0b6c88fe84ba0907d515fd9f38e72)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:55.624257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19431e97-39df-40eb-b82b-cc5d52cdb333 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:55.687895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-19431e97-39df-40eb-b82b-cc5d52cdb333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a0b6c88fe84ba0907d515fd9f38e72'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:55.704206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-19431e97-39df-40eb-b82b-cc5d52cdb333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a0b6c88fe84ba0907d515fd9f38e72'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:55.714265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-19431e97-39df-40eb-b82b-cc5d52cdb333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a0b6c88fe84ba0907d515fd9f38e72'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:55.715112 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-19431e97-39df-40eb-b82b-cc5d52cdb333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a0b6c88fe84ba0907d515fd9f38e72'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:55.715663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-19431e97-39df-40eb-b82b-cc5d52cdb333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a0b6c88fe84ba0907d515fd9f38e72'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:55.734070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1297/2587] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:17:55 2022] DELETE /identity/v3/users/86a0b6c88fe84ba0907d515fd9f38e72 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:55.949997 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bf38e-2ea4-4988-8164-4ddf047503ab service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:55.960474 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bf38e-2ea4-4988-8164-4ddf047503ab service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:56.032150 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d99241-789f-46bd-9cb7-21b8923d9e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:56.033191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d99241-789f-46bd-9cb7-21b8923d9e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:56.033520 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d99241-789f-46bd-9cb7-21b8923d9e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:56.033760 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d99241-789f-46bd-9cb7-21b8923d9e40 admin admin] PATH_INFO: `/v3/projects/9d587d1ef11b4055b77055e6fbcc1899` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:56.035083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d99241-789f-46bd-9cb7-21b8923d9e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d587d1ef11b4055b77055e6fbcc1899)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:56.037287 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d99241-789f-46bd-9cb7-21b8923d9e40 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:56.085700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b3d99241-789f-46bd-9cb7-21b8923d9e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d587d1ef11b4055b77055e6fbcc1899', 'request_id': 'req-b3d99241-789f-46bd-9cb7-21b8923d9e40'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:56.091876 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b3d99241-789f-46bd-9cb7-21b8923d9e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d587d1ef11b4055b77055e6fbcc1899', 'request_id': 'req-b3d99241-789f-46bd-9cb7-21b8923d9e40'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:56.098933 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b3d99241-789f-46bd-9cb7-21b8923d9e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d587d1ef11b4055b77055e6fbcc1899', 'request_id': 'req-b3d99241-789f-46bd-9cb7-21b8923d9e40'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:56.110556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b3d99241-789f-46bd-9cb7-21b8923d9e40 admin admin] The token cache is being invalidate because project 9d587d1ef11b4055b77055e6fbcc1899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:17:56.110842 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b3d99241-789f-46bd-9cb7-21b8923d9e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:56.111484 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b3d99241-789f-46bd-9cb7-21b8923d9e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:56.113043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1291/2588] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:17:55 2022] DELETE /identity/v3/projects/9d587d1ef11b4055b77055e6fbcc1899 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:56.118027 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3573a9-54c3-43b8-a0cc-06ed50bcd7b8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:56.118315 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3573a9-54c3-43b8-a0cc-06ed50bcd7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:56.118752 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3573a9-54c3-43b8-a0cc-06ed50bcd7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:56.137511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ed3573a9-54c3-43b8-a0cc-06ed50bcd7b8 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:56.138690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ed3573a9-54c3-43b8-a0cc-06ed50bcd7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:56.195387 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1298/2589] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:56.204233 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8a410-3a42-49e5-9945-799a845f4125 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:56.204531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8a410-3a42-49e5-9945-799a845f4125 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:56.204795 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8a410-3a42-49e5-9945-799a845f4125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:56.223156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-59f8a410-3a42-49e5-9945-799a845f4125 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:56.224364 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-59f8a410-3a42-49e5-9945-799a845f4125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:56.232362 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1292/2590] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:56.236411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3573a9-54c3-43b8-a0cc-06ed50bcd7b8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:56.245794 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3573a9-54c3-43b8-a0cc-06ed50bcd7b8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:56.250320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fa05f-6ca5-40b5-829c-161469533512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:56.250962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fa05f-6ca5-40b5-829c-161469533512 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:56.251237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fa05f-6ca5-40b5-829c-161469533512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:56.251533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fa05f-6ca5-40b5-829c-161469533512 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:56.252313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fa05f-6ca5-40b5-829c-161469533512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:17:56.252612 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fa05f-6ca5-40b5-829c-161469533512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:56.254306 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fa05f-6ca5-40b5-829c-161469533512 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:56.266197 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1299/2591] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:17:56.270145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8a410-3a42-49e5-9945-799a845f4125 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:56.280110 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8a410-3a42-49e5-9945-799a845f4125 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:56.284813 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ddfc7-7664-43f2-85ed-276ac67a4518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:56.285451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ddfc7-7664-43f2-85ed-276ac67a4518 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:56.285734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ddfc7-7664-43f2-85ed-276ac67a4518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:56.286010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ddfc7-7664-43f2-85ed-276ac67a4518 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:56.286727 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ddfc7-7664-43f2-85ed-276ac67a4518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:56.288686 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ddfc7-7664-43f2-85ed-276ac67a4518 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:56.313897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1293/2592] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:17:56 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:17:56.318002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fa05f-6ca5-40b5-829c-161469533512 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:56.328211 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fa05f-6ca5-40b5-829c-161469533512 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:56.390323 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f64b41-eb98-4bc8-b345-caf2a955d50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:56.390990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f64b41-eb98-4bc8-b345-caf2a955d50f admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:56.391267 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f64b41-eb98-4bc8-b345-caf2a955d50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:56.391540 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f64b41-eb98-4bc8-b345-caf2a955d50f admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:56.392245 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f64b41-eb98-4bc8-b345-caf2a955d50f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:56.394319 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f64b41-eb98-4bc8-b345-caf2a955d50f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:56.414191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1300/2593] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:17:56 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:56.418349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ddfc7-7664-43f2-85ed-276ac67a4518 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:56.429348 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ddfc7-7664-43f2-85ed-276ac67a4518 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:56.434563 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54803e9c-8059-4824-952b-d83ffd0f5599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:56.435226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54803e9c-8059-4824-952b-d83ffd0f5599 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:56.435509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54803e9c-8059-4824-952b-d83ffd0f5599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:56.435836 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54803e9c-8059-4824-952b-d83ffd0f5599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:56.436558 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54803e9c-8059-4824-952b-d83ffd0f5599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:56.438134 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54803e9c-8059-4824-952b-d83ffd0f5599 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:56.449232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1294/2594] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:56.453308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f64b41-eb98-4bc8-b345-caf2a955d50f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:56.463943 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f64b41-eb98-4bc8-b345-caf2a955d50f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:56.468871 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efd4af-fbc7-4091-886a-d4d08accd7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:56.469531 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efd4af-fbc7-4091-886a-d4d08accd7dd admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:56.469815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efd4af-fbc7-4091-886a-d4d08accd7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:56.470100 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efd4af-fbc7-4091-886a-d4d08accd7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:56.470806 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efd4af-fbc7-4091-886a-d4d08accd7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:56.472445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efd4af-fbc7-4091-886a-d4d08accd7dd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:56.482233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1301/2595] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:56.486309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54803e9c-8059-4824-952b-d83ffd0f5599 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:56.496653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54803e9c-8059-4824-952b-d83ffd0f5599 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:56.501193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf25dfd-679b-410c-99a8-d801073bb2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:56.502053 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf25dfd-679b-410c-99a8-d801073bb2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:56.502331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf25dfd-679b-410c-99a8-d801073bb2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:56.502629 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf25dfd-679b-410c-99a8-d801073bb2c5 admin admin] PATH_INFO: `/v3/projects/d78c54bc651a4a14a7c5655faead2b81/users/c14529a8d7fe4f0598793d9218090efc/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:56.517262 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf25dfd-679b-410c-99a8-d801073bb2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d78c54bc651a4a14a7c5655faead2b81, user_id=c14529a8d7fe4f0598793d9218090efc, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:56.519951 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf25dfd-679b-410c-99a8-d801073bb2c5 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:56.533109 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1295/2596] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:56 2022] PUT /identity/v3/projects/d78c54bc651a4a14a7c5655faead2b81/users/c14529a8d7fe4f0598793d9218090efc/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:17:56.544018 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9473-5ef1-45bc-9af8-58299711d7cd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:56.544335 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9473-5ef1-45bc-9af8-58299711d7cd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:56.544619 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9473-5ef1-45bc-9af8-58299711d7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:56.572996 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b8ce9473-5ef1-45bc-9af8-58299711d7cd None None] MFA Rules not processed for user `c14529a8d7fe4f0598793d9218090efc`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:56.574438 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b8ce9473-5ef1-45bc-9af8-58299711d7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:56.635031 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1302/2597] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:56.639424 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf25dfd-679b-410c-99a8-d801073bb2c5 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:56.698266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf25dfd-679b-410c-99a8-d801073bb2c5 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:56.703032 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758e280-3711-4c7d-8294-6794c9477b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:56.703708 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758e280-3711-4c7d-8294-6794c9477b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:56.703995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758e280-3711-4c7d-8294-6794c9477b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:56.704277 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758e280-3711-4c7d-8294-6794c9477b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:56.704971 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758e280-3711-4c7d-8294-6794c9477b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:56.706864 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758e280-3711-4c7d-8294-6794c9477b8c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:56.734880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1296/2598] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:17:56 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:56.736098 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce9473-5ef1-45bc-9af8-58299711d7cd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:56.747244 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce9473-5ef1-45bc-9af8-58299711d7cd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:56.810185 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc2d1f-3e2c-48c5-9822-ca38b5bdd729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:56.810783 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc2d1f-3e2c-48c5-9822-ca38b5bdd729 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:56.811063 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc2d1f-3e2c-48c5-9822-ca38b5bdd729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:56.811333 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc2d1f-3e2c-48c5-9822-ca38b5bdd729 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:56.812061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc2d1f-3e2c-48c5-9822-ca38b5bdd729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:56.814018 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc2d1f-3e2c-48c5-9822-ca38b5bdd729 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:56.852086 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1303/2599] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:17:56 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:56.856311 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758e280-3711-4c7d-8294-6794c9477b8c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:56.871750 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758e280-3711-4c7d-8294-6794c9477b8c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:56.889736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c7bec-0acf-418a-8329-3dd31d57d162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:56.890747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c7bec-0acf-418a-8329-3dd31d57d162 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:56.891244 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c7bec-0acf-418a-8329-3dd31d57d162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:56.891831 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c7bec-0acf-418a-8329-3dd31d57d162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:56.893229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c7bec-0acf-418a-8329-3dd31d57d162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:56.895036 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c7bec-0acf-418a-8329-3dd31d57d162 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:56.914037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1297/2600] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:56.918647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc2d1f-3e2c-48c5-9822-ca38b5bdd729 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:56.933662 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc2d1f-3e2c-48c5-9822-ca38b5bdd729 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:56.939618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54431fd-c63a-437b-b0da-87dda8218f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:56.940532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54431fd-c63a-437b-b0da-87dda8218f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:56.940816 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54431fd-c63a-437b-b0da-87dda8218f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:56.941091 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54431fd-c63a-437b-b0da-87dda8218f22 admin admin] PATH_INFO: `/v3/projects/3400e9c356594af5a99c911b879d300b/users/fd24d5768ac143789a635cbc48005b13/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:56.960264 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54431fd-c63a-437b-b0da-87dda8218f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3400e9c356594af5a99c911b879d300b, user_id=fd24d5768ac143789a635cbc48005b13, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:56.963392 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54431fd-c63a-437b-b0da-87dda8218f22 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:56.979482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1304/2601] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:56 2022] PUT /identity/v3/projects/3400e9c356594af5a99c911b879d300b/users/fd24d5768ac143789a635cbc48005b13/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:17:56.983757 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c7bec-0acf-418a-8329-3dd31d57d162 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:56.995626 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c7bec-0acf-418a-8329-3dd31d57d162 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:57.079342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecfcfe-c6da-4c13-a0ce-606aabd211e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:57.080280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecfcfe-c6da-4c13-a0ce-606aabd211e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:57.080670 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecfcfe-c6da-4c13-a0ce-606aabd211e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:57.081064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecfcfe-c6da-4c13-a0ce-606aabd211e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:57.081999 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecfcfe-c6da-4c13-a0ce-606aabd211e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:57.096286 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecfcfe-c6da-4c13-a0ce-606aabd211e0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:57.113161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1298/2602] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:57.117333 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54431fd-c63a-437b-b0da-87dda8218f22 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:57.137418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54431fd-c63a-437b-b0da-87dda8218f22 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:57.147489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86ae05-375a-4c49-a65b-598dbcd4ac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:57.148586 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86ae05-375a-4c49-a65b-598dbcd4ac09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:57.148873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86ae05-375a-4c49-a65b-598dbcd4ac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:57.149152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86ae05-375a-4c49-a65b-598dbcd4ac09 admin admin] PATH_INFO: `/v3/projects/3400e9c356594af5a99c911b879d300b/users/fd24d5768ac143789a635cbc48005b13/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:57.152828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86ae05-375a-4c49-a65b-598dbcd4ac09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3400e9c356594af5a99c911b879d300b, user_id=fd24d5768ac143789a635cbc48005b13, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:57.155940 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86ae05-375a-4c49-a65b-598dbcd4ac09 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:57.187204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1305/2603] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:57 2022] PUT /identity/v3/projects/3400e9c356594af5a99c911b879d300b/users/fd24d5768ac143789a635cbc48005b13/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:57.200380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804f816-3dfd-4e52-a84e-70e89d902856 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:57.200754 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804f816-3dfd-4e52-a84e-70e89d902856 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:57.201378 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804f816-3dfd-4e52-a84e-70e89d902856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:57.232361 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c804f816-3dfd-4e52-a84e-70e89d902856 None None] MFA Rules not processed for user `fd24d5768ac143789a635cbc48005b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:57.233650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c804f816-3dfd-4e52-a84e-70e89d902856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:57.302766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1299/2604] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:57.314669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86ae05-375a-4c49-a65b-598dbcd4ac09 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:57.316437 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3e86ae05-375a-4c49-a65b-598dbcd4ac09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:57.374978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86ae05-375a-4c49-a65b-598dbcd4ac09 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:57.378600 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0d300-6a53-4d43-81a5-b4bf84a7caae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:57.379242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d300-6a53-4d43-81a5-b4bf84a7caae service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:57.379522 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d300-6a53-4d43-81a5-b4bf84a7caae service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:57.379826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d300-6a53-4d43-81a5-b4bf84a7caae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:57.389396 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0d300-6a53-4d43-81a5-b4bf84a7caae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:57.390882 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0d300-6a53-4d43-81a5-b4bf84a7caae service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:57.400468 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1306/2605] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:57.762052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804f816-3dfd-4e52-a84e-70e89d902856 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:57.820584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804f816-3dfd-4e52-a84e-70e89d902856 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:57.825158 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394299a-7881-45e6-bf7f-dc278bb14d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:57.826015 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394299a-7881-45e6-bf7f-dc278bb14d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:57.826290 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394299a-7881-45e6-bf7f-dc278bb14d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:57.826558 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394299a-7881-45e6-bf7f-dc278bb14d45 admin admin] PATH_INFO: `/v3/users/c14529a8d7fe4f0598793d9218090efc` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:57.827749 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394299a-7881-45e6-bf7f-dc278bb14d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14529a8d7fe4f0598793d9218090efc)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:57.829653 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394299a-7881-45e6-bf7f-dc278bb14d45 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:57.874552 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d394299a-7881-45e6-bf7f-dc278bb14d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14529a8d7fe4f0598793d9218090efc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:57.875200 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d394299a-7881-45e6-bf7f-dc278bb14d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14529a8d7fe4f0598793d9218090efc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:57.886328 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d394299a-7881-45e6-bf7f-dc278bb14d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14529a8d7fe4f0598793d9218090efc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:57.892885 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d394299a-7881-45e6-bf7f-dc278bb14d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14529a8d7fe4f0598793d9218090efc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:57.893575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-d394299a-7881-45e6-bf7f-dc278bb14d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14529a8d7fe4f0598793d9218090efc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:57.905870 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1300/2606] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:17:57 2022] DELETE /identity/v3/users/c14529a8d7fe4f0598793d9218090efc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:57.910386 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b2587-8b7c-49ff-849a-f5ddf3136759 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:57.910851 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b2587-8b7c-49ff-849a-f5ddf3136759 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:57.910947 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b2587-8b7c-49ff-849a-f5ddf3136759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:57.928188 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0d5b2587-8b7c-49ff-849a-f5ddf3136759 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:57.929354 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0d5b2587-8b7c-49ff-849a-f5ddf3136759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:57.985973 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1307/2607] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:57.996115 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394299a-7881-45e6-bf7f-dc278bb14d45 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:57.997614 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d394299a-7881-45e6-bf7f-dc278bb14d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:58.054800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394299a-7881-45e6-bf7f-dc278bb14d45 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:58.058557 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3a103-e87a-4cb2-821d-3661784b0c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:58.059203 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3a103-e87a-4cb2-821d-3661784b0c50 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:58.059488 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3a103-e87a-4cb2-821d-3661784b0c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:58.059805 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3a103-e87a-4cb2-821d-3661784b0c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:58.075155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3a103-e87a-4cb2-821d-3661784b0c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:58.075155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3a103-e87a-4cb2-821d-3661784b0c50 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:58.080436 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1301/2608] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:17:58.452120 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b2587-8b7c-49ff-849a-f5ddf3136759 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:58.454223 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0d5b2587-8b7c-49ff-849a-f5ddf3136759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:58.472608 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b2587-8b7c-49ff-849a-f5ddf3136759 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:58.480682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef115c-3a37-4557-a383-7b755faeece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:58.481668 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef115c-3a37-4557-a383-7b755faeece3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:58.482053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef115c-3a37-4557-a383-7b755faeece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:58.482417 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef115c-3a37-4557-a383-7b755faeece3 admin admin] PATH_INFO: `/v3/projects/d78c54bc651a4a14a7c5655faead2b81` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:58.483951 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef115c-3a37-4557-a383-7b755faeece3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d78c54bc651a4a14a7c5655faead2b81)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:58.486328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef115c-3a37-4557-a383-7b755faeece3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:58.544454 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ebef115c-3a37-4557-a383-7b755faeece3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd78c54bc651a4a14a7c5655faead2b81', 'request_id': 'req-ebef115c-3a37-4557-a383-7b755faeece3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:58.550477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ebef115c-3a37-4557-a383-7b755faeece3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd78c54bc651a4a14a7c5655faead2b81', 'request_id': 'req-ebef115c-3a37-4557-a383-7b755faeece3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:58.563953 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ebef115c-3a37-4557-a383-7b755faeece3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd78c54bc651a4a14a7c5655faead2b81', 'request_id': 'req-ebef115c-3a37-4557-a383-7b755faeece3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:58.575920 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ebef115c-3a37-4557-a383-7b755faeece3 admin admin] The token cache is being invalidate because project d78c54bc651a4a14a7c5655faead2b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:17:58.576298 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ebef115c-3a37-4557-a383-7b755faeece3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:58.577021 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ebef115c-3a37-4557-a383-7b755faeece3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:58.578902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1308/2609] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:17:58 2022] DELETE /identity/v3/projects/d78c54bc651a4a14a7c5655faead2b81 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:58.582658 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3a103-e87a-4cb2-821d-3661784b0c50 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:58.592810 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3a103-e87a-4cb2-821d-3661784b0c50 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:58.674797 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b25e0-6cd5-4c62-b834-d6e88c44e235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:58.675707 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b25e0-6cd5-4c62-b834-d6e88c44e235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:58.676012 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b25e0-6cd5-4c62-b834-d6e88c44e235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:58.676288 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b25e0-6cd5-4c62-b834-d6e88c44e235 admin admin] PATH_INFO: `/v3/users/fd24d5768ac143789a635cbc48005b13` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:58.684482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b25e0-6cd5-4c62-b834-d6e88c44e235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd24d5768ac143789a635cbc48005b13)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:58.686421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b25e0-6cd5-4c62-b834-d6e88c44e235 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:58.741610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1a7b25e0-6cd5-4c62-b834-d6e88c44e235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd24d5768ac143789a635cbc48005b13'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:58.742350 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1a7b25e0-6cd5-4c62-b834-d6e88c44e235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd24d5768ac143789a635cbc48005b13'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:58.755037 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1a7b25e0-6cd5-4c62-b834-d6e88c44e235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd24d5768ac143789a635cbc48005b13'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:58.762250 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1a7b25e0-6cd5-4c62-b834-d6e88c44e235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd24d5768ac143789a635cbc48005b13'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:58.763077 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1a7b25e0-6cd5-4c62-b834-d6e88c44e235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd24d5768ac143789a635cbc48005b13'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:58.779106 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1302/2610] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:17:58 2022] DELETE /identity/v3/users/fd24d5768ac143789a635cbc48005b13 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:17:59.064813 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef115c-3a37-4557-a383-7b755faeece3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:59.066336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ebef115c-3a37-4557-a383-7b755faeece3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:59.086286 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef115c-3a37-4557-a383-7b755faeece3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:59.143320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602625c-5d67-4a62-bf8c-ffb1e55caef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:59.144217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602625c-5d67-4a62-bf8c-ffb1e55caef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:59.144517 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602625c-5d67-4a62-bf8c-ffb1e55caef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:59.144815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602625c-5d67-4a62-bf8c-ffb1e55caef7 admin admin] PATH_INFO: `/v3/projects/3400e9c356594af5a99c911b879d300b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:59.146002 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602625c-5d67-4a62-bf8c-ffb1e55caef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3400e9c356594af5a99c911b879d300b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:59.147959 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602625c-5d67-4a62-bf8c-ffb1e55caef7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:59.194566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c602625c-5d67-4a62-bf8c-ffb1e55caef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3400e9c356594af5a99c911b879d300b', 'request_id': 'req-c602625c-5d67-4a62-bf8c-ffb1e55caef7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:59.200498 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c602625c-5d67-4a62-bf8c-ffb1e55caef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3400e9c356594af5a99c911b879d300b', 'request_id': 'req-c602625c-5d67-4a62-bf8c-ffb1e55caef7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:59.207747 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c602625c-5d67-4a62-bf8c-ffb1e55caef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3400e9c356594af5a99c911b879d300b', 'request_id': 'req-c602625c-5d67-4a62-bf8c-ffb1e55caef7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:59.219178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c602625c-5d67-4a62-bf8c-ffb1e55caef7 admin admin] The token cache is being invalidate because project 3400e9c356594af5a99c911b879d300b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:17:59.219462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c602625c-5d67-4a62-bf8c-ffb1e55caef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:59.220154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c602625c-5d67-4a62-bf8c-ffb1e55caef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:17:59.221726 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1309/2611] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:17:59 2022] DELETE /identity/v3/projects/3400e9c356594af5a99c911b879d300b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:59.228904 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb0d7d-2fe1-4e26-bf2a-3677e9546c90 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:59.229442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb0d7d-2fe1-4e26-bf2a-3677e9546c90 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:59.229442 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb0d7d-2fe1-4e26-bf2a-3677e9546c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:59.248754 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-96fb0d7d-2fe1-4e26-bf2a-3677e9546c90 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:59.250085 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-96fb0d7d-2fe1-4e26-bf2a-3677e9546c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:59.311705 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1303/2612] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:59.319276 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70c824-addb-4e68-97a8-c2ba46794979 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:59.319574 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70c824-addb-4e68-97a8-c2ba46794979 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:59.319896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70c824-addb-4e68-97a8-c2ba46794979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:59.343361 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4b70c824-addb-4e68-97a8-c2ba46794979 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:59.344906 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4b70c824-addb-4e68-97a8-c2ba46794979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:59.355159 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1310/2613] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:59.359399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb0d7d-2fe1-4e26-bf2a-3677e9546c90 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:59.369445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb0d7d-2fe1-4e26-bf2a-3677e9546c90 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:59.375332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea977cfa-f4a5-4759-a5ae-8859277c695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:59.376523 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea977cfa-f4a5-4759-a5ae-8859277c695e admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:59.377027 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea977cfa-f4a5-4759-a5ae-8859277c695e admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:59.377489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea977cfa-f4a5-4759-a5ae-8859277c695e admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:59.378508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea977cfa-f4a5-4759-a5ae-8859277c695e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:17:59.379042 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea977cfa-f4a5-4759-a5ae-8859277c695e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:59.381115 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea977cfa-f4a5-4759-a5ae-8859277c695e admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:59.396142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1304/2614] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:17:59.402199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70c824-addb-4e68-97a8-c2ba46794979 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:59.412016 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70c824-addb-4e68-97a8-c2ba46794979 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:59.419459 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3312dce-61fc-4efb-94f6-038ffa4381c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:59.420427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3312dce-61fc-4efb-94f6-038ffa4381c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:59.421007 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3312dce-61fc-4efb-94f6-038ffa4381c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:59.421501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3312dce-61fc-4efb-94f6-038ffa4381c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:59.422295 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3312dce-61fc-4efb-94f6-038ffa4381c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:59.429831 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3312dce-61fc-4efb-94f6-038ffa4381c5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:59.436593 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea977cfa-f4a5-4759-a5ae-8859277c695e admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:59.438266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ea977cfa-f4a5-4759-a5ae-8859277c695e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:59.464222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1311/2615] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:17:59 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:59.465361 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3312dce-61fc-4efb-94f6-038ffa4381c5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:59.502740 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea977cfa-f4a5-4759-a5ae-8859277c695e admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:59.526788 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3312dce-61fc-4efb-94f6-038ffa4381c5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:59.531625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036c47-3631-4cc6-97aa-c1762c98a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:59.532399 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036c47-3631-4cc6-97aa-c1762c98a4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:59.532750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036c47-3631-4cc6-97aa-c1762c98a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:59.533090 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036c47-3631-4cc6-97aa-c1762c98a4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:59.533778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2036c47-3631-4cc6-97aa-c1762c98a4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:59.535748 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2036c47-3631-4cc6-97aa-c1762c98a4e0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:59.550926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c889e4-ada7-42bd-9238-c36383a4598b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:59.551694 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c889e4-ada7-42bd-9238-c36383a4598b service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:59.552118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c889e4-ada7-42bd-9238-c36383a4598b service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:59.552495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c889e4-ada7-42bd-9238-c36383a4598b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:59.554319 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f3c889e4-ada7-42bd-9238-c36383a4598b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:59.558306 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1312/2616] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:17:59 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:59.562459 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036c47-3631-4cc6-97aa-c1762c98a4e0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:59.567057 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c889e4-ada7-42bd-9238-c36383a4598b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:59.568879 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c889e4-ada7-42bd-9238-c36383a4598b service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:59.572899 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036c47-3631-4cc6-97aa-c1762c98a4e0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:59.577718 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345ba40-b34a-421b-b14b-16979d5ec6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:59.578373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345ba40-b34a-421b-b14b-16979d5ec6dd admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:59.578649 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345ba40-b34a-421b-b14b-16979d5ec6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:59.578921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345ba40-b34a-421b-b14b-16979d5ec6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:59.579104 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1305/2617] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:17:59.579971 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345ba40-b34a-421b-b14b-16979d5ec6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:59.581640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345ba40-b34a-421b-b14b-16979d5ec6dd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:59.591647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1313/2618] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:17:59.595799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c889e4-ada7-42bd-9238-c36383a4598b service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:59.605521 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c889e4-ada7-42bd-9238-c36383a4598b service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:59.610141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a06be-5b01-479b-a1c6-8ee5105958a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:59.610803 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a06be-5b01-479b-a1c6-8ee5105958a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:59.611087 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a06be-5b01-479b-a1c6-8ee5105958a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:59.611367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a06be-5b01-479b-a1c6-8ee5105958a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:59.612124 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a06be-5b01-479b-a1c6-8ee5105958a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:59.613711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a06be-5b01-479b-a1c6-8ee5105958a6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:59.624330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1306/2619] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:17:59.628715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345ba40-b34a-421b-b14b-16979d5ec6dd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:59.639471 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345ba40-b34a-421b-b14b-16979d5ec6dd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:59.644089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a97db-eaa5-4115-bbd0-917ce538dc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:59.644979 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a97db-eaa5-4115-bbd0-917ce538dc23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:59.645260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a97db-eaa5-4115-bbd0-917ce538dc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:59.645533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a97db-eaa5-4115-bbd0-917ce538dc23 admin admin] PATH_INFO: `/v3/projects/dbb2454938094ee3938613ffdffe7af0/users/bbda08b6bd4944219920b680f30d0567/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:59.662687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a97db-eaa5-4115-bbd0-917ce538dc23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb2454938094ee3938613ffdffe7af0, user_id=bbda08b6bd4944219920b680f30d0567, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:59.666711 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a97db-eaa5-4115-bbd0-917ce538dc23 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:59.681686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1314/2620] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:17:59 2022] PUT /identity/v3/projects/dbb2454938094ee3938613ffdffe7af0/users/bbda08b6bd4944219920b680f30d0567/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:17:59.691756 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e059cf7-cb47-4731-8102-5c36a397765c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:59.692047 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e059cf7-cb47-4731-8102-5c36a397765c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:59.692324 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e059cf7-cb47-4731-8102-5c36a397765c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:59.718945 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7e059cf7-cb47-4731-8102-5c36a397765c None None] MFA Rules not processed for user `bbda08b6bd4944219920b680f30d0567`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:17:59.720270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7e059cf7-cb47-4731-8102-5c36a397765c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:17:59.784769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1307/2621] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:17:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:17:59.789366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a97db-eaa5-4115-bbd0-917ce538dc23 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:59.851831 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a97db-eaa5-4115-bbd0-917ce538dc23 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:59.857183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85043785-7871-4bd7-b826-b9f7daec9477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:59.857842 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85043785-7871-4bd7-b826-b9f7daec9477 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:59.858124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85043785-7871-4bd7-b826-b9f7daec9477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:59.858416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85043785-7871-4bd7-b826-b9f7daec9477 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:59.859097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85043785-7871-4bd7-b826-b9f7daec9477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:59.861377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85043785-7871-4bd7-b826-b9f7daec9477 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:17:59.892206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1315/2622] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:17:59 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:17:59.896167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e059cf7-cb47-4731-8102-5c36a397765c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:17:59.912667 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e059cf7-cb47-4731-8102-5c36a397765c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:17:59.983245 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6695d85-7e65-40c4-88af-4a4e79563643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:17:59.984181 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6695d85-7e65-40c4-88af-4a4e79563643 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:17:59.984717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6695d85-7e65-40c4-88af-4a4e79563643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:17:59.985269 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6695d85-7e65-40c4-88af-4a4e79563643 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:17:59.986633 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6695d85-7e65-40c4-88af-4a4e79563643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:17:59.990350 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6695d85-7e65-40c4-88af-4a4e79563643 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:00.015376 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1308/2623] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:17:59 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:00.016641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85043785-7871-4bd7-b826-b9f7daec9477 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:00.028826 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85043785-7871-4bd7-b826-b9f7daec9477 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:00.034214 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bae150-bb9c-4b5b-8b78-2a16b0f383b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:00.034977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bae150-bb9c-4b5b-8b78-2a16b0f383b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:00.035362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bae150-bb9c-4b5b-8b78-2a16b0f383b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:00.035758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bae150-bb9c-4b5b-8b78-2a16b0f383b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:00.036566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bae150-bb9c-4b5b-8b78-2a16b0f383b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:00.038308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bae150-bb9c-4b5b-8b78-2a16b0f383b4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:00.052418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1316/2624] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:00.054645 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6695d85-7e65-40c4-88af-4a4e79563643 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:00.066870 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6695d85-7e65-40c4-88af-4a4e79563643 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:00.073881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1eb94-ff48-4390-b1cb-f464a1d03f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:00.075094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1eb94-ff48-4390-b1cb-f464a1d03f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:00.075532 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1eb94-ff48-4390-b1cb-f464a1d03f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:00.076134 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1eb94-ff48-4390-b1cb-f464a1d03f23 admin admin] PATH_INFO: `/v3/projects/595f6ab5eb264f5490b5271a6bacdaa5/users/de96ffe0b0104eddbacb7d6fb8f98213/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:00.095894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1eb94-ff48-4390-b1cb-f464a1d03f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=595f6ab5eb264f5490b5271a6bacdaa5, user_id=de96ffe0b0104eddbacb7d6fb8f98213, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:00.099306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1eb94-ff48-4390-b1cb-f464a1d03f23 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:00.117136 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1309/2625] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:00 2022] PUT /identity/v3/projects/595f6ab5eb264f5490b5271a6bacdaa5/users/de96ffe0b0104eddbacb7d6fb8f98213/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:00.122162 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bae150-bb9c-4b5b-8b78-2a16b0f383b4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:00.135776 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bae150-bb9c-4b5b-8b78-2a16b0f383b4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:00.200447 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b131b-5c24-438e-b559-4cdd80a8a0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:00.201135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b131b-5c24-438e-b559-4cdd80a8a0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:00.201418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b131b-5c24-438e-b559-4cdd80a8a0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:00.201694 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b131b-5c24-438e-b559-4cdd80a8a0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:00.202421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b131b-5c24-438e-b559-4cdd80a8a0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:00.204078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b131b-5c24-438e-b559-4cdd80a8a0a2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:00.218690 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1317/2626] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:00.219861 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1eb94-ff48-4390-b1cb-f464a1d03f23 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:00.231242 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1eb94-ff48-4390-b1cb-f464a1d03f23 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:00.236452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d1003-eafc-41b6-819a-64d661099b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:00.237753 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d1003-eafc-41b6-819a-64d661099b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:00.238111 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d1003-eafc-41b6-819a-64d661099b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:00.238466 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d1003-eafc-41b6-819a-64d661099b0f admin admin] PATH_INFO: `/v3/projects/595f6ab5eb264f5490b5271a6bacdaa5/users/de96ffe0b0104eddbacb7d6fb8f98213/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:00.240706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d1003-eafc-41b6-819a-64d661099b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=595f6ab5eb264f5490b5271a6bacdaa5, user_id=de96ffe0b0104eddbacb7d6fb8f98213, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:00.244243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d1003-eafc-41b6-819a-64d661099b0f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:00.255529 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1310/2627] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:00 2022] PUT /identity/v3/projects/595f6ab5eb264f5490b5271a6bacdaa5/users/de96ffe0b0104eddbacb7d6fb8f98213/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:18:00.267579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ce145-9392-4271-a1de-a3fb88364fe2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:00.268022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ce145-9392-4271-a1de-a3fb88364fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:00.268551 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ce145-9392-4271-a1de-a3fb88364fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:00.298551 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ca8ce145-9392-4271-a1de-a3fb88364fe2 None None] MFA Rules not processed for user `de96ffe0b0104eddbacb7d6fb8f98213`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:00.300007 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ca8ce145-9392-4271-a1de-a3fb88364fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:00.379943 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1318/2628] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:00.394711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d1003-eafc-41b6-819a-64d661099b0f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:00.398630 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4c7d1003-eafc-41b6-819a-64d661099b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:00.522213 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d1003-eafc-41b6-819a-64d661099b0f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:00.531935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9d41c-c90c-49ab-b0e6-7586a73ec08c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:00.532608 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9d41c-c90c-49ab-b0e6-7586a73ec08c service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:00.532888 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9d41c-c90c-49ab-b0e6-7586a73ec08c service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:00.533165 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9d41c-c90c-49ab-b0e6-7586a73ec08c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:00.561834 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9d41c-c90c-49ab-b0e6-7586a73ec08c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:00.563292 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9d41c-c90c-49ab-b0e6-7586a73ec08c service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:00.575028 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1311/2629] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:00 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:00.685534 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ce145-9392-4271-a1de-a3fb88364fe2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:00.702313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ce145-9392-4271-a1de-a3fb88364fe2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:00.714737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c00dc-7fa6-44a8-8e0d-15744d386c88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:00.716215 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c00dc-7fa6-44a8-8e0d-15744d386c88 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:00.716725 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c00dc-7fa6-44a8-8e0d-15744d386c88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:00.717186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c00dc-7fa6-44a8-8e0d-15744d386c88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:00.793306 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c00dc-7fa6-44a8-8e0d-15744d386c88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:00.796736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c00dc-7fa6-44a8-8e0d-15744d386c88 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:00.816294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1319/2630] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:01.491678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9d41c-c90c-49ab-b0e6-7586a73ec08c service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:01.493930 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b0c9d41c-c90c-49ab-b0e6-7586a73ec08c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:01.563211 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9d41c-c90c-49ab-b0e6-7586a73ec08c service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:01.567861 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61682d4c-bc93-4ded-9863-05f66d58affd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:01.568738 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61682d4c-bc93-4ded-9863-05f66d58affd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:01.569016 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61682d4c-bc93-4ded-9863-05f66d58affd admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:01.569283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61682d4c-bc93-4ded-9863-05f66d58affd admin admin] PATH_INFO: `/v3/users/5f670681f05045a9bedda88d89df815c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:01.571293 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61682d4c-bc93-4ded-9863-05f66d58affd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f670681f05045a9bedda88d89df815c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:01.574188 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61682d4c-bc93-4ded-9863-05f66d58affd admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:01.630792 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-61682d4c-bc93-4ded-9863-05f66d58affd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f670681f05045a9bedda88d89df815c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:01.630792 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-61682d4c-bc93-4ded-9863-05f66d58affd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f670681f05045a9bedda88d89df815c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:01.644867 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-61682d4c-bc93-4ded-9863-05f66d58affd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f670681f05045a9bedda88d89df815c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:01.653582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-61682d4c-bc93-4ded-9863-05f66d58affd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f670681f05045a9bedda88d89df815c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:01.654531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-61682d4c-bc93-4ded-9863-05f66d58affd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f670681f05045a9bedda88d89df815c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:01.672686 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1312/2631] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:01 2022] DELETE /identity/v3/users/5f670681f05045a9bedda88d89df815c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:01.867668 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c00dc-7fa6-44a8-8e0d-15744d386c88 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:01.883112 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c00dc-7fa6-44a8-8e0d-15744d386c88 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:01.948084 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:01.949029 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:01.950572 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:01.950572 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa admin admin] PATH_INFO: `/v3/projects/be5fa842e29944f5957064f633e275ad` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:01.950798 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=be5fa842e29944f5957064f633e275ad)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:01.952751 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:02.005663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be5fa842e29944f5957064f633e275ad', 'request_id': 'req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:02.012079 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be5fa842e29944f5957064f633e275ad', 'request_id': 'req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:02.022828 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be5fa842e29944f5957064f633e275ad', 'request_id': 'req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:02.036952 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa admin admin] The token cache is being invalidate because project be5fa842e29944f5957064f633e275ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:02.037173 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:02.037863 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:02.039418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1320/2632] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:01 2022] DELETE /identity/v3/projects/be5fa842e29944f5957064f633e275ad => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:02.044110 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61682d4c-bc93-4ded-9863-05f66d58affd admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:02.045628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-61682d4c-bc93-4ded-9863-05f66d58affd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:02.059103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61682d4c-bc93-4ded-9863-05f66d58affd admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:02.118764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976cb40-8d9a-4b92-84e8-1daf1070b502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:02.119693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976cb40-8d9a-4b92-84e8-1daf1070b502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:02.120157 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976cb40-8d9a-4b92-84e8-1daf1070b502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:02.120607 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976cb40-8d9a-4b92-84e8-1daf1070b502 admin admin] PATH_INFO: `/v3/users/23108d254bc54be88a29d7f9f032ca6f` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:02.122701 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976cb40-8d9a-4b92-84e8-1daf1070b502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23108d254bc54be88a29d7f9f032ca6f)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:02.125123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976cb40-8d9a-4b92-84e8-1daf1070b502 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:02.188622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2976cb40-8d9a-4b92-84e8-1daf1070b502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23108d254bc54be88a29d7f9f032ca6f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:02.189359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2976cb40-8d9a-4b92-84e8-1daf1070b502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23108d254bc54be88a29d7f9f032ca6f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:02.202731 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2976cb40-8d9a-4b92-84e8-1daf1070b502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23108d254bc54be88a29d7f9f032ca6f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:02.209849 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2976cb40-8d9a-4b92-84e8-1daf1070b502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23108d254bc54be88a29d7f9f032ca6f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:02.210651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2976cb40-8d9a-4b92-84e8-1daf1070b502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23108d254bc54be88a29d7f9f032ca6f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:02.224616 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1313/2633] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:02 2022] DELETE /identity/v3/users/23108d254bc54be88a29d7f9f032ca6f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:18:02.549238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:02.551526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:02.571541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a25cc-7d5b-42f5-b661-78a1dfe9e2aa admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:02.658336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec42de-b9db-4797-b083-dc62a11c1b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:02.659259 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec42de-b9db-4797-b083-dc62a11c1b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:02.659542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec42de-b9db-4797-b083-dc62a11c1b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:02.659868 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec42de-b9db-4797-b083-dc62a11c1b79 admin admin] PATH_INFO: `/v3/projects/83ac822d13d44babadfa7d4791a4f5d1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:02.661062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec42de-b9db-4797-b083-dc62a11c1b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ac822d13d44babadfa7d4791a4f5d1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:02.663083 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec42de-b9db-4797-b083-dc62a11c1b79 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:02.718224 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-25ec42de-b9db-4797-b083-dc62a11c1b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ac822d13d44babadfa7d4791a4f5d1', 'request_id': 'req-25ec42de-b9db-4797-b083-dc62a11c1b79'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:02.724233 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-25ec42de-b9db-4797-b083-dc62a11c1b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ac822d13d44babadfa7d4791a4f5d1', 'request_id': 'req-25ec42de-b9db-4797-b083-dc62a11c1b79'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:02.733072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-25ec42de-b9db-4797-b083-dc62a11c1b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ac822d13d44babadfa7d4791a4f5d1', 'request_id': 'req-25ec42de-b9db-4797-b083-dc62a11c1b79'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:02.748336 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-25ec42de-b9db-4797-b083-dc62a11c1b79 admin admin] The token cache is being invalidate because project 83ac822d13d44babadfa7d4791a4f5d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:02.748647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-25ec42de-b9db-4797-b083-dc62a11c1b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:02.749300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-25ec42de-b9db-4797-b083-dc62a11c1b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:02.751103 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1321/2634] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:02 2022] DELETE /identity/v3/projects/83ac822d13d44babadfa7d4791a4f5d1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:02.756873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3e9de-fbcd-4de7-b46f-2156660beecb None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:02.757712 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3e9de-fbcd-4de7-b46f-2156660beecb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:02.758187 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3e9de-fbcd-4de7-b46f-2156660beecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:02.778031 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-fbb3e9de-fbcd-4de7-b46f-2156660beecb None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:02.779981 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-fbb3e9de-fbcd-4de7-b46f-2156660beecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:02.849744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1314/2635] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:02.857772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafba91f-75ac-4b0e-b784-9eb02cf92448 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:02.858060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafba91f-75ac-4b0e-b784-9eb02cf92448 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:02.858340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafba91f-75ac-4b0e-b784-9eb02cf92448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:02.877194 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-eafba91f-75ac-4b0e-b784-9eb02cf92448 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:02.878310 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-eafba91f-75ac-4b0e-b784-9eb02cf92448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:02.886395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1322/2636] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:02.890627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3e9de-fbcd-4de7-b46f-2156660beecb None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:02.900060 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3e9de-fbcd-4de7-b46f-2156660beecb None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:02.905514 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a590067-97ad-4b73-b0f4-4764a209fb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:02.906509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a590067-97ad-4b73-b0f4-4764a209fb51 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:02.906776 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a590067-97ad-4b73-b0f4-4764a209fb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:02.907176 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a590067-97ad-4b73-b0f4-4764a209fb51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:02.908034 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a590067-97ad-4b73-b0f4-4764a209fb51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:18:02.908341 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a590067-97ad-4b73-b0f4-4764a209fb51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:02.909943 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a590067-97ad-4b73-b0f4-4764a209fb51 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:02.935309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1315/2637] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:18:02.939978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafba91f-75ac-4b0e-b784-9eb02cf92448 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:02.951234 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafba91f-75ac-4b0e-b784-9eb02cf92448 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:02.960637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5bd2b-68de-443f-9d33-bdbfd0a56d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:02.961565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5bd2b-68de-443f-9d33-bdbfd0a56d44 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:02.962658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5bd2b-68de-443f-9d33-bdbfd0a56d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:02.963235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5bd2b-68de-443f-9d33-bdbfd0a56d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:02.964497 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5bd2b-68de-443f-9d33-bdbfd0a56d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:02.967478 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5bd2b-68de-443f-9d33-bdbfd0a56d44 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:03.021134 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1323/2638] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:02 2022] POST /identity/v3/projects => generated 369 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:03.022454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a590067-97ad-4b73-b0f4-4764a209fb51 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:03.034418 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a590067-97ad-4b73-b0f4-4764a209fb51 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:03.122844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd073-0fa9-4fa9-9466-a0f942e1e43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:03.124367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd073-0fa9-4fa9-9466-a0f942e1e43d admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:03.124824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd073-0fa9-4fa9-9466-a0f942e1e43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:03.125818 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd073-0fa9-4fa9-9466-a0f942e1e43d admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:03.126772 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cd073-0fa9-4fa9-9466-a0f942e1e43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:03.129066 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cd073-0fa9-4fa9-9466-a0f942e1e43d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:03.156292 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1316/2639] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:03 2022] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:03.161638 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5bd2b-68de-443f-9d33-bdbfd0a56d44 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:03.176123 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5bd2b-68de-443f-9d33-bdbfd0a56d44 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:03.183377 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e66533-b591-4548-a07d-f3ec6636bf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:03.184880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e66533-b591-4548-a07d-f3ec6636bf75 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:03.185340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e66533-b591-4548-a07d-f3ec6636bf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:03.185806 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e66533-b591-4548-a07d-f3ec6636bf75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:03.186777 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e66533-b591-4548-a07d-f3ec6636bf75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:03.188761 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e66533-b591-4548-a07d-f3ec6636bf75 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:03.224729 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1324/2640] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:03.228542 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd073-0fa9-4fa9-9466-a0f942e1e43d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:03.240800 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd073-0fa9-4fa9-9466-a0f942e1e43d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:03.265584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6a787-beef-49f9-bf75-fe9a741d8e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:03.266283 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6a787-beef-49f9-bf75-fe9a741d8e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:03.266562 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6a787-beef-49f9-bf75-fe9a741d8e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:03.266842 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6a787-beef-49f9-bf75-fe9a741d8e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:03.267576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6a787-beef-49f9-bf75-fe9a741d8e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:03.273912 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6a787-beef-49f9-bf75-fe9a741d8e3a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:03.289472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1317/2641] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:03.294445 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e66533-b591-4548-a07d-f3ec6636bf75 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:03.306309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e66533-b591-4548-a07d-f3ec6636bf75 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:03.311148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a4a04-5db2-4ba9-95ff-bf83267447d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:03.312079 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a4a04-5db2-4ba9-95ff-bf83267447d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:03.312362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a4a04-5db2-4ba9-95ff-bf83267447d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:03.312637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a4a04-5db2-4ba9-95ff-bf83267447d1 admin admin] PATH_INFO: `/v3/projects/b8656ffc24e54f4e90c1023b46f7ed19/users/12090ac2033e4bd0b427248bbfdeef7c/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:03.344807 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6a787-beef-49f9-bf75-fe9a741d8e3a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:03.346640 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-34c6a787-beef-49f9-bf75-fe9a741d8e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:03.348526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a4a04-5db2-4ba9-95ff-bf83267447d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8656ffc24e54f4e90c1023b46f7ed19, user_id=12090ac2033e4bd0b427248bbfdeef7c, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:03.354170 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a4a04-5db2-4ba9-95ff-bf83267447d1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:03.365183 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6a787-beef-49f9-bf75-fe9a741d8e3a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:03.372421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868cbef-aa1b-44fa-9818-d067ff75a47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:03.373363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868cbef-aa1b-44fa-9818-d067ff75a47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:03.373672 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868cbef-aa1b-44fa-9818-d067ff75a47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:03.374078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868cbef-aa1b-44fa-9818-d067ff75a47a admin admin] PATH_INFO: `/v3/users/61daaf70d25c4e1592fcb2f4feafff86` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:03.375340 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868cbef-aa1b-44fa-9818-d067ff75a47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=61daaf70d25c4e1592fcb2f4feafff86)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:03.377317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868cbef-aa1b-44fa-9818-d067ff75a47a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:03.378696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1325/2642] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:03 2022] PUT /identity/v3/projects/b8656ffc24e54f4e90c1023b46f7ed19/users/12090ac2033e4bd0b427248bbfdeef7c/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:03.395648 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d7ec2-b94b-4222-b1da-f061bcc93ac3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:03.395920 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d7ec2-b94b-4222-b1da-f061bcc93ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:03.396191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d7ec2-b94b-4222-b1da-f061bcc93ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:03.426411 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f37d7ec2-b94b-4222-b1da-f061bcc93ac3 None None] MFA Rules not processed for user `12090ac2033e4bd0b427248bbfdeef7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:03.427622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f37d7ec2-b94b-4222-b1da-f061bcc93ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:03.430430 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f868cbef-aa1b-44fa-9818-d067ff75a47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61daaf70d25c4e1592fcb2f4feafff86'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:03.431726 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f868cbef-aa1b-44fa-9818-d067ff75a47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61daaf70d25c4e1592fcb2f4feafff86'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:03.442972 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f868cbef-aa1b-44fa-9818-d067ff75a47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61daaf70d25c4e1592fcb2f4feafff86'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:03.450358 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f868cbef-aa1b-44fa-9818-d067ff75a47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61daaf70d25c4e1592fcb2f4feafff86'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:03.451036 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-f868cbef-aa1b-44fa-9818-d067ff75a47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61daaf70d25c4e1592fcb2f4feafff86'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:03.465675 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1318/2643] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:03 2022] DELETE /identity/v3/users/61daaf70d25c4e1592fcb2f4feafff86 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:18:03.492419 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1326/2644] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:18:03.510127 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868cbef-aa1b-44fa-9818-d067ff75a47a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:03.511716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f868cbef-aa1b-44fa-9818-d067ff75a47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:03.572823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868cbef-aa1b-44fa-9818-d067ff75a47a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:03.576571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10e3b1-2133-4934-a9e6-276ba830098f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25519cdc25244a0b039ce3097c328d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:03.577223 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10e3b1-2133-4934-a9e6-276ba830098f service glance] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:03.577510 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10e3b1-2133-4934-a9e6-276ba830098f service glance] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:03.577787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10e3b1-2133-4934-a9e6-276ba830098f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:03.654681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d7ec2-b94b-4222-b1da-f061bcc93ac3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:03.656870 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f37d7ec2-b94b-4222-b1da-f061bcc93ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:03.659693 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10e3b1-2133-4934-a9e6-276ba830098f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:03.661258 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10e3b1-2133-4934-a9e6-276ba830098f service glance] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:03.675529 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1319/2645] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:03.760200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d7ec2-b94b-4222-b1da-f061bcc93ac3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:03.829368 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde36e5d-6618-4f71-a285-58ba92821426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:03.830352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde36e5d-6618-4f71-a285-58ba92821426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:03.830637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde36e5d-6618-4f71-a285-58ba92821426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:03.830910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde36e5d-6618-4f71-a285-58ba92821426 admin admin] PATH_INFO: `/v3/projects/54981d1c7fe64f5cb6a846496ad4f776` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:03.832151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde36e5d-6618-4f71-a285-58ba92821426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54981d1c7fe64f5cb6a846496ad4f776)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:03.834246 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde36e5d-6618-4f71-a285-58ba92821426 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:03.892648 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bde36e5d-6618-4f71-a285-58ba92821426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54981d1c7fe64f5cb6a846496ad4f776', 'request_id': 'req-bde36e5d-6618-4f71-a285-58ba92821426'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:03.897253 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bde36e5d-6618-4f71-a285-58ba92821426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54981d1c7fe64f5cb6a846496ad4f776', 'request_id': 'req-bde36e5d-6618-4f71-a285-58ba92821426'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:03.905732 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bde36e5d-6618-4f71-a285-58ba92821426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54981d1c7fe64f5cb6a846496ad4f776', 'request_id': 'req-bde36e5d-6618-4f71-a285-58ba92821426'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:03.917496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bde36e5d-6618-4f71-a285-58ba92821426 admin admin] The token cache is being invalidate because project 54981d1c7fe64f5cb6a846496ad4f776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:03.918108 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bde36e5d-6618-4f71-a285-58ba92821426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:03.918847 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bde36e5d-6618-4f71-a285-58ba92821426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:03.920882 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1327/2646] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:03 2022] DELETE /identity/v3/projects/54981d1c7fe64f5cb6a846496ad4f776 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:18:03.925888 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6979-70aa-476f-ad8a-ec760aab28c6 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:03.926582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6979-70aa-476f-ad8a-ec760aab28c6 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:03.926582 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6979-70aa-476f-ad8a-ec760aab28c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:03.944829 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-6b4b6979-70aa-476f-ad8a-ec760aab28c6 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:03.946020 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6b4b6979-70aa-476f-ad8a-ec760aab28c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:04.014761 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1320/2647] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:04.023244 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e7e1b-3c1a-49ec-87db-a38b557958bd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:04.023820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e7e1b-3c1a-49ec-87db-a38b557958bd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:04.025052 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e7e1b-3c1a-49ec-87db-a38b557958bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:04.046698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-309e7e1b-3c1a-49ec-87db-a38b557958bd None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:04.047940 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-309e7e1b-3c1a-49ec-87db-a38b557958bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:04.055919 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1328/2648] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:04.060883 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b6979-70aa-476f-ad8a-ec760aab28c6 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:04.070546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b6979-70aa-476f-ad8a-ec760aab28c6 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:04.076185 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cd45c-0fe1-4775-b529-55806c0a282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:04.076921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cd45c-0fe1-4775-b529-55806c0a282f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:04.077211 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cd45c-0fe1-4775-b529-55806c0a282f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:04.077485 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cd45c-0fe1-4775-b529-55806c0a282f admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:04.078409 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cd45c-0fe1-4775-b529-55806c0a282f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:18:04.078989 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cd45c-0fe1-4775-b529-55806c0a282f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:04.080636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cd45c-0fe1-4775-b529-55806c0a282f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:04.095010 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1321/2649] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:18:04.098631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e7e1b-3c1a-49ec-87db-a38b557958bd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:04.109372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e7e1b-3c1a-49ec-87db-a38b557958bd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:04.115931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6b683-f613-4542-a686-16fbf67d20fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:04.116699 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6b683-f613-4542-a686-16fbf67d20fe admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:04.117237 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6b683-f613-4542-a686-16fbf67d20fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:04.117793 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6b683-f613-4542-a686-16fbf67d20fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:04.118950 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6b683-f613-4542-a686-16fbf67d20fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:04.124193 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6b683-f613-4542-a686-16fbf67d20fe admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:04.179891 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1329/2650] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:04 2022] POST /identity/v3/projects => generated 403 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:04.183890 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cd45c-0fe1-4775-b529-55806c0a282f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:04.200062 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cd45c-0fe1-4775-b529-55806c0a282f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:04.262246 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62338d7c-4874-4935-a2e6-d361c5aae034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:04.262963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338d7c-4874-4935-a2e6-d361c5aae034 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:04.263473 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338d7c-4874-4935-a2e6-d361c5aae034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:04.263811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338d7c-4874-4935-a2e6-d361c5aae034 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:04.265086 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62338d7c-4874-4935-a2e6-d361c5aae034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:04.267686 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62338d7c-4874-4935-a2e6-d361c5aae034 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:04.297683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1322/2651] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:04 2022] POST /identity/v3/users => generated 302 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:18:04.301949 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6b683-f613-4542-a686-16fbf67d20fe admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:04.312231 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6b683-f613-4542-a686-16fbf67d20fe admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:04.317581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb7c66-276f-4c77-9c8d-9da0630cb9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:04.318453 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb7c66-276f-4c77-9c8d-9da0630cb9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:04.318963 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb7c66-276f-4c77-9c8d-9da0630cb9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:04.319179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb7c66-276f-4c77-9c8d-9da0630cb9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:04.320091 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb7c66-276f-4c77-9c8d-9da0630cb9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:04.322206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb7c66-276f-4c77-9c8d-9da0630cb9e1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:04.332526 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1330/2652] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:04.337453 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62338d7c-4874-4935-a2e6-d361c5aae034 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:04.351033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62338d7c-4874-4935-a2e6-d361c5aae034 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:04.358627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dcd19-5694-4d43-a0e4-98cf02bf5f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:04.359990 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dcd19-5694-4d43-a0e4-98cf02bf5f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:04.360463 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dcd19-5694-4d43-a0e4-98cf02bf5f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:04.360844 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dcd19-5694-4d43-a0e4-98cf02bf5f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:04.361969 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48dcd19-5694-4d43-a0e4-98cf02bf5f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:04.363963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48dcd19-5694-4d43-a0e4-98cf02bf5f3f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:04.380531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1323/2653] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:04.385786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb7c66-276f-4c77-9c8d-9da0630cb9e1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:04.396319 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb7c66-276f-4c77-9c8d-9da0630cb9e1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:04.403015 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a62d5a-a910-41be-bc13-0673a218aab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:04.403943 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a62d5a-a910-41be-bc13-0673a218aab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:04.404228 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a62d5a-a910-41be-bc13-0673a218aab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:04.404588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a62d5a-a910-41be-bc13-0673a218aab2 admin admin] PATH_INFO: `/v3/projects/633525064a1e4db68071036057947432/users/5c43635342d2453881a1591717353db9/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:04.423691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a62d5a-a910-41be-bc13-0673a218aab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633525064a1e4db68071036057947432, user_id=5c43635342d2453881a1591717353db9, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:04.431948 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a62d5a-a910-41be-bc13-0673a218aab2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:04.449149 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1331/2654] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:04 2022] PUT /identity/v3/projects/633525064a1e4db68071036057947432/users/5c43635342d2453881a1591717353db9/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:04.454272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cd366-7326-45c7-8aed-4ac1f9c183e7 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:04.454561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cd366-7326-45c7-8aed-4ac1f9c183e7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:04.454840 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cd366-7326-45c7-8aed-4ac1f9c183e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:04.473021 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-f56cd366-7326-45c7-8aed-4ac1f9c183e7 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:04.474230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-f56cd366-7326-45c7-8aed-4ac1f9c183e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:04.543681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1324/2655] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:04.554181 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a62d5a-a910-41be-bc13-0673a218aab2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:04.556187 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b1a62d5a-a910-41be-bc13-0673a218aab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:04.620281 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a62d5a-a910-41be-bc13-0673a218aab2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:04.623935 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916671a-a6ca-4765-b480-f8c33f68c9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:04.624581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916671a-a6ca-4765-b480-f8c33f68c9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:04.624859 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916671a-a6ca-4765-b480-f8c33f68c9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:04.625128 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916671a-a6ca-4765-b480-f8c33f68c9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:04.635122 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916671a-a6ca-4765-b480-f8c33f68c9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:04.636572 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916671a-a6ca-4765-b480-f8c33f68c9d4 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:04.645673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1332/2656] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:05.249467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4abcc-17c4-4876-85c6-85890623ad4b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:05.249467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4abcc-17c4-4876-85c6-85890623ad4b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:05.249467 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4abcc-17c4-4876-85c6-85890623ad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:05.275034 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-15c4abcc-17c4-4876-85c6-85890623ad4b None None] MFA Rules not processed for user `5c43635342d2453881a1591717353db9`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:05.276615 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-15c4abcc-17c4-4876-85c6-85890623ad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:05.347985 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1325/2657] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:05.352367 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916671a-a6ca-4765-b480-f8c33f68c9d4 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:05.363557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916671a-a6ca-4765-b480-f8c33f68c9d4 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:05.373558 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51897a0-7c40-42ea-9b37-c0c57f26735e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:05.374638 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51897a0-7c40-42ea-9b37-c0c57f26735e admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:05.375123 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51897a0-7c40-42ea-9b37-c0c57f26735e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:05.375615 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51897a0-7c40-42ea-9b37-c0c57f26735e admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:05.376552 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51897a0-7c40-42ea-9b37-c0c57f26735e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:05.378472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51897a0-7c40-42ea-9b37-c0c57f26735e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:05.408696 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1333/2658] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:05 2022] POST /identity/v3/projects => generated 401 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:05.413453 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4abcc-17c4-4876-85c6-85890623ad4b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:05.424424 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4abcc-17c4-4876-85c6-85890623ad4b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:05.480801 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbae06e-580a-4e1c-9474-d925dc04ce27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:05.481719 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbae06e-580a-4e1c-9474-d925dc04ce27 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:05.482005 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbae06e-580a-4e1c-9474-d925dc04ce27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:05.482282 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbae06e-580a-4e1c-9474-d925dc04ce27 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:05.482979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbae06e-580a-4e1c-9474-d925dc04ce27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:05.484948 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbae06e-580a-4e1c-9474-d925dc04ce27 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:05.508507 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1326/2659] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:05 2022] POST /identity/v3/users => generated 307 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:05.509832 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51897a0-7c40-42ea-9b37-c0c57f26735e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:05.521409 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51897a0-7c40-42ea-9b37-c0c57f26735e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:05.527060 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c83b74-4117-437d-9eef-74dd98704e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:05.527770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c83b74-4117-437d-9eef-74dd98704e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:05.528053 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c83b74-4117-437d-9eef-74dd98704e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:05.528325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c83b74-4117-437d-9eef-74dd98704e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:05.529113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c83b74-4117-437d-9eef-74dd98704e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:05.530813 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c83b74-4117-437d-9eef-74dd98704e38 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:05.542369 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1334/2660] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:05.546472 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbae06e-580a-4e1c-9474-d925dc04ce27 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:05.556367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbae06e-580a-4e1c-9474-d925dc04ce27 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:05.561061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f7758-480a-46c5-8518-33df0ea6d29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:05.561967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f7758-480a-46c5-8518-33df0ea6d29f admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:05.562273 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f7758-480a-46c5-8518-33df0ea6d29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:05.562567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f7758-480a-46c5-8518-33df0ea6d29f admin admin] PATH_INFO: `/v3/projects/9930d916aa4647db82b94335bfb81105/users/001485d3864441e1afda65584fca720e/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:05.577661 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f7758-480a-46c5-8518-33df0ea6d29f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9930d916aa4647db82b94335bfb81105, user_id=001485d3864441e1afda65584fca720e, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:05.580353 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f7758-480a-46c5-8518-33df0ea6d29f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:05.593143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1327/2661] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:05 2022] PUT /identity/v3/projects/9930d916aa4647db82b94335bfb81105/users/001485d3864441e1afda65584fca720e/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:05.597146 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c83b74-4117-437d-9eef-74dd98704e38 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:05.608419 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c83b74-4117-437d-9eef-74dd98704e38 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:05.664715 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a953af-6981-4dfb-b728-4dda8230f379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:05.665901 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a953af-6981-4dfb-b728-4dda8230f379 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:05.666185 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a953af-6981-4dfb-b728-4dda8230f379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:05.666457 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a953af-6981-4dfb-b728-4dda8230f379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:05.667179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a953af-6981-4dfb-b728-4dda8230f379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:05.668795 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a953af-6981-4dfb-b728-4dda8230f379 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:05.678974 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1335/2662] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:05.684082 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f7758-480a-46c5-8518-33df0ea6d29f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:05.696063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f7758-480a-46c5-8518-33df0ea6d29f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:05.701456 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773a0a7-15f8-4cca-9d49-13dfa037008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:05.702583 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a0a7-15f8-4cca-9d49-13dfa037008d admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:05.702952 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a0a7-15f8-4cca-9d49-13dfa037008d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:05.703281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a0a7-15f8-4cca-9d49-13dfa037008d admin admin] PATH_INFO: `/v3/projects/9930d916aa4647db82b94335bfb81105/users/001485d3864441e1afda65584fca720e/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:05.705338 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773a0a7-15f8-4cca-9d49-13dfa037008d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9930d916aa4647db82b94335bfb81105, user_id=001485d3864441e1afda65584fca720e, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:05.708101 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773a0a7-15f8-4cca-9d49-13dfa037008d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:05.720450 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1328/2663] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:05 2022] PUT /identity/v3/projects/9930d916aa4647db82b94335bfb81105/users/001485d3864441e1afda65584fca720e/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:05.815552 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a953af-6981-4dfb-b728-4dda8230f379 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:05.817852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-25a953af-6981-4dfb-b728-4dda8230f379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:05.831947 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a953af-6981-4dfb-b728-4dda8230f379 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:05.896086 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba087b-1370-4564-a99f-564355bd6b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:05.897181 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba087b-1370-4564-a99f-564355bd6b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:05.897691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba087b-1370-4564-a99f-564355bd6b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:05.898081 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba087b-1370-4564-a99f-564355bd6b4a admin admin] PATH_INFO: `/v3/users/bbda08b6bd4944219920b680f30d0567` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:05.900782 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba087b-1370-4564-a99f-564355bd6b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbda08b6bd4944219920b680f30d0567)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:05.903724 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba087b-1370-4564-a99f-564355bd6b4a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:05.951995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-98ba087b-1370-4564-a99f-564355bd6b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbda08b6bd4944219920b680f30d0567'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:05.964817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-98ba087b-1370-4564-a99f-564355bd6b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbda08b6bd4944219920b680f30d0567'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:05.971876 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-98ba087b-1370-4564-a99f-564355bd6b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbda08b6bd4944219920b680f30d0567'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:05.972628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-98ba087b-1370-4564-a99f-564355bd6b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbda08b6bd4944219920b680f30d0567'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:05.973380 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-98ba087b-1370-4564-a99f-564355bd6b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbda08b6bd4944219920b680f30d0567'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:05.987137 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1336/2664] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:05 2022] DELETE /identity/v3/users/bbda08b6bd4944219920b680f30d0567 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:05.992234 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd063e-ee0b-4fd2-a6c3-b3fefaee99b2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:05.992710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd063e-ee0b-4fd2-a6c3-b3fefaee99b2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:05.993839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd063e-ee0b-4fd2-a6c3-b3fefaee99b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:06.030988 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-25bd063e-ee0b-4fd2-a6c3-b3fefaee99b2 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:06.032417 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-25bd063e-ee0b-4fd2-a6c3-b3fefaee99b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:06.101066 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1329/2665] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:06.112199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba087b-1370-4564-a99f-564355bd6b4a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:06.114676 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-98ba087b-1370-4564-a99f-564355bd6b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:06.177863 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba087b-1370-4564-a99f-564355bd6b4a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:06.182099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272c196-eef7-4973-b594-372e146477fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:06.182829 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272c196-eef7-4973-b594-372e146477fc service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:06.183186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272c196-eef7-4973-b594-372e146477fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:06.183535 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272c196-eef7-4973-b594-372e146477fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:06.193256 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272c196-eef7-4973-b594-372e146477fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:06.194764 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272c196-eef7-4973-b594-372e146477fc service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:06.205208 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1337/2666] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:06.453593 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35850b0c-a8de-4dcc-8930-0ef05f279b52 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:06.454528 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35850b0c-a8de-4dcc-8930-0ef05f279b52 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:06.454969 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35850b0c-a8de-4dcc-8930-0ef05f279b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:06.491880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-35850b0c-a8de-4dcc-8930-0ef05f279b52 None None] MFA Rules not processed for user `001485d3864441e1afda65584fca720e`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:06.493608 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-35850b0c-a8de-4dcc-8930-0ef05f279b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:06.554296 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272c196-eef7-4973-b594-372e146477fc service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:06.557133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6272c196-eef7-4973-b594-372e146477fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:06.576505 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272c196-eef7-4973-b594-372e146477fc service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:06.582579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7603eff-e0b6-4810-be3f-ac509178eefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:06.584090 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7603eff-e0b6-4810-be3f-ac509178eefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:06.584481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7603eff-e0b6-4810-be3f-ac509178eefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:06.584822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7603eff-e0b6-4810-be3f-ac509178eefb admin admin] PATH_INFO: `/v3/projects/dbb2454938094ee3938613ffdffe7af0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:06.586626 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7603eff-e0b6-4810-be3f-ac509178eefb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb2454938094ee3938613ffdffe7af0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:06.589290 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7603eff-e0b6-4810-be3f-ac509178eefb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:06.596133 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1330/2667] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:06 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:06.654133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f7603eff-e0b6-4810-be3f-ac509178eefb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb2454938094ee3938613ffdffe7af0', 'request_id': 'req-f7603eff-e0b6-4810-be3f-ac509178eefb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:06.662552 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f7603eff-e0b6-4810-be3f-ac509178eefb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb2454938094ee3938613ffdffe7af0', 'request_id': 'req-f7603eff-e0b6-4810-be3f-ac509178eefb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:06.672162 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f7603eff-e0b6-4810-be3f-ac509178eefb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb2454938094ee3938613ffdffe7af0', 'request_id': 'req-f7603eff-e0b6-4810-be3f-ac509178eefb'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:06.688801 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f7603eff-e0b6-4810-be3f-ac509178eefb admin admin] The token cache is being invalidate because project dbb2454938094ee3938613ffdffe7af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:06.689205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f7603eff-e0b6-4810-be3f-ac509178eefb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:06.690131 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f7603eff-e0b6-4810-be3f-ac509178eefb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:06.692661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1338/2668] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:06 2022] DELETE /identity/v3/projects/dbb2454938094ee3938613ffdffe7af0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:06.697743 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35850b0c-a8de-4dcc-8930-0ef05f279b52 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:06.710039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35850b0c-a8de-4dcc-8930-0ef05f279b52 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:06.768977 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b8b65-4bea-4681-b4d9-8b6ec9e0db89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:06.769977 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8b65-4bea-4681-b4d9-8b6ec9e0db89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:06.770268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8b65-4bea-4681-b4d9-8b6ec9e0db89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:06.770569 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8b65-4bea-4681-b4d9-8b6ec9e0db89 admin admin] PATH_INFO: `/v3/users/de96ffe0b0104eddbacb7d6fb8f98213` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:06.771936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b8b65-4bea-4681-b4d9-8b6ec9e0db89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de96ffe0b0104eddbacb7d6fb8f98213)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:06.773905 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b8b65-4bea-4681-b4d9-8b6ec9e0db89 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:06.828606 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2c2b8b65-4bea-4681-b4d9-8b6ec9e0db89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de96ffe0b0104eddbacb7d6fb8f98213'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:06.829516 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2c2b8b65-4bea-4681-b4d9-8b6ec9e0db89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de96ffe0b0104eddbacb7d6fb8f98213'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:06.842407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2c2b8b65-4bea-4681-b4d9-8b6ec9e0db89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de96ffe0b0104eddbacb7d6fb8f98213'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:06.849465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2c2b8b65-4bea-4681-b4d9-8b6ec9e0db89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de96ffe0b0104eddbacb7d6fb8f98213'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:06.850319 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2c2b8b65-4bea-4681-b4d9-8b6ec9e0db89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de96ffe0b0104eddbacb7d6fb8f98213'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:06.865792 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1331/2669] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:06 2022] DELETE /identity/v3/users/de96ffe0b0104eddbacb7d6fb8f98213 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:07.242675 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7603eff-e0b6-4810-be3f-ac509178eefb admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:07.244850 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f7603eff-e0b6-4810-be3f-ac509178eefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:07.259836 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7603eff-e0b6-4810-be3f-ac509178eefb admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:07.327566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674135c-98d8-400a-9b2a-ef90743da128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:07.328474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674135c-98d8-400a-9b2a-ef90743da128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:07.328749 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674135c-98d8-400a-9b2a-ef90743da128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:07.329025 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674135c-98d8-400a-9b2a-ef90743da128 admin admin] PATH_INFO: `/v3/projects/595f6ab5eb264f5490b5271a6bacdaa5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:07.330292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674135c-98d8-400a-9b2a-ef90743da128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=595f6ab5eb264f5490b5271a6bacdaa5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:07.332246 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674135c-98d8-400a-9b2a-ef90743da128 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:07.389015 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2674135c-98d8-400a-9b2a-ef90743da128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '595f6ab5eb264f5490b5271a6bacdaa5', 'request_id': 'req-2674135c-98d8-400a-9b2a-ef90743da128'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:07.394897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2674135c-98d8-400a-9b2a-ef90743da128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '595f6ab5eb264f5490b5271a6bacdaa5', 'request_id': 'req-2674135c-98d8-400a-9b2a-ef90743da128'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:07.407456 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2674135c-98d8-400a-9b2a-ef90743da128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '595f6ab5eb264f5490b5271a6bacdaa5', 'request_id': 'req-2674135c-98d8-400a-9b2a-ef90743da128'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:07.422319 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2674135c-98d8-400a-9b2a-ef90743da128 admin admin] The token cache is being invalidate because project 595f6ab5eb264f5490b5271a6bacdaa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:07.422633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2674135c-98d8-400a-9b2a-ef90743da128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:07.423321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2674135c-98d8-400a-9b2a-ef90743da128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:07.425123 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1339/2670] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:07 2022] DELETE /identity/v3/projects/595f6ab5eb264f5490b5271a6bacdaa5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:07.429752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31a250-ac43-45cc-a1fb-17f9a8bf2802 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:07.430104 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31a250-ac43-45cc-a1fb-17f9a8bf2802 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:07.430496 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31a250-ac43-45cc-a1fb-17f9a8bf2802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:07.448885 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-ec31a250-ac43-45cc-a1fb-17f9a8bf2802 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:07.450794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ec31a250-ac43-45cc-a1fb-17f9a8bf2802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:07.518646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1332/2671] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:07.520384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e6adc-4732-4b96-bba3-87dbd65eadfd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:07.520670 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e6adc-4732-4b96-bba3-87dbd65eadfd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:07.520947 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e6adc-4732-4b96-bba3-87dbd65eadfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:07.543634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-442e6adc-4732-4b96-bba3-87dbd65eadfd None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:07.543634 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-442e6adc-4732-4b96-bba3-87dbd65eadfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:07.554972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1340/2672] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:18:07.556435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31a250-ac43-45cc-a1fb-17f9a8bf2802 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:07.566673 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31a250-ac43-45cc-a1fb-17f9a8bf2802 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:07.572323 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eeebb-10ae-4b20-b66f-0bf474ca65af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:07.573102 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eeebb-10ae-4b20-b66f-0bf474ca65af admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:07.573495 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eeebb-10ae-4b20-b66f-0bf474ca65af admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:07.573871 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eeebb-10ae-4b20-b66f-0bf474ca65af admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:07.574716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961eeebb-10ae-4b20-b66f-0bf474ca65af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:18:07.575143 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961eeebb-10ae-4b20-b66f-0bf474ca65af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:07.576877 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961eeebb-10ae-4b20-b66f-0bf474ca65af admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:07.595900 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1333/2673] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:18:07.600227 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e6adc-4732-4b96-bba3-87dbd65eadfd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:07.609565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e6adc-4732-4b96-bba3-87dbd65eadfd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:07.614287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf2664-940c-46d9-a9a1-c2e4a723aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:07.615169 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf2664-940c-46d9-a9a1-c2e4a723aabf admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:07.615631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf2664-940c-46d9-a9a1-c2e4a723aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:07.616082 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf2664-940c-46d9-a9a1-c2e4a723aabf admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:07.616767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf2664-940c-46d9-a9a1-c2e4a723aabf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:07.618931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf2664-940c-46d9-a9a1-c2e4a723aabf admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:07.648602 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1341/2674] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:07 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:07.653416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eeebb-10ae-4b20-b66f-0bf474ca65af admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:07.666961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eeebb-10ae-4b20-b66f-0bf474ca65af admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:07.737948 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760554-5625-4134-bf0f-4783166ee2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:07.738892 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760554-5625-4134-bf0f-4783166ee2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:07.739354 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760554-5625-4134-bf0f-4783166ee2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:07.739765 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760554-5625-4134-bf0f-4783166ee2b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:07.740553 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6760554-5625-4134-bf0f-4783166ee2b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:07.742705 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6760554-5625-4134-bf0f-4783166ee2b6 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:07.745408 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf2664-940c-46d9-a9a1-c2e4a723aabf admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:07.747121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6edf2664-940c-46d9-a9a1-c2e4a723aabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:07.761476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf2664-940c-46d9-a9a1-c2e4a723aabf admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:07.766024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1334/2675] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:07 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:07.766174 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db2e2b-b481-402e-b86d-87fb5fc5431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:07.767124 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db2e2b-b481-402e-b86d-87fb5fc5431a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:07.767421 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db2e2b-b481-402e-b86d-87fb5fc5431a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:07.767714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db2e2b-b481-402e-b86d-87fb5fc5431a admin admin] PATH_INFO: `/v3/users/5c43635342d2453881a1591717353db9` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:07.768890 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db2e2b-b481-402e-b86d-87fb5fc5431a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c43635342d2453881a1591717353db9)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:07.770805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db2e2b-b481-402e-b86d-87fb5fc5431a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:07.771304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760554-5625-4134-bf0f-4783166ee2b6 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:07.785379 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760554-5625-4134-bf0f-4783166ee2b6 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:07.790777 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ca756-93b0-4db8-a24f-77186b1c3f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:07.791444 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ca756-93b0-4db8-a24f-77186b1c3f27 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:07.791759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ca756-93b0-4db8-a24f-77186b1c3f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:07.792035 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ca756-93b0-4db8-a24f-77186b1c3f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:07.792757 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ca756-93b0-4db8-a24f-77186b1c3f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:07.794342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ca756-93b0-4db8-a24f-77186b1c3f27 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:07.809739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1335/2676] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:07.810990 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ca756-93b0-4db8-a24f-77186b1c3f27 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:07.820197 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b5db2e2b-b481-402e-b86d-87fb5fc5431a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c43635342d2453881a1591717353db9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:07.820910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ca756-93b0-4db8-a24f-77186b1c3f27 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:07.825932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d1d00-ce91-4f13-b62e-e5333ef3ff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:07.826595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d1d00-ce91-4f13-b62e-e5333ef3ff93 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:07.826874 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d1d00-ce91-4f13-b62e-e5333ef3ff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:07.827152 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d1d00-ce91-4f13-b62e-e5333ef3ff93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:07.827924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d1d00-ce91-4f13-b62e-e5333ef3ff93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:07.829526 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d1d00-ce91-4f13-b62e-e5333ef3ff93 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:07.832744 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b5db2e2b-b481-402e-b86d-87fb5fc5431a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c43635342d2453881a1591717353db9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:07.840061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b5db2e2b-b481-402e-b86d-87fb5fc5431a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c43635342d2453881a1591717353db9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:07.840789 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b5db2e2b-b481-402e-b86d-87fb5fc5431a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c43635342d2453881a1591717353db9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:07.841465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b5db2e2b-b481-402e-b86d-87fb5fc5431a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c43635342d2453881a1591717353db9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:07.843762 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1336/2677] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:07.846710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d1d00-ce91-4f13-b62e-e5333ef3ff93 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:07.848686 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-292d1d00-ce91-4f13-b62e-e5333ef3ff93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:07.860076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1342/2678] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:07 2022] DELETE /identity/v3/users/5c43635342d2453881a1591717353db9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:07.864872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d1d00-ce91-4f13-b62e-e5333ef3ff93 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:07.921878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0da7d2-fe3b-45a0-a7d4-9a189dbad8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:07.922857 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0da7d2-fe3b-45a0-a7d4-9a189dbad8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:07.923135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0da7d2-fe3b-45a0-a7d4-9a189dbad8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:07.923407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0da7d2-fe3b-45a0-a7d4-9a189dbad8cc admin admin] PATH_INFO: `/v3/projects/263d991379d54043afa9f7da7c796ada/users/a5819d817d1c42ef9b8ccc67601a9ade/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:07.939074 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0da7d2-fe3b-45a0-a7d4-9a189dbad8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=263d991379d54043afa9f7da7c796ada, user_id=a5819d817d1c42ef9b8ccc67601a9ade, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:07.941773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0da7d2-fe3b-45a0-a7d4-9a189dbad8cc admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:07.955370 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1337/2679] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:07 2022] PUT /identity/v3/projects/263d991379d54043afa9f7da7c796ada/users/a5819d817d1c42ef9b8ccc67601a9ade/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:18:07.965751 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e1843-9943-4742-ba8a-f6fe4309ce66 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:07.966143 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e1843-9943-4742-ba8a-f6fe4309ce66 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:07.966484 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e1843-9943-4742-ba8a-f6fe4309ce66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:07.994415 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c24e1843-9943-4742-ba8a-f6fe4309ce66 None None] MFA Rules not processed for user `a5819d817d1c42ef9b8ccc67601a9ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:07.995659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c24e1843-9943-4742-ba8a-f6fe4309ce66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:08.046169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0da7d2-fe3b-45a0-a7d4-9a189dbad8cc admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:08.048061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-be0da7d2-fe3b-45a0-a7d4-9a189dbad8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:08.073838 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1343/2680] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:18:08.078330 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e1843-9943-4742-ba8a-f6fe4309ce66 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:08.116351 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0da7d2-fe3b-45a0-a7d4-9a189dbad8cc admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:08.121905 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96af26f-486d-4fd8-8b08-9c356c3532e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:08.122556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96af26f-486d-4fd8-8b08-9c356c3532e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:08.122838 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96af26f-486d-4fd8-8b08-9c356c3532e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:08.123175 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96af26f-486d-4fd8-8b08-9c356c3532e4 admin admin] PATH_INFO: `/v3/projects/633525064a1e4db68071036057947432` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:08.124316 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96af26f-486d-4fd8-8b08-9c356c3532e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=633525064a1e4db68071036057947432)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:08.126205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96af26f-486d-4fd8-8b08-9c356c3532e4 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:08.154334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e1843-9943-4742-ba8a-f6fe4309ce66 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:08.159313 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afa012-97b8-43c4-9665-cd3117d2c84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:08.160016 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afa012-97b8-43c4-9665-cd3117d2c84b admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:08.160314 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afa012-97b8-43c4-9665-cd3117d2c84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:08.160570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afa012-97b8-43c4-9665-cd3117d2c84b admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:08.161352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afa012-97b8-43c4-9665-cd3117d2c84b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:08.163291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afa012-97b8-43c4-9665-cd3117d2c84b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:08.173503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b96af26f-486d-4fd8-8b08-9c356c3532e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633525064a1e4db68071036057947432', 'request_id': 'req-b96af26f-486d-4fd8-8b08-9c356c3532e4'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:08.179135 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b96af26f-486d-4fd8-8b08-9c356c3532e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633525064a1e4db68071036057947432', 'request_id': 'req-b96af26f-486d-4fd8-8b08-9c356c3532e4'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:08.188121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b96af26f-486d-4fd8-8b08-9c356c3532e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633525064a1e4db68071036057947432', 'request_id': 'req-b96af26f-486d-4fd8-8b08-9c356c3532e4'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:08.189727 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1344/2681] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:08 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:08.194016 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afa012-97b8-43c4-9665-cd3117d2c84b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:08.204112 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b96af26f-486d-4fd8-8b08-9c356c3532e4 admin admin] The token cache is being invalidate because project 633525064a1e4db68071036057947432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:08.204401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b96af26f-486d-4fd8-8b08-9c356c3532e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:08.205065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b96af26f-486d-4fd8-8b08-9c356c3532e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:08.206612 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1338/2682] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:08 2022] DELETE /identity/v3/projects/633525064a1e4db68071036057947432 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:18:08.213029 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96af26f-486d-4fd8-8b08-9c356c3532e4 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:08.214452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b96af26f-486d-4fd8-8b08-9c356c3532e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:08.254930 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afa012-97b8-43c4-9665-cd3117d2c84b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:08.260024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f48bf-8f1d-4988-afc4-8192db1160e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:08.260684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f48bf-8f1d-4988-afc4-8192db1160e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:08.260964 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f48bf-8f1d-4988-afc4-8192db1160e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:08.261236 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f48bf-8f1d-4988-afc4-8192db1160e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:08.261915 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f48bf-8f1d-4988-afc4-8192db1160e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:08.263861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f48bf-8f1d-4988-afc4-8192db1160e7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:08.279367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96af26f-486d-4fd8-8b08-9c356c3532e4 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:08.285162 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c254d-fb9d-493c-b376-938d2f1bd206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:08.286045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c254d-fb9d-493c-b376-938d2f1bd206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:08.286324 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c254d-fb9d-493c-b376-938d2f1bd206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:08.286605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c254d-fb9d-493c-b376-938d2f1bd206 admin admin] PATH_INFO: `/v3/users/001485d3864441e1afda65584fca720e` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:08.287849 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c254d-fb9d-493c-b376-938d2f1bd206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=001485d3864441e1afda65584fca720e)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:08.290296 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c254d-fb9d-493c-b376-938d2f1bd206 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:08.291149 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1345/2683] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:08 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:08.295030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f48bf-8f1d-4988-afc4-8192db1160e7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:08.296622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-311f48bf-8f1d-4988-afc4-8192db1160e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:08.308771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f48bf-8f1d-4988-afc4-8192db1160e7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:08.313682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f89e9-a6e2-4149-9c9b-1ec5dca5f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:08.314364 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f89e9-a6e2-4149-9c9b-1ec5dca5f0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:08.314662 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f89e9-a6e2-4149-9c9b-1ec5dca5f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:08.314936 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f89e9-a6e2-4149-9c9b-1ec5dca5f0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:08.315672 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f89e9-a6e2-4149-9c9b-1ec5dca5f0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:08.317289 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f89e9-a6e2-4149-9c9b-1ec5dca5f0b9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:08.328481 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1346/2684] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:18:08.332527 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f89e9-a6e2-4149-9c9b-1ec5dca5f0b9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:08.341839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-684c254d-fb9d-493c-b376-938d2f1bd206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001485d3864441e1afda65584fca720e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:08.342479 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f89e9-a6e2-4149-9c9b-1ec5dca5f0b9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:08.342627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-684c254d-fb9d-493c-b376-938d2f1bd206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001485d3864441e1afda65584fca720e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:08.347044 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52818e6-b866-4c84-be55-72e8f1ef83df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:08.347939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52818e6-b866-4c84-be55-72e8f1ef83df admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:08.348222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52818e6-b866-4c84-be55-72e8f1ef83df admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:08.348541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52818e6-b866-4c84-be55-72e8f1ef83df admin admin] PATH_INFO: `/v3/projects/87c117e1b60a4409822c14880ff46c7b/users/060881cf8aab4cf6953c2d3e0a2a97f9/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:08.354784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-684c254d-fb9d-493c-b376-938d2f1bd206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001485d3864441e1afda65584fca720e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:08.362716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-684c254d-fb9d-493c-b376-938d2f1bd206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001485d3864441e1afda65584fca720e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:08.365019 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52818e6-b866-4c84-be55-72e8f1ef83df admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c117e1b60a4409822c14880ff46c7b, user_id=060881cf8aab4cf6953c2d3e0a2a97f9, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:08.366268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-684c254d-fb9d-493c-b376-938d2f1bd206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001485d3864441e1afda65584fca720e'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:08.368588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52818e6-b866-4c84-be55-72e8f1ef83df admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:08.381678 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1339/2685] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:08 2022] DELETE /identity/v3/users/001485d3864441e1afda65584fca720e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:08.385362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1347/2686] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:08 2022] PUT /identity/v3/projects/87c117e1b60a4409822c14880ff46c7b/users/060881cf8aab4cf6953c2d3e0a2a97f9/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:18:08.389038 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c254d-fb9d-493c-b376-938d2f1bd206 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:08.390509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-684c254d-fb9d-493c-b376-938d2f1bd206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:08.465712 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c254d-fb9d-493c-b376-938d2f1bd206 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:08.470345 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7e8cc-fe7e-4d76-a4bb-4d5cd4cebe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:08.471002 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7e8cc-fe7e-4d76-a4bb-4d5cd4cebe21 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:08.471278 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7e8cc-fe7e-4d76-a4bb-4d5cd4cebe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:08.471551 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7e8cc-fe7e-4d76-a4bb-4d5cd4cebe21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:08.472330 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7e8cc-fe7e-4d76-a4bb-4d5cd4cebe21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:08.473905 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7e8cc-fe7e-4d76-a4bb-4d5cd4cebe21 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:08.487462 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1340/2687] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:18:08.489420 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52818e6-b866-4c84-be55-72e8f1ef83df admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:08.555206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52818e6-b866-4c84-be55-72e8f1ef83df admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:08.560802 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d7689-256c-4673-8c73-1da638391af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:08.561810 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d7689-256c-4673-8c73-1da638391af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:08.561948 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d7689-256c-4673-8c73-1da638391af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:08.562229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d7689-256c-4673-8c73-1da638391af1 admin admin] PATH_INFO: `/v3/projects/87c117e1b60a4409822c14880ff46c7b/users/060881cf8aab4cf6953c2d3e0a2a97f9/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:08.564371 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d7689-256c-4673-8c73-1da638391af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c117e1b60a4409822c14880ff46c7b, user_id=060881cf8aab4cf6953c2d3e0a2a97f9, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:08.567082 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d7689-256c-4673-8c73-1da638391af1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:08.572813 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7e8cc-fe7e-4d76-a4bb-4d5cd4cebe21 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:08.575050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-4da7e8cc-fe7e-4d76-a4bb-4d5cd4cebe21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:08.579997 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1348/2688] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:08 2022] PUT /identity/v3/projects/87c117e1b60a4409822c14880ff46c7b/users/060881cf8aab4cf6953c2d3e0a2a97f9/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:08.590348 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7e8cc-fe7e-4d76-a4bb-4d5cd4cebe21 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:08.592515 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa701674-5f97-4f30-8c37-31777a41d219 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:08.592884 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa701674-5f97-4f30-8c37-31777a41d219 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:08.593265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa701674-5f97-4f30-8c37-31777a41d219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:08.637968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-fa701674-5f97-4f30-8c37-31777a41d219 None None] MFA Rules not processed for user `060881cf8aab4cf6953c2d3e0a2a97f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:08.639185 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fa701674-5f97-4f30-8c37-31777a41d219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:08.680401 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ef853-4f59-444c-b984-e23ca26ca823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:08.681716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ef853-4f59-444c-b984-e23ca26ca823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:08.682115 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ef853-4f59-444c-b984-e23ca26ca823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:08.682508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ef853-4f59-444c-b984-e23ca26ca823 admin admin] PATH_INFO: `/v3/projects/9930d916aa4647db82b94335bfb81105` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:08.684225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ef853-4f59-444c-b984-e23ca26ca823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9930d916aa4647db82b94335bfb81105)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:08.686397 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ef853-4f59-444c-b984-e23ca26ca823 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:08.716246 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1349/2689] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:08.737309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1f3ef853-4f59-444c-b984-e23ca26ca823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9930d916aa4647db82b94335bfb81105', 'request_id': 'req-1f3ef853-4f59-444c-b984-e23ca26ca823'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:08.737685 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa701674-5f97-4f30-8c37-31777a41d219 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:08.739321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fa701674-5f97-4f30-8c37-31777a41d219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:08.744727 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1f3ef853-4f59-444c-b984-e23ca26ca823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9930d916aa4647db82b94335bfb81105', 'request_id': 'req-1f3ef853-4f59-444c-b984-e23ca26ca823'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:08.753347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1f3ef853-4f59-444c-b984-e23ca26ca823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9930d916aa4647db82b94335bfb81105', 'request_id': 'req-1f3ef853-4f59-444c-b984-e23ca26ca823'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:08.767353 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1f3ef853-4f59-444c-b984-e23ca26ca823 admin admin] The token cache is being invalidate because project 9930d916aa4647db82b94335bfb81105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:08.767742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1f3ef853-4f59-444c-b984-e23ca26ca823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:08.768595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1f3ef853-4f59-444c-b984-e23ca26ca823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:08.770630 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1341/2690] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:08 2022] DELETE /identity/v3/projects/9930d916aa4647db82b94335bfb81105 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:08.776873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecb9de-eed3-4b7b-9f8f-165257e86f49 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:08.777236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecb9de-eed3-4b7b-9f8f-165257e86f49 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:08.777581 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecb9de-eed3-4b7b-9f8f-165257e86f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:08.798899 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-98ecb9de-eed3-4b7b-9f8f-165257e86f49 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:08.800499 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-98ecb9de-eed3-4b7b-9f8f-165257e86f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:08.809776 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa701674-5f97-4f30-8c37-31777a41d219 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:08.869657 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1342/2691] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:08.869897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6cdc08-71dd-44b0-b456-3aee13057865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:08.871186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cdc08-71dd-44b0-b456-3aee13057865 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:08.871638 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cdc08-71dd-44b0-b456-3aee13057865 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:08.871986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cdc08-71dd-44b0-b456-3aee13057865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:08.872437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8768f-2b83-422c-8f21-4092152b01d2 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:08.873341 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8768f-2b83-422c-8f21-4092152b01d2 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:08.873635 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8768f-2b83-422c-8f21-4092152b01d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:08.874449 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2c6cdc08-71dd-44b0-b456-3aee13057865 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:08.896902 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-93a8768f-2b83-422c-8f21-4092152b01d2 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:08.898121 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-93a8768f-2b83-422c-8f21-4092152b01d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:08.907744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1343/2692] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:18:08.911894 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8768f-2b83-422c-8f21-4092152b01d2 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:08.921794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8768f-2b83-422c-8f21-4092152b01d2 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:08.926875 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63861b-563e-4bee-93cf-ecd165e978ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:08.927526 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63861b-563e-4bee-93cf-ecd165e978ac admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:08.927842 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63861b-563e-4bee-93cf-ecd165e978ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:08.928116 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63861b-563e-4bee-93cf-ecd165e978ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:08.928838 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63861b-563e-4bee-93cf-ecd165e978ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:18:08.929141 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63861b-563e-4bee-93cf-ecd165e978ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:08.931391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63861b-563e-4bee-93cf-ecd165e978ac admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:08.947285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1344/2693] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:18:08.947285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63861b-563e-4bee-93cf-ecd165e978ac admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:08.947285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ec63861b-563e-4bee-93cf-ecd165e978ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:08.952646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6cdc08-71dd-44b0-b456-3aee13057865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:08.954511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6cdc08-71dd-44b0-b456-3aee13057865 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:08.964588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1350/2694] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:18:08.965269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6cdc08-71dd-44b0-b456-3aee13057865 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:08.975292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6cdc08-71dd-44b0-b456-3aee13057865 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:08.980011 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b466e2d-6086-43aa-b68e-c0a0e6717e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:08.980685 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b466e2d-6086-43aa-b68e-c0a0e6717e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:08.980939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b466e2d-6086-43aa-b68e-c0a0e6717e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:08.981212 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b466e2d-6086-43aa-b68e-c0a0e6717e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:08.981895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b466e2d-6086-43aa-b68e-c0a0e6717e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:08.983860 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b466e2d-6086-43aa-b68e-c0a0e6717e11 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:09.013393 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1351/2695] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:08 2022] POST /identity/v3/projects => generated 357 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:09.018043 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b466e2d-6086-43aa-b68e-c0a0e6717e11 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:09.018230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63861b-563e-4bee-93cf-ecd165e978ac admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:09.076448 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc133-052b-4c0b-81d6-174115f8fe75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:09.077176 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc133-052b-4c0b-81d6-174115f8fe75 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.077396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc133-052b-4c0b-81d6-174115f8fe75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.077771 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc133-052b-4c0b-81d6-174115f8fe75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.079953 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-fb8dc133-052b-4c0b-81d6-174115f8fe75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:09.097710 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b466e2d-6086-43aa-b68e-c0a0e6717e11 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:09.104043 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68460a-99ef-462e-81a7-e12f28074eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:09.104721 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68460a-99ef-462e-81a7-e12f28074eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.105000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68460a-99ef-462e-81a7-e12f28074eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.105273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68460a-99ef-462e-81a7-e12f28074eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.105958 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68460a-99ef-462e-81a7-e12f28074eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:09.107941 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68460a-99ef-462e-81a7-e12f28074eb9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:09.140673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1352/2696] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:09 2022] POST /identity/v3/users => generated 279 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:09.142775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68460a-99ef-462e-81a7-e12f28074eb9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:09.153292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68460a-99ef-462e-81a7-e12f28074eb9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:09.159413 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dc133-052b-4c0b-81d6-174115f8fe75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:09.159413 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dc133-052b-4c0b-81d6-174115f8fe75 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:09.160108 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45fe16-54ef-46cb-ae53-537b49bd5f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:09.160906 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45fe16-54ef-46cb-ae53-537b49bd5f69 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.161379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45fe16-54ef-46cb-ae53-537b49bd5f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.161779 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45fe16-54ef-46cb-ae53-537b49bd5f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.162627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45fe16-54ef-46cb-ae53-537b49bd5f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:09.167902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45fe16-54ef-46cb-ae53-537b49bd5f69 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:09.170534 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1345/2697] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:09.188659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1353/2698] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:09.190771 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc133-052b-4c0b-81d6-174115f8fe75 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:09.201021 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc133-052b-4c0b-81d6-174115f8fe75 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:09.213247 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd705d8-a047-421c-8637-da19476b675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:09.214030 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd705d8-a047-421c-8637-da19476b675a admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.214460 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd705d8-a047-421c-8637-da19476b675a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.215236 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd705d8-a047-421c-8637-da19476b675a admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.215518 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd705d8-a047-421c-8637-da19476b675a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:09.217266 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd705d8-a047-421c-8637-da19476b675a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:09.232790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1346/2699] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:09.236590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45fe16-54ef-46cb-ae53-537b49bd5f69 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:09.252360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45fe16-54ef-46cb-ae53-537b49bd5f69 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:09.257674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf07df-6ccd-4d24-ba91-f411410a2ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:09.258594 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf07df-6ccd-4d24-ba91-f411410a2ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.258881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf07df-6ccd-4d24-ba91-f411410a2ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.259156 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf07df-6ccd-4d24-ba91-f411410a2ba0 admin admin] PATH_INFO: `/v3/projects/deb469535b574dfb808cb4266279144f/users/1b7a63f1723e46a8a5620c62704b1020/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.276853 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf07df-6ccd-4d24-ba91-f411410a2ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb469535b574dfb808cb4266279144f, user_id=1b7a63f1723e46a8a5620c62704b1020, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:09.280363 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf07df-6ccd-4d24-ba91-f411410a2ba0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:09.298876 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1354/2700] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:09 2022] PUT /identity/v3/projects/deb469535b574dfb808cb4266279144f/users/1b7a63f1723e46a8a5620c62704b1020/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:18:09.310785 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f438ce-114a-476e-9b09-9be2c6ba86a7 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.311174 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f438ce-114a-476e-9b09-9be2c6ba86a7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.311556 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f438ce-114a-476e-9b09-9be2c6ba86a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.342125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-72f438ce-114a-476e-9b09-9be2c6ba86a7 None None] MFA Rules not processed for user `1b7a63f1723e46a8a5620c62704b1020`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:09.343494 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-72f438ce-114a-476e-9b09-9be2c6ba86a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:09.380277 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf07df-6ccd-4d24-ba91-f411410a2ba0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:09.382320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-18cf07df-6ccd-4d24-ba91-f411410a2ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:09.433191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1347/2701] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:09 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:09.437714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f438ce-114a-476e-9b09-9be2c6ba86a7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:09.454604 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf07df-6ccd-4d24-ba91-f411410a2ba0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:09.459831 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a00e5-dbe6-4afa-8de3-65706f08f7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:09.460853 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a00e5-dbe6-4afa-8de3-65706f08f7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.461152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a00e5-dbe6-4afa-8de3-65706f08f7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.461537 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a00e5-dbe6-4afa-8de3-65706f08f7b1 admin admin] PATH_INFO: `/v3/users/a5819d817d1c42ef9b8ccc67601a9ade` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.463264 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a00e5-dbe6-4afa-8de3-65706f08f7b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5819d817d1c42ef9b8ccc67601a9ade)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:09.465879 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a00e5-dbe6-4afa-8de3-65706f08f7b1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:09.525936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f438ce-114a-476e-9b09-9be2c6ba86a7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:09.526147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ea1a00e5-dbe6-4afa-8de3-65706f08f7b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5819d817d1c42ef9b8ccc67601a9ade'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:09.530587 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130756c5-8a0e-4562-b8f0-4068a3fe7bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:09.531245 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130756c5-8a0e-4562-b8f0-4068a3fe7bae admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.531534 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130756c5-8a0e-4562-b8f0-4068a3fe7bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.531843 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130756c5-8a0e-4562-b8f0-4068a3fe7bae admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.532523 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130756c5-8a0e-4562-b8f0-4068a3fe7bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:09.534409 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130756c5-8a0e-4562-b8f0-4068a3fe7bae admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:09.538850 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ea1a00e5-dbe6-4afa-8de3-65706f08f7b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5819d817d1c42ef9b8ccc67601a9ade'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:09.545887 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ea1a00e5-dbe6-4afa-8de3-65706f08f7b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5819d817d1c42ef9b8ccc67601a9ade'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:09.546677 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ea1a00e5-dbe6-4afa-8de3-65706f08f7b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5819d817d1c42ef9b8ccc67601a9ade'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:09.547287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ea1a00e5-dbe6-4afa-8de3-65706f08f7b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5819d817d1c42ef9b8ccc67601a9ade'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:09.562550 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1355/2702] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:09 2022] DELETE /identity/v3/users/a5819d817d1c42ef9b8ccc67601a9ade => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:18:09.567671 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1348/2703] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:09 2022] POST /identity/v3/projects => generated 355 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:09.570160 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130756c5-8a0e-4562-b8f0-4068a3fe7bae admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:09.570810 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7eb36-a83b-4ab5-ad74-46f9449e0bda None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.571857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7eb36-a83b-4ab5-ad74-46f9449e0bda None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.572189 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7eb36-a83b-4ab5-ad74-46f9449e0bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.573162 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-130756c5-8a0e-4562-b8f0-4068a3fe7bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:09.589979 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a6a7eb36-a83b-4ab5-ad74-46f9449e0bda None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:09.591197 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a6a7eb36-a83b-4ab5-ad74-46f9449e0bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:09.643649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130756c5-8a0e-4562-b8f0-4068a3fe7bae admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:09.648752 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2fc9a-40dd-40d1-bd17-f37500ad29dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:09.649477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2fc9a-40dd-40d1-bd17-f37500ad29dd admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.650097 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2fc9a-40dd-40d1-bd17-f37500ad29dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.650097 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2fc9a-40dd-40d1-bd17-f37500ad29dd admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.650956 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2fc9a-40dd-40d1-bd17-f37500ad29dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:09.653282 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2fc9a-40dd-40d1-bd17-f37500ad29dd admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:09.653430 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1356/2704] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:09.664567 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7eb36-a83b-4ab5-ad74-46f9449e0bda None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:09.666975 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a6a7eb36-a83b-4ab5-ad74-46f9449e0bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:09.675910 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1349/2705] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:09 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:09.681819 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2fc9a-40dd-40d1-bd17-f37500ad29dd admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:09.694058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2fc9a-40dd-40d1-bd17-f37500ad29dd admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:09.699825 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f7130-f5aa-446d-abea-75c280b49859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:09.700537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f7130-f5aa-446d-abea-75c280b49859 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.700821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f7130-f5aa-446d-abea-75c280b49859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.701094 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f7130-f5aa-446d-abea-75c280b49859 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.701821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f7130-f5aa-446d-abea-75c280b49859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:09.703400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f7130-f5aa-446d-abea-75c280b49859 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:09.714723 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1350/2706] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:18:09.720239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f7130-f5aa-446d-abea-75c280b49859 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:09.732721 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f7130-f5aa-446d-abea-75c280b49859 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:09.737858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a6b41-6db7-462e-b523-2c7382fb3b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:09.738805 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a6b41-6db7-462e-b523-2c7382fb3b77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.739186 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a6b41-6db7-462e-b523-2c7382fb3b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.739537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a6b41-6db7-462e-b523-2c7382fb3b77 admin admin] PATH_INFO: `/v3/projects/a4657c1302ba41bb8524c88f4e208c5b/users/4fb2329fb7d04ba3bd88bc547dd3d628/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.740597 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7eb36-a83b-4ab5-ad74-46f9449e0bda None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:09.744892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853849a0-778f-477b-80e3-8dbd91bebdc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:09.745622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853849a0-778f-477b-80e3-8dbd91bebdc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.745979 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853849a0-778f-477b-80e3-8dbd91bebdc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.746325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853849a0-778f-477b-80e3-8dbd91bebdc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.756347 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853849a0-778f-477b-80e3-8dbd91bebdc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:09.757475 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a6b41-6db7-462e-b523-2c7382fb3b77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4657c1302ba41bb8524c88f4e208c5b, user_id=4fb2329fb7d04ba3bd88bc547dd3d628, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:09.759266 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853849a0-778f-477b-80e3-8dbd91bebdc4 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:09.761410 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a6b41-6db7-462e-b523-2c7382fb3b77 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:09.769962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1357/2707] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:18:09.781030 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1351/2708] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:09 2022] PUT /identity/v3/projects/a4657c1302ba41bb8524c88f4e208c5b/users/4fb2329fb7d04ba3bd88bc547dd3d628/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:09.784918 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853849a0-778f-477b-80e3-8dbd91bebdc4 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:09.795309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853849a0-778f-477b-80e3-8dbd91bebdc4 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:09.856513 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be4905-8b99-4996-899f-2621edcbd74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:09.857242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be4905-8b99-4996-899f-2621edcbd74d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.857529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be4905-8b99-4996-899f-2621edcbd74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.857806 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be4905-8b99-4996-899f-2621edcbd74d admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.858564 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be4905-8b99-4996-899f-2621edcbd74d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:09.860416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be4905-8b99-4996-899f-2621edcbd74d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:09.874275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1358/2709] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:09.876367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a6b41-6db7-462e-b523-2c7382fb3b77 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:09.889076 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a6b41-6db7-462e-b523-2c7382fb3b77 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:09.894740 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a529ea-2b7e-4587-8ac7-e057bf8596fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:09.895829 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a529ea-2b7e-4587-8ac7-e057bf8596fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.896108 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a529ea-2b7e-4587-8ac7-e057bf8596fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.896381 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a529ea-2b7e-4587-8ac7-e057bf8596fe admin admin] PATH_INFO: `/v3/projects/a4657c1302ba41bb8524c88f4e208c5b/users/4fb2329fb7d04ba3bd88bc547dd3d628/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.898526 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a529ea-2b7e-4587-8ac7-e057bf8596fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4657c1302ba41bb8524c88f4e208c5b, user_id=4fb2329fb7d04ba3bd88bc547dd3d628, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:09.901537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a529ea-2b7e-4587-8ac7-e057bf8596fe admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:09.912156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1352/2710] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:09 2022] PUT /identity/v3/projects/a4657c1302ba41bb8524c88f4e208c5b/users/4fb2329fb7d04ba3bd88bc547dd3d628/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:09.922758 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04163d-5697-44f7-b755-8f06087bd58d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:09.923068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04163d-5697-44f7-b755-8f06087bd58d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:09.923345 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04163d-5697-44f7-b755-8f06087bd58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:09.951557 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cc04163d-5697-44f7-b755-8f06087bd58d None None] MFA Rules not processed for user `4fb2329fb7d04ba3bd88bc547dd3d628`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:09.952844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cc04163d-5697-44f7-b755-8f06087bd58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:10.025030 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1359/2711] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:09 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:10.036968 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a529ea-2b7e-4587-8ac7-e057bf8596fe admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:10.038673 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-21a529ea-2b7e-4587-8ac7-e057bf8596fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:10.100745 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a529ea-2b7e-4587-8ac7-e057bf8596fe admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:10.105332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67962cb9-3c49-4fd1-a0f5-9c2cfbc89050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:10.105995 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67962cb9-3c49-4fd1-a0f5-9c2cfbc89050 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:10.106277 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67962cb9-3c49-4fd1-a0f5-9c2cfbc89050 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:10.106552 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67962cb9-3c49-4fd1-a0f5-9c2cfbc89050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:10.116689 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67962cb9-3c49-4fd1-a0f5-9c2cfbc89050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:10.118854 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67962cb9-3c49-4fd1-a0f5-9c2cfbc89050 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:10.132933 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1353/2712] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:10 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:10.212859 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04163d-5697-44f7-b755-8f06087bd58d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:10.228621 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04163d-5697-44f7-b755-8f06087bd58d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:10.234511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057f85d-ade4-4c27-9adf-86b720b5b279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:10.235438 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057f85d-ade4-4c27-9adf-86b720b5b279 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:10.236190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057f85d-ade4-4c27-9adf-86b720b5b279 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:10.237034 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057f85d-ade4-4c27-9adf-86b720b5b279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:10.238805 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4057f85d-ade4-4c27-9adf-86b720b5b279 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:10.262545 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67962cb9-3c49-4fd1-a0f5-9c2cfbc89050 service cinder] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:10.264131 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-67962cb9-3c49-4fd1-a0f5-9c2cfbc89050 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:10.323049 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057f85d-ade4-4c27-9adf-86b720b5b279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:10.324562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057f85d-ade4-4c27-9adf-86b720b5b279 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:10.334609 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1360/2713] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:10 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:10.368047 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67962cb9-3c49-4fd1-a0f5-9c2cfbc89050 service cinder] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:10.374994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eafaa-f9e2-46ad-af0a-ce7549a8be02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:10.376358 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eafaa-f9e2-46ad-af0a-ce7549a8be02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:10.376646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eafaa-f9e2-46ad-af0a-ce7549a8be02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:10.377020 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eafaa-f9e2-46ad-af0a-ce7549a8be02 admin admin] PATH_INFO: `/v3/projects/263d991379d54043afa9f7da7c796ada` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:10.378286 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071eafaa-f9e2-46ad-af0a-ce7549a8be02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=263d991379d54043afa9f7da7c796ada)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:10.380256 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071eafaa-f9e2-46ad-af0a-ce7549a8be02 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:10.432529 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-071eafaa-f9e2-46ad-af0a-ce7549a8be02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '263d991379d54043afa9f7da7c796ada', 'request_id': 'req-071eafaa-f9e2-46ad-af0a-ce7549a8be02'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:10.438767 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-071eafaa-f9e2-46ad-af0a-ce7549a8be02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '263d991379d54043afa9f7da7c796ada', 'request_id': 'req-071eafaa-f9e2-46ad-af0a-ce7549a8be02'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:10.456083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-071eafaa-f9e2-46ad-af0a-ce7549a8be02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '263d991379d54043afa9f7da7c796ada', 'request_id': 'req-071eafaa-f9e2-46ad-af0a-ce7549a8be02'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:10.469623 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-071eafaa-f9e2-46ad-af0a-ce7549a8be02 admin admin] The token cache is being invalidate because project 263d991379d54043afa9f7da7c796ada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:10.469917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-071eafaa-f9e2-46ad-af0a-ce7549a8be02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:10.470755 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-071eafaa-f9e2-46ad-af0a-ce7549a8be02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:10.472717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1354/2714] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:10 2022] DELETE /identity/v3/projects/263d991379d54043afa9f7da7c796ada => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:10.476622 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057f85d-ade4-4c27-9adf-86b720b5b279 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:10.510298 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057f85d-ade4-4c27-9adf-86b720b5b279 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:10.589111 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5861dda-40af-407d-b17e-6bb31772c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:10.589986 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5861dda-40af-407d-b17e-6bb31772c1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:10.590292 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5861dda-40af-407d-b17e-6bb31772c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:10.590620 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5861dda-40af-407d-b17e-6bb31772c1a1 admin admin] PATH_INFO: `/v3/users/060881cf8aab4cf6953c2d3e0a2a97f9` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:10.592016 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5861dda-40af-407d-b17e-6bb31772c1a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=060881cf8aab4cf6953c2d3e0a2a97f9)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:10.593946 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5861dda-40af-407d-b17e-6bb31772c1a1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:10.644607 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f5861dda-40af-407d-b17e-6bb31772c1a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060881cf8aab4cf6953c2d3e0a2a97f9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:10.656559 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f5861dda-40af-407d-b17e-6bb31772c1a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060881cf8aab4cf6953c2d3e0a2a97f9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:10.663879 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f5861dda-40af-407d-b17e-6bb31772c1a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060881cf8aab4cf6953c2d3e0a2a97f9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:10.665395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f5861dda-40af-407d-b17e-6bb31772c1a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060881cf8aab4cf6953c2d3e0a2a97f9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:10.665857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f5861dda-40af-407d-b17e-6bb31772c1a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060881cf8aab4cf6953c2d3e0a2a97f9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:10.679780 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1361/2715] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:10 2022] DELETE /identity/v3/users/060881cf8aab4cf6953c2d3e0a2a97f9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:10.960055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eafaa-f9e2-46ad-af0a-ce7549a8be02 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:10.965436 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-071eafaa-f9e2-46ad-af0a-ce7549a8be02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:10.977975 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eafaa-f9e2-46ad-af0a-ce7549a8be02 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:11.038986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc15710-cf4e-4748-8e13-ed1d0def74ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:11.039963 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc15710-cf4e-4748-8e13-ed1d0def74ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:11.040305 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc15710-cf4e-4748-8e13-ed1d0def74ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:11.040588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc15710-cf4e-4748-8e13-ed1d0def74ca admin admin] PATH_INFO: `/v3/projects/87c117e1b60a4409822c14880ff46c7b` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:11.041775 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc15710-cf4e-4748-8e13-ed1d0def74ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c117e1b60a4409822c14880ff46c7b)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:11.043769 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc15710-cf4e-4748-8e13-ed1d0def74ca admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:11.102006 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8cc15710-cf4e-4748-8e13-ed1d0def74ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c117e1b60a4409822c14880ff46c7b', 'request_id': 'req-8cc15710-cf4e-4748-8e13-ed1d0def74ca'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:11.108946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8cc15710-cf4e-4748-8e13-ed1d0def74ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c117e1b60a4409822c14880ff46c7b', 'request_id': 'req-8cc15710-cf4e-4748-8e13-ed1d0def74ca'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:11.127738 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8cc15710-cf4e-4748-8e13-ed1d0def74ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c117e1b60a4409822c14880ff46c7b', 'request_id': 'req-8cc15710-cf4e-4748-8e13-ed1d0def74ca'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:11.148911 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8cc15710-cf4e-4748-8e13-ed1d0def74ca admin admin] The token cache is being invalidate because project 87c117e1b60a4409822c14880ff46c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:11.149461 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8cc15710-cf4e-4748-8e13-ed1d0def74ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:11.150014 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-8cc15710-cf4e-4748-8e13-ed1d0def74ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:11.152092 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1355/2716] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:10 2022] DELETE /identity/v3/projects/87c117e1b60a4409822c14880ff46c7b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:11.157616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bbead-a2e8-4ec3-b617-15132e67250c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:11.157908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bbead-a2e8-4ec3-b617-15132e67250c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:11.158182 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bbead-a2e8-4ec3-b617-15132e67250c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:11.184135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-685bbead-a2e8-4ec3-b617-15132e67250c None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:11.185607 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-685bbead-a2e8-4ec3-b617-15132e67250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:11.259626 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1362/2717] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:11.268529 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83043597-1f8c-4a47-9507-24be7de36e44 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:11.269370 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83043597-1f8c-4a47-9507-24be7de36e44 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:11.270024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83043597-1f8c-4a47-9507-24be7de36e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:11.296289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-83043597-1f8c-4a47-9507-24be7de36e44 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:11.298402 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-83043597-1f8c-4a47-9507-24be7de36e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:11.311590 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1356/2718] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:18:11.316152 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bbead-a2e8-4ec3-b617-15132e67250c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:11.327232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bbead-a2e8-4ec3-b617-15132e67250c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:11.333227 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbf802-64a1-4b4b-a45a-56af13d675f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:11.333993 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbf802-64a1-4b4b-a45a-56af13d675f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:11.334736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbf802-64a1-4b4b-a45a-56af13d675f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:11.334736 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbf802-64a1-4b4b-a45a-56af13d675f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:11.335309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbf802-64a1-4b4b-a45a-56af13d675f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:18:11.335625 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbf802-64a1-4b4b-a45a-56af13d675f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:11.337698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbf802-64a1-4b4b-a45a-56af13d675f9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:11.358089 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1363/2719] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:18:11.359391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83043597-1f8c-4a47-9507-24be7de36e44 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:11.370773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83043597-1f8c-4a47-9507-24be7de36e44 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:11.385585 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4febd0-346e-48bf-9831-b143c15ae641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:11.386264 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4febd0-346e-48bf-9831-b143c15ae641 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:11.386544 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4febd0-346e-48bf-9831-b143c15ae641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:11.386811 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4febd0-346e-48bf-9831-b143c15ae641 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:11.387508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4febd0-346e-48bf-9831-b143c15ae641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:11.389482 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4febd0-346e-48bf-9831-b143c15ae641 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:11.434025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1357/2720] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:11 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:11.437930 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbf802-64a1-4b4b-a45a-56af13d675f9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:11.448902 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbf802-64a1-4b4b-a45a-56af13d675f9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:11.527288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462c2d8-5ea4-4651-bea0-44d2264d7621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:11.528575 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462c2d8-5ea4-4651-bea0-44d2264d7621 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:11.529139 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462c2d8-5ea4-4651-bea0-44d2264d7621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:11.529345 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462c2d8-5ea4-4651-bea0-44d2264d7621 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:11.536014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462c2d8-5ea4-4651-bea0-44d2264d7621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:11.538229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462c2d8-5ea4-4651-bea0-44d2264d7621 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:11.589925 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1364/2721] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:11 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:11.594291 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4febd0-346e-48bf-9831-b143c15ae641 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:11.607030 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4febd0-346e-48bf-9831-b143c15ae641 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:11.618302 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ea6b1-4a34-4bbc-b37c-6c46daa2031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:11.619142 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ea6b1-4a34-4bbc-b37c-6c46daa2031f admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:11.621661 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ea6b1-4a34-4bbc-b37c-6c46daa2031f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:11.623309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ea6b1-4a34-4bbc-b37c-6c46daa2031f admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:11.624533 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ea6b1-4a34-4bbc-b37c-6c46daa2031f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:11.627823 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ea6b1-4a34-4bbc-b37c-6c46daa2031f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:11.647644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1358/2722] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:11.651012 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462c2d8-5ea4-4651-bea0-44d2264d7621 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:11.662945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462c2d8-5ea4-4651-bea0-44d2264d7621 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:11.669528 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95337aa-c95e-44e3-8af0-9bcabd8d6da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:11.670665 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95337aa-c95e-44e3-8af0-9bcabd8d6da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:11.670976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95337aa-c95e-44e3-8af0-9bcabd8d6da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:11.671163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95337aa-c95e-44e3-8af0-9bcabd8d6da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:11.672153 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95337aa-c95e-44e3-8af0-9bcabd8d6da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:11.675061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95337aa-c95e-44e3-8af0-9bcabd8d6da5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:11.692031 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1365/2723] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:11.695058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ea6b1-4a34-4bbc-b37c-6c46daa2031f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:11.706655 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ea6b1-4a34-4bbc-b37c-6c46daa2031f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:11.714863 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39455b1-5573-42e9-a822-0bfd10165871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:11.716468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39455b1-5573-42e9-a822-0bfd10165871 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:11.717384 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39455b1-5573-42e9-a822-0bfd10165871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:11.717918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39455b1-5573-42e9-a822-0bfd10165871 admin admin] PATH_INFO: `/v3/projects/8a756546d7eb416ebf4ab750089cb496/users/25a6effad5c4484d939dfc427c729029/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:11.741202 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39455b1-5573-42e9-a822-0bfd10165871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a756546d7eb416ebf4ab750089cb496, user_id=25a6effad5c4484d939dfc427c729029, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:11.745578 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39455b1-5573-42e9-a822-0bfd10165871 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:11.774668 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1359/2724] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:11 2022] PUT /identity/v3/projects/8a756546d7eb416ebf4ab750089cb496/users/25a6effad5c4484d939dfc427c729029/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:11.777420 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af97fed-48f6-4e6f-a1af-59c80b70aaee None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:11.778067 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af97fed-48f6-4e6f-a1af-59c80b70aaee None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:11.778810 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af97fed-48f6-4e6f-a1af-59c80b70aaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:11.829428 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1af97fed-48f6-4e6f-a1af-59c80b70aaee None None] MFA Rules not processed for user `25a6effad5c4484d939dfc427c729029`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:11.834287 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1af97fed-48f6-4e6f-a1af-59c80b70aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:11.916840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1366/2725] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:11.931059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39455b1-5573-42e9-a822-0bfd10165871 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:11.933333 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c39455b1-5573-42e9-a822-0bfd10165871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:12.018738 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39455b1-5573-42e9-a822-0bfd10165871 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:12.032555 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f74f4d-5f6d-4b5d-8dfd-d15861a47145 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25519cdc25244a0b039ce3097c328d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:12.033297 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f74f4d-5f6d-4b5d-8dfd-d15861a47145 service glance] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:12.033585 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f74f4d-5f6d-4b5d-8dfd-d15861a47145 service glance] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:12.033862 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f74f4d-5f6d-4b5d-8dfd-d15861a47145 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:12.045300 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f74f4d-5f6d-4b5d-8dfd-d15861a47145 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:12.047083 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f74f4d-5f6d-4b5d-8dfd-d15861a47145 service glance] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:12.063570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1360/2726] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:12.808714 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af97fed-48f6-4e6f-a1af-59c80b70aaee None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:12.810106 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1af97fed-48f6-4e6f-a1af-59c80b70aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:12.882662 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af97fed-48f6-4e6f-a1af-59c80b70aaee None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:12.894036 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9e065-443e-4d6d-83dd-77de8ae0da7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:12.896656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9e065-443e-4d6d-83dd-77de8ae0da7f service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:12.897232 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9e065-443e-4d6d-83dd-77de8ae0da7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:12.897691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9e065-443e-4d6d-83dd-77de8ae0da7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:12.900465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8fd9e065-443e-4d6d-83dd-77de8ae0da7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:12.969524 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9e065-443e-4d6d-83dd-77de8ae0da7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:12.970979 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9e065-443e-4d6d-83dd-77de8ae0da7f service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:12.983135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1367/2727] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:18.390909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f74f4d-5f6d-4b5d-8dfd-d15861a47145 service glance] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:18.400984 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f74f4d-5f6d-4b5d-8dfd-d15861a47145 service glance] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:18.404489 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba640e35-5dba-46d2-87bc-454fd680cb37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:18.405116 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba640e35-5dba-46d2-87bc-454fd680cb37 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:18.405400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba640e35-5dba-46d2-87bc-454fd680cb37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:18.405670 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba640e35-5dba-46d2-87bc-454fd680cb37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:18.407388 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ba640e35-5dba-46d2-87bc-454fd680cb37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:18.468805 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba640e35-5dba-46d2-87bc-454fd680cb37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:18.470232 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba640e35-5dba-46d2-87bc-454fd680cb37 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:18.479804 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1361/2728] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:24.791663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9e065-443e-4d6d-83dd-77de8ae0da7f service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:24.793662 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8fd9e065-443e-4d6d-83dd-77de8ae0da7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:24.810820 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9e065-443e-4d6d-83dd-77de8ae0da7f service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:24.815335 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e4a15-730b-40af-a2d4-18e00c898e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:24.816293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e4a15-730b-40af-a2d4-18e00c898e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:24.816578 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e4a15-730b-40af-a2d4-18e00c898e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:24.816844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e4a15-730b-40af-a2d4-18e00c898e6a admin admin] PATH_INFO: `/v3/users/4302f72c503341d4a5367613edf38055` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:24.818212 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e4a15-730b-40af-a2d4-18e00c898e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4302f72c503341d4a5367613edf38055)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:24.820490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e4a15-730b-40af-a2d4-18e00c898e6a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:24.884870 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a4e4a15-730b-40af-a2d4-18e00c898e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4302f72c503341d4a5367613edf38055'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:24.893144 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a4e4a15-730b-40af-a2d4-18e00c898e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4302f72c503341d4a5367613edf38055'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:24.900260 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a4e4a15-730b-40af-a2d4-18e00c898e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4302f72c503341d4a5367613edf38055'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:24.900966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a4e4a15-730b-40af-a2d4-18e00c898e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4302f72c503341d4a5367613edf38055'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:24.901566 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4a4e4a15-730b-40af-a2d4-18e00c898e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4302f72c503341d4a5367613edf38055'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:24.915226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1368/2729] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:24 2022] DELETE /identity/v3/users/4302f72c503341d4a5367613edf38055 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:25.096049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba640e35-5dba-46d2-87bc-454fd680cb37 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:25.107172 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba640e35-5dba-46d2-87bc-454fd680cb37 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:25.173784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18734a-e3f6-450c-aa6e-79da7a29c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:25.174649 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18734a-e3f6-450c-aa6e-79da7a29c03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:25.174938 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18734a-e3f6-450c-aa6e-79da7a29c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:25.175218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18734a-e3f6-450c-aa6e-79da7a29c03a admin admin] PATH_INFO: `/v3/projects/2630e0044e5f4f28b8d2adcfeaf0c604` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:25.176425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18734a-e3f6-450c-aa6e-79da7a29c03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2630e0044e5f4f28b8d2adcfeaf0c604)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:25.178318 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18734a-e3f6-450c-aa6e-79da7a29c03a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:25.225588 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2a18734a-e3f6-450c-aa6e-79da7a29c03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2630e0044e5f4f28b8d2adcfeaf0c604', 'request_id': 'req-2a18734a-e3f6-450c-aa6e-79da7a29c03a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:25.231788 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2a18734a-e3f6-450c-aa6e-79da7a29c03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2630e0044e5f4f28b8d2adcfeaf0c604', 'request_id': 'req-2a18734a-e3f6-450c-aa6e-79da7a29c03a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:25.238884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2a18734a-e3f6-450c-aa6e-79da7a29c03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2630e0044e5f4f28b8d2adcfeaf0c604', 'request_id': 'req-2a18734a-e3f6-450c-aa6e-79da7a29c03a'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:25.250523 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2a18734a-e3f6-450c-aa6e-79da7a29c03a admin admin] The token cache is being invalidate because project 2630e0044e5f4f28b8d2adcfeaf0c604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:25.250810 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2a18734a-e3f6-450c-aa6e-79da7a29c03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:25.251433 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2a18734a-e3f6-450c-aa6e-79da7a29c03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:25.252986 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1362/2730] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:25 2022] DELETE /identity/v3/projects/2630e0044e5f4f28b8d2adcfeaf0c604 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:25.257018 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e4a15-730b-40af-a2d4-18e00c898e6a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:25.258586 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4a4e4a15-730b-40af-a2d4-18e00c898e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:25.271199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e4a15-730b-40af-a2d4-18e00c898e6a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:25.328383 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63541111-a9f0-4208-968b-908f2c6af78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:25.329253 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63541111-a9f0-4208-968b-908f2c6af78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:25.329538 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63541111-a9f0-4208-968b-908f2c6af78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:25.329843 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63541111-a9f0-4208-968b-908f2c6af78a admin admin] PATH_INFO: `/v3/users/870dd4a30bf14ec78e3263b72f936628` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:25.331027 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63541111-a9f0-4208-968b-908f2c6af78a admin admin] RBAC: Authorizing `identity:delete_user(user_id=870dd4a30bf14ec78e3263b72f936628)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:25.333008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63541111-a9f0-4208-968b-908f2c6af78a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:25.380908 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-63541111-a9f0-4208-968b-908f2c6af78a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870dd4a30bf14ec78e3263b72f936628'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:25.392770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-63541111-a9f0-4208-968b-908f2c6af78a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870dd4a30bf14ec78e3263b72f936628'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:25.400084 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-63541111-a9f0-4208-968b-908f2c6af78a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870dd4a30bf14ec78e3263b72f936628'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:25.400759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-63541111-a9f0-4208-968b-908f2c6af78a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870dd4a30bf14ec78e3263b72f936628'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:25.401358 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-63541111-a9f0-4208-968b-908f2c6af78a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870dd4a30bf14ec78e3263b72f936628'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:25.414250 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1369/2731] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:25 2022] DELETE /identity/v3/users/870dd4a30bf14ec78e3263b72f936628 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:25.591154 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18734a-e3f6-450c-aa6e-79da7a29c03a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:25.592837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2a18734a-e3f6-450c-aa6e-79da7a29c03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:25.622545 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18734a-e3f6-450c-aa6e-79da7a29c03a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:25.686750 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88863f-293f-48cf-8faa-87297f0711ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:25.687742 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88863f-293f-48cf-8faa-87297f0711ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:25.688041 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88863f-293f-48cf-8faa-87297f0711ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:25.688331 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88863f-293f-48cf-8faa-87297f0711ea admin admin] PATH_INFO: `/v3/projects/21299fda6d7a4f278b2594739476b380` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:25.689652 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88863f-293f-48cf-8faa-87297f0711ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=21299fda6d7a4f278b2594739476b380)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:25.691570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88863f-293f-48cf-8faa-87297f0711ea admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:25.740565 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0f88863f-293f-48cf-8faa-87297f0711ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21299fda6d7a4f278b2594739476b380', 'request_id': 'req-0f88863f-293f-48cf-8faa-87297f0711ea'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:25.746484 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0f88863f-293f-48cf-8faa-87297f0711ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21299fda6d7a4f278b2594739476b380', 'request_id': 'req-0f88863f-293f-48cf-8faa-87297f0711ea'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:25.753920 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0f88863f-293f-48cf-8faa-87297f0711ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21299fda6d7a4f278b2594739476b380', 'request_id': 'req-0f88863f-293f-48cf-8faa-87297f0711ea'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:25.766438 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0f88863f-293f-48cf-8faa-87297f0711ea admin admin] The token cache is being invalidate because project 21299fda6d7a4f278b2594739476b380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:25.766728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0f88863f-293f-48cf-8faa-87297f0711ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:25.767379 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-0f88863f-293f-48cf-8faa-87297f0711ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:25.768980 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1363/2732] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:25 2022] DELETE /identity/v3/projects/21299fda6d7a4f278b2594739476b380 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:28.920000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63541111-a9f0-4208-968b-908f2c6af78a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:28.921491 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-63541111-a9f0-4208-968b-908f2c6af78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:28.934533 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63541111-a9f0-4208-968b-908f2c6af78a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:28.988615 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8bf9c-b848-4bb5-89ac-04c0aa3aa3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:28.989474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8bf9c-b848-4bb5-89ac-04c0aa3aa3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:28.989753 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8bf9c-b848-4bb5-89ac-04c0aa3aa3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:28.990078 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8bf9c-b848-4bb5-89ac-04c0aa3aa3ca admin admin] PATH_INFO: `/v3/users/1b7a63f1723e46a8a5620c62704b1020` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:28.991198 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8bf9c-b848-4bb5-89ac-04c0aa3aa3ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b7a63f1723e46a8a5620c62704b1020)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:28.994995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8bf9c-b848-4bb5-89ac-04c0aa3aa3ca admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:29.043880 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4ab8bf9c-b848-4bb5-89ac-04c0aa3aa3ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b7a63f1723e46a8a5620c62704b1020'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:29.059041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4ab8bf9c-b848-4bb5-89ac-04c0aa3aa3ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b7a63f1723e46a8a5620c62704b1020'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:29.067962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4ab8bf9c-b848-4bb5-89ac-04c0aa3aa3ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b7a63f1723e46a8a5620c62704b1020'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:29.068686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4ab8bf9c-b848-4bb5-89ac-04c0aa3aa3ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b7a63f1723e46a8a5620c62704b1020'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:29.069293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4ab8bf9c-b848-4bb5-89ac-04c0aa3aa3ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b7a63f1723e46a8a5620c62704b1020'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:29.084822 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1370/2733] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:28 2022] DELETE /identity/v3/users/1b7a63f1723e46a8a5620c62704b1020 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:29.092058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98498e27-484b-48fc-97da-116393837da9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:29.092564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98498e27-484b-48fc-97da-116393837da9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:29.092669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98498e27-484b-48fc-97da-116393837da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:29.110396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-98498e27-484b-48fc-97da-116393837da9 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:29.111868 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-98498e27-484b-48fc-97da-116393837da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:29.177962 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1364/2734] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:29.188699 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8bf9c-b848-4bb5-89ac-04c0aa3aa3ca admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:29.190115 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4ab8bf9c-b848-4bb5-89ac-04c0aa3aa3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:29.249831 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8bf9c-b848-4bb5-89ac-04c0aa3aa3ca admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:29.254601 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279bcab-7195-496d-9e84-f75db0ac02cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:29.255240 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279bcab-7195-496d-9e84-f75db0ac02cb service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:29.255518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279bcab-7195-496d-9e84-f75db0ac02cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:29.255817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279bcab-7195-496d-9e84-f75db0ac02cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:29.267687 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279bcab-7195-496d-9e84-f75db0ac02cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:29.269135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279bcab-7195-496d-9e84-f75db0ac02cb service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:29.279318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1371/2735] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:18:29.617291 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98498e27-484b-48fc-97da-116393837da9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:29.618252 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-98498e27-484b-48fc-97da-116393837da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:29.631052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98498e27-484b-48fc-97da-116393837da9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:29.637077 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:29.638171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:29.638533 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:29.638668 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f admin admin] PATH_INFO: `/v3/projects/deb469535b574dfb808cb4266279144f` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:29.639905 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb469535b574dfb808cb4266279144f)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:29.642824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:29.699884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb469535b574dfb808cb4266279144f', 'request_id': 'req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:29.705452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb469535b574dfb808cb4266279144f', 'request_id': 'req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:29.714663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb469535b574dfb808cb4266279144f', 'request_id': 'req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:29.727571 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f admin admin] The token cache is being invalidate because project deb469535b574dfb808cb4266279144f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:29.727979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:29.728794 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:29.730466 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1365/2736] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:29 2022] DELETE /identity/v3/projects/deb469535b574dfb808cb4266279144f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:29.734873 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279bcab-7195-496d-9e84-f75db0ac02cb service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:29.746428 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279bcab-7195-496d-9e84-f75db0ac02cb service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:29.806335 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af97ba-0a92-4360-b433-847f07124a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:29.807197 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af97ba-0a92-4360-b433-847f07124a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:29.807476 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af97ba-0a92-4360-b433-847f07124a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:29.807779 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af97ba-0a92-4360-b433-847f07124a8a admin admin] PATH_INFO: `/v3/users/4fb2329fb7d04ba3bd88bc547dd3d628` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:29.808944 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af97ba-0a92-4360-b433-847f07124a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb2329fb7d04ba3bd88bc547dd3d628)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:29.810920 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af97ba-0a92-4360-b433-847f07124a8a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:29.861945 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b4af97ba-0a92-4360-b433-847f07124a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb2329fb7d04ba3bd88bc547dd3d628'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:29.868265 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b4af97ba-0a92-4360-b433-847f07124a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb2329fb7d04ba3bd88bc547dd3d628'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:29.874889 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b4af97ba-0a92-4360-b433-847f07124a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb2329fb7d04ba3bd88bc547dd3d628'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:29.875573 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b4af97ba-0a92-4360-b433-847f07124a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb2329fb7d04ba3bd88bc547dd3d628'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:29.876236 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b4af97ba-0a92-4360-b433-847f07124a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb2329fb7d04ba3bd88bc547dd3d628'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:29.890927 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1372/2737] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:29 2022] DELETE /identity/v3/users/4fb2329fb7d04ba3bd88bc547dd3d628 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:30.156669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:30.158225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:30.178309 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe92c1c-95e2-4a16-bb09-2e6910e8e81f admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:30.234710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740dd66-a394-48f3-a68a-84f912e1abf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:30.235684 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740dd66-a394-48f3-a68a-84f912e1abf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:30.235967 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740dd66-a394-48f3-a68a-84f912e1abf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:30.236239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740dd66-a394-48f3-a68a-84f912e1abf1 admin admin] PATH_INFO: `/v3/projects/a4657c1302ba41bb8524c88f4e208c5b` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:30.237427 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740dd66-a394-48f3-a68a-84f912e1abf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4657c1302ba41bb8524c88f4e208c5b)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:30.239349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740dd66-a394-48f3-a68a-84f912e1abf1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:30.283881 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7740dd66-a394-48f3-a68a-84f912e1abf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4657c1302ba41bb8524c88f4e208c5b', 'request_id': 'req-7740dd66-a394-48f3-a68a-84f912e1abf1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:30.289559 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7740dd66-a394-48f3-a68a-84f912e1abf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4657c1302ba41bb8524c88f4e208c5b', 'request_id': 'req-7740dd66-a394-48f3-a68a-84f912e1abf1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:30.296383 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7740dd66-a394-48f3-a68a-84f912e1abf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4657c1302ba41bb8524c88f4e208c5b', 'request_id': 'req-7740dd66-a394-48f3-a68a-84f912e1abf1'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:30.307285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7740dd66-a394-48f3-a68a-84f912e1abf1 admin admin] The token cache is being invalidate because project a4657c1302ba41bb8524c88f4e208c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:30.307570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7740dd66-a394-48f3-a68a-84f912e1abf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:30.308229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-7740dd66-a394-48f3-a68a-84f912e1abf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:30.309744 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1366/2738] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:30 2022] DELETE /identity/v3/projects/a4657c1302ba41bb8524c88f4e208c5b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:30.314724 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014b0be-27e4-4458-a428-60686b95a50d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:30.315180 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014b0be-27e4-4458-a428-60686b95a50d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:30.315291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014b0be-27e4-4458-a428-60686b95a50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:30.333250 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b014b0be-27e4-4458-a428-60686b95a50d None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:30.334424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b014b0be-27e4-4458-a428-60686b95a50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:30.392325 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1373/2739] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:30.401237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46ee52-4977-4c9f-bdb4-a60247fdd3b1 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:30.401525 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46ee52-4977-4c9f-bdb4-a60247fdd3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:30.401802 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46ee52-4977-4c9f-bdb4-a60247fdd3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:30.420299 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-cd46ee52-4977-4c9f-bdb4-a60247fdd3b1 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:30.421476 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-cd46ee52-4977-4c9f-bdb4-a60247fdd3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:30.429346 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1367/2740] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:30.433686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014b0be-27e4-4458-a428-60686b95a50d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:30.443185 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014b0be-27e4-4458-a428-60686b95a50d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:30.447841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037ab6a-a061-41d0-b27e-341a4b14611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:30.448500 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037ab6a-a061-41d0-b27e-341a4b14611d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:30.448779 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037ab6a-a061-41d0-b27e-341a4b14611d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:30.449054 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037ab6a-a061-41d0-b27e-341a4b14611d admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:30.449770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037ab6a-a061-41d0-b27e-341a4b14611d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:18:30.450072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037ab6a-a061-41d0-b27e-341a4b14611d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:30.451700 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037ab6a-a061-41d0-b27e-341a4b14611d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:30.464900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1374/2741] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:18:30.469383 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46ee52-4977-4c9f-bdb4-a60247fdd3b1 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:30.479367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46ee52-4977-4c9f-bdb4-a60247fdd3b1 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:30.485771 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb3c2c-78c6-49f5-9959-f8815c465894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:30.486414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb3c2c-78c6-49f5-9959-f8815c465894 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:30.486696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb3c2c-78c6-49f5-9959-f8815c465894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:30.486972 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb3c2c-78c6-49f5-9959-f8815c465894 admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:30.487674 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb3c2c-78c6-49f5-9959-f8815c465894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:30.489570 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb3c2c-78c6-49f5-9959-f8815c465894 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:30.516215 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1368/2742] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:30 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:30.520497 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037ab6a-a061-41d0-b27e-341a4b14611d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:30.530897 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037ab6a-a061-41d0-b27e-341a4b14611d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:30.584685 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0895b0-a066-4c11-869e-b9f7db2a0890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:30.586073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0895b0-a066-4c11-869e-b9f7db2a0890 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:30.586509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0895b0-a066-4c11-869e-b9f7db2a0890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:30.586773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0895b0-a066-4c11-869e-b9f7db2a0890 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:30.587465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0895b0-a066-4c11-869e-b9f7db2a0890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:30.589456 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0895b0-a066-4c11-869e-b9f7db2a0890 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:30.614326 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1375/2743] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:30 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:30.615500 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb3c2c-78c6-49f5-9959-f8815c465894 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:30.626195 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb3c2c-78c6-49f5-9959-f8815c465894 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:30.635160 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d727134-5560-43be-becc-a19dfe668fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:30.635936 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d727134-5560-43be-becc-a19dfe668fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:30.636286 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d727134-5560-43be-becc-a19dfe668fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:30.636666 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d727134-5560-43be-becc-a19dfe668fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:30.637503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d727134-5560-43be-becc-a19dfe668fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:30.639145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d727134-5560-43be-becc-a19dfe668fe3 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:30.650920 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1369/2744] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:18:30.654869 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0895b0-a066-4c11-869e-b9f7db2a0890 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:30.664764 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0895b0-a066-4c11-869e-b9f7db2a0890 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:30.669304 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2932e60-8e40-4f1c-890c-df724a809f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:30.669952 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2932e60-8e40-4f1c-890c-df724a809f47 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:30.670228 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2932e60-8e40-4f1c-890c-df724a809f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:30.670501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2932e60-8e40-4f1c-890c-df724a809f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:30.671203 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2932e60-8e40-4f1c-890c-df724a809f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:30.672802 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2932e60-8e40-4f1c-890c-df724a809f47 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:30.682378 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1376/2745] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:30.686210 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d727134-5560-43be-becc-a19dfe668fe3 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:30.696722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d727134-5560-43be-becc-a19dfe668fe3 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:30.701360 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ef5af-851a-4789-859e-209503a5057a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:30.702230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ef5af-851a-4789-859e-209503a5057a admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:30.702509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ef5af-851a-4789-859e-209503a5057a admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:30.702790 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ef5af-851a-4789-859e-209503a5057a admin admin] PATH_INFO: `/v3/projects/ae0057bef15f480f9f236dc04b1c707e/users/4dd4abc9ed17470d90c9a99de22ee0dc/roles/e613911293e3458c975cbab36cae354d` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:30.717918 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ef5af-851a-4789-859e-209503a5057a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0057bef15f480f9f236dc04b1c707e, user_id=4dd4abc9ed17470d90c9a99de22ee0dc, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:30.720637 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ef5af-851a-4789-859e-209503a5057a admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:30.735194 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1370/2746] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:30 2022] PUT /identity/v3/projects/ae0057bef15f480f9f236dc04b1c707e/users/4dd4abc9ed17470d90c9a99de22ee0dc/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:30.746274 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da6d9f-eb33-44ef-9f82-3538cddbec52 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:30.746584 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da6d9f-eb33-44ef-9f82-3538cddbec52 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:30.746861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da6d9f-eb33-44ef-9f82-3538cddbec52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:30.774861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c9da6d9f-eb33-44ef-9f82-3538cddbec52 None None] MFA Rules not processed for user `4dd4abc9ed17470d90c9a99de22ee0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:30.776100 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c9da6d9f-eb33-44ef-9f82-3538cddbec52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:30.840242 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1377/2747] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:30.844714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ef5af-851a-4789-859e-209503a5057a admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:30.903959 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ef5af-851a-4789-859e-209503a5057a admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:30.908589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271ec1d-487e-420c-9092-9425666616fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:30.909237 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271ec1d-487e-420c-9092-9425666616fd admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:30.909517 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271ec1d-487e-420c-9092-9425666616fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:30.909791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271ec1d-487e-420c-9092-9425666616fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:30.910473 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271ec1d-487e-420c-9092-9425666616fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:30.912403 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271ec1d-487e-420c-9092-9425666616fd admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:30.937530 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1371/2748] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:30 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:30.941635 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da6d9f-eb33-44ef-9f82-3538cddbec52 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:30.952355 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da6d9f-eb33-44ef-9f82-3538cddbec52 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:31.005693 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a10e9d-283a-46d3-b75e-c00468b18868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:31.006348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a10e9d-283a-46d3-b75e-c00468b18868 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:31.006626 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a10e9d-283a-46d3-b75e-c00468b18868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:31.006896 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a10e9d-283a-46d3-b75e-c00468b18868 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:31.007626 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a10e9d-283a-46d3-b75e-c00468b18868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:31.009542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a10e9d-283a-46d3-b75e-c00468b18868 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:31.029055 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1378/2749] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:30 2022] POST /identity/v3/users => generated 299 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:31.033047 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271ec1d-487e-420c-9092-9425666616fd admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:31.043760 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271ec1d-487e-420c-9092-9425666616fd admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:31.048342 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace31c9-1602-47bd-8494-19ddbcbe9a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:31.048990 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace31c9-1602-47bd-8494-19ddbcbe9a37 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:31.049270 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace31c9-1602-47bd-8494-19ddbcbe9a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:31.049544 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace31c9-1602-47bd-8494-19ddbcbe9a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:31.050260 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace31c9-1602-47bd-8494-19ddbcbe9a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:31.051883 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace31c9-1602-47bd-8494-19ddbcbe9a37 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:31.062522 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1372/2750] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:31.066697 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a10e9d-283a-46d3-b75e-c00468b18868 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:31.076285 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a10e9d-283a-46d3-b75e-c00468b18868 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:31.080750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7abce6-0dc4-4c97-b911-bb727feb5695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:31.081612 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7abce6-0dc4-4c97-b911-bb727feb5695 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:31.081890 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7abce6-0dc4-4c97-b911-bb727feb5695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:31.082161 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7abce6-0dc4-4c97-b911-bb727feb5695 admin admin] PATH_INFO: `/v3/projects/75dd95db9db14d039baa803e82319681/users/c2667419833a4e618d93c966d7cc0cd0/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:31.097097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7abce6-0dc4-4c97-b911-bb727feb5695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75dd95db9db14d039baa803e82319681, user_id=c2667419833a4e618d93c966d7cc0cd0, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:31.099772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7abce6-0dc4-4c97-b911-bb727feb5695 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:31.112773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1379/2751] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:31 2022] PUT /identity/v3/projects/75dd95db9db14d039baa803e82319681/users/c2667419833a4e618d93c966d7cc0cd0/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:18:31.117117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace31c9-1602-47bd-8494-19ddbcbe9a37 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:31.126777 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace31c9-1602-47bd-8494-19ddbcbe9a37 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:31.181233 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e6506-6c74-4f0e-aae6-66963c7dcbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:31.181919 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e6506-6c74-4f0e-aae6-66963c7dcbfa admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:31.182166 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e6506-6c74-4f0e-aae6-66963c7dcbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:31.182444 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e6506-6c74-4f0e-aae6-66963c7dcbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:31.183157 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e6506-6c74-4f0e-aae6-66963c7dcbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:31.184764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e6506-6c74-4f0e-aae6-66963c7dcbfa admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:31.194327 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1373/2752] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:31.198602 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7abce6-0dc4-4c97-b911-bb727feb5695 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:31.208527 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7abce6-0dc4-4c97-b911-bb727feb5695 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:31.214007 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8114caf-822f-4da2-aec9-3e7e152b274a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:31.214912 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8114caf-822f-4da2-aec9-3e7e152b274a admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:31.215196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8114caf-822f-4da2-aec9-3e7e152b274a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:31.215469 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8114caf-822f-4da2-aec9-3e7e152b274a admin admin] PATH_INFO: `/v3/projects/75dd95db9db14d039baa803e82319681/users/c2667419833a4e618d93c966d7cc0cd0/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:31.217453 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8114caf-822f-4da2-aec9-3e7e152b274a admin admin] RBAC: Authorizing `identity:create_grant(project_id=75dd95db9db14d039baa803e82319681, user_id=c2667419833a4e618d93c966d7cc0cd0, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:31.220135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8114caf-822f-4da2-aec9-3e7e152b274a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:31.230724 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1380/2753] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:31 2022] PUT /identity/v3/projects/75dd95db9db14d039baa803e82319681/users/c2667419833a4e618d93c966d7cc0cd0/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:31.240730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845cc1b-a211-420c-b26e-aab7c952250b None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:31.241027 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845cc1b-a211-420c-b26e-aab7c952250b None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:31.241317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845cc1b-a211-420c-b26e-aab7c952250b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:31.266711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2845cc1b-a211-420c-b26e-aab7c952250b None None] MFA Rules not processed for user `c2667419833a4e618d93c966d7cc0cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:31.267937 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2845cc1b-a211-420c-b26e-aab7c952250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:31.333688 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1374/2754] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:31.345886 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8114caf-822f-4da2-aec9-3e7e152b274a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:31.347535 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e8114caf-822f-4da2-aec9-3e7e152b274a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:31.407352 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8114caf-822f-4da2-aec9-3e7e152b274a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:31.410995 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339cd35-db03-4164-96f9-c298dde436bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:31.411651 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339cd35-db03-4164-96f9-c298dde436bc service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:31.411931 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339cd35-db03-4164-96f9-c298dde436bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:31.412204 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339cd35-db03-4164-96f9-c298dde436bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:31.421049 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339cd35-db03-4164-96f9-c298dde436bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:31.422536 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339cd35-db03-4164-96f9-c298dde436bc service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:31.431730 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1381/2755] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:31.495314 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845cc1b-a211-420c-b26e-aab7c952250b None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:31.555737 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845cc1b-a211-420c-b26e-aab7c952250b None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:31.560169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ba001-a4e4-4cfa-8454-f45a4b71228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:31.561033 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ba001-a4e4-4cfa-8454-f45a4b71228c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:31.561307 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ba001-a4e4-4cfa-8454-f45a4b71228c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:31.561573 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ba001-a4e4-4cfa-8454-f45a4b71228c admin admin] PATH_INFO: `/v3/users/4dd4abc9ed17470d90c9a99de22ee0dc` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:31.562738 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ba001-a4e4-4cfa-8454-f45a4b71228c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd4abc9ed17470d90c9a99de22ee0dc)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:31.564663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ba001-a4e4-4cfa-8454-f45a4b71228c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:31.609730 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3d3ba001-a4e4-4cfa-8454-f45a4b71228c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd4abc9ed17470d90c9a99de22ee0dc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:31.610302 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3d3ba001-a4e4-4cfa-8454-f45a4b71228c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd4abc9ed17470d90c9a99de22ee0dc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:31.621628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3d3ba001-a4e4-4cfa-8454-f45a4b71228c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd4abc9ed17470d90c9a99de22ee0dc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:31.628129 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3d3ba001-a4e4-4cfa-8454-f45a4b71228c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd4abc9ed17470d90c9a99de22ee0dc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:31.628766 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-3d3ba001-a4e4-4cfa-8454-f45a4b71228c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd4abc9ed17470d90c9a99de22ee0dc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:31.641508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1375/2756] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:31 2022] DELETE /identity/v3/users/4dd4abc9ed17470d90c9a99de22ee0dc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:31.645962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9c849-5327-4464-bb2a-2457f9b9776f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:31.646252 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9c849-5327-4464-bb2a-2457f9b9776f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:31.646559 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9c849-5327-4464-bb2a-2457f9b9776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:31.664604 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-44e9c849-5327-4464-bb2a-2457f9b9776f None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:31.665845 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-44e9c849-5327-4464-bb2a-2457f9b9776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:31.724645 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1382/2757] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:31.735105 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ba001-a4e4-4cfa-8454-f45a4b71228c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:31.736541 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3d3ba001-a4e4-4cfa-8454-f45a4b71228c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:31.795233 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ba001-a4e4-4cfa-8454-f45a4b71228c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:31.798883 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d14233-02e5-49a2-bdab-c5e82bb48bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:31.799526 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d14233-02e5-49a2-bdab-c5e82bb48bcf service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:31.799847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d14233-02e5-49a2-bdab-c5e82bb48bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:31.800122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d14233-02e5-49a2-bdab-c5e82bb48bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:31.808966 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d14233-02e5-49a2-bdab-c5e82bb48bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:31.810387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d14233-02e5-49a2-bdab-c5e82bb48bcf service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:31.819589 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1376/2758] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:32.077462 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9c849-5327-4464-bb2a-2457f9b9776f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:32.078929 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-44e9c849-5327-4464-bb2a-2457f9b9776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:32.093875 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9c849-5327-4464-bb2a-2457f9b9776f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:32.099855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:32.101033 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:32.101263 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:32.101580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446 admin admin] PATH_INFO: `/v3/projects/ae0057bef15f480f9f236dc04b1c707e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:32.102836 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae0057bef15f480f9f236dc04b1c707e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:32.104728 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:32.150441 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae0057bef15f480f9f236dc04b1c707e', 'request_id': 'req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:32.155545 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae0057bef15f480f9f236dc04b1c707e', 'request_id': 'req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:32.163135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae0057bef15f480f9f236dc04b1c707e', 'request_id': 'req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:32.174344 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446 admin admin] The token cache is being invalidate because project ae0057bef15f480f9f236dc04b1c707e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:32.174637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:32.175561 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:32.177133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1383/2759] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:32 2022] DELETE /identity/v3/projects/ae0057bef15f480f9f236dc04b1c707e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:32.181692 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d14233-02e5-49a2-bdab-c5e82bb48bcf service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:32.191305 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d14233-02e5-49a2-bdab-c5e82bb48bcf service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:32.248587 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec400d-5763-4764-ad56-bbdeb73525bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:32.249590 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec400d-5763-4764-ad56-bbdeb73525bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:32.249871 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec400d-5763-4764-ad56-bbdeb73525bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:32.250148 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec400d-5763-4764-ad56-bbdeb73525bd admin admin] PATH_INFO: `/v3/users/c2667419833a4e618d93c966d7cc0cd0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:32.251321 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec400d-5763-4764-ad56-bbdeb73525bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2667419833a4e618d93c966d7cc0cd0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:32.253428 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec400d-5763-4764-ad56-bbdeb73525bd admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:32.297664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e4ec400d-5763-4764-ad56-bbdeb73525bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2667419833a4e618d93c966d7cc0cd0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:32.298305 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e4ec400d-5763-4764-ad56-bbdeb73525bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2667419833a4e618d93c966d7cc0cd0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:32.309564 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e4ec400d-5763-4764-ad56-bbdeb73525bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2667419833a4e618d93c966d7cc0cd0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:32.316066 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e4ec400d-5763-4764-ad56-bbdeb73525bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2667419833a4e618d93c966d7cc0cd0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:32.316694 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e4ec400d-5763-4764-ad56-bbdeb73525bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2667419833a4e618d93c966d7cc0cd0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:32.328932 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1377/2760] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:32 2022] DELETE /identity/v3/users/c2667419833a4e618d93c966d7cc0cd0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:32.594490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:32.596014 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:32.609191 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4ea46-f7c5-4fff-98c6-8fdcfdbde446 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:32.665582 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cac7cc-3e36-4da8-8c0e-8faf28033800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:32.666443 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cac7cc-3e36-4da8-8c0e-8faf28033800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:32.666727 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cac7cc-3e36-4da8-8c0e-8faf28033800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:32.667001 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cac7cc-3e36-4da8-8c0e-8faf28033800 admin admin] PATH_INFO: `/v3/projects/75dd95db9db14d039baa803e82319681` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:32.668194 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cac7cc-3e36-4da8-8c0e-8faf28033800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75dd95db9db14d039baa803e82319681)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:32.670088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cac7cc-3e36-4da8-8c0e-8faf28033800 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:32.715529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-61cac7cc-3e36-4da8-8c0e-8faf28033800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75dd95db9db14d039baa803e82319681', 'request_id': 'req-61cac7cc-3e36-4da8-8c0e-8faf28033800'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:32.721072 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-61cac7cc-3e36-4da8-8c0e-8faf28033800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75dd95db9db14d039baa803e82319681', 'request_id': 'req-61cac7cc-3e36-4da8-8c0e-8faf28033800'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:32.729314 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-61cac7cc-3e36-4da8-8c0e-8faf28033800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75dd95db9db14d039baa803e82319681', 'request_id': 'req-61cac7cc-3e36-4da8-8c0e-8faf28033800'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:32.740489 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-61cac7cc-3e36-4da8-8c0e-8faf28033800 admin admin] The token cache is being invalidate because project 75dd95db9db14d039baa803e82319681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:32.740775 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-61cac7cc-3e36-4da8-8c0e-8faf28033800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:32.741933 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-61cac7cc-3e36-4da8-8c0e-8faf28033800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:32.743465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1384/2761] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:32 2022] DELETE /identity/v3/projects/75dd95db9db14d039baa803e82319681 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:32.748218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d1ab-63a4-4f86-9315-315ffa56dd72 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:32.748535 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d1ab-63a4-4f86-9315-315ffa56dd72 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:32.748847 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d1ab-63a4-4f86-9315-315ffa56dd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:32.766455 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2b89d1ab-63a4-4f86-9315-315ffa56dd72 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:32.767685 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2b89d1ab-63a4-4f86-9315-315ffa56dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:32.829773 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1378/2762] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:32.837604 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b32fe-e37d-423f-af5f-6ea22f8ede37 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:32.837893 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b32fe-e37d-423f-af5f-6ea22f8ede37 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:32.838170 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b32fe-e37d-423f-af5f-6ea22f8ede37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:32.856196 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ba8b32fe-e37d-423f-af5f-6ea22f8ede37 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:32.857400 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ba8b32fe-e37d-423f-af5f-6ea22f8ede37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:32.865172 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1385/2763] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:32.869862 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89d1ab-63a4-4f86-9315-315ffa56dd72 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:32.879590 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89d1ab-63a4-4f86-9315-315ffa56dd72 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:32.884724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dd59c-0337-4190-91f6-7656182301d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:32.885380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dd59c-0337-4190-91f6-7656182301d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:32.885665 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dd59c-0337-4190-91f6-7656182301d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:32.885942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dd59c-0337-4190-91f6-7656182301d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:32.886670 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dd59c-0337-4190-91f6-7656182301d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:18:32.886976 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dd59c-0337-4190-91f6-7656182301d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:32.888605 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dd59c-0337-4190-91f6-7656182301d0 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:32.900654 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1379/2764] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:18:32.904939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b32fe-e37d-423f-af5f-6ea22f8ede37 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:32.914576 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b32fe-e37d-423f-af5f-6ea22f8ede37 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:32.919180 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa2057-7349-4945-a1bc-66e159bd86bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:32.919913 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa2057-7349-4945-a1bc-66e159bd86bd admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:32.920205 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa2057-7349-4945-a1bc-66e159bd86bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:32.920548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa2057-7349-4945-a1bc-66e159bd86bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:32.921250 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa2057-7349-4945-a1bc-66e159bd86bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:32.923151 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa2057-7349-4945-a1bc-66e159bd86bd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:32.949120 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1386/2765] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:32 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:32.953015 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dd59c-0337-4190-91f6-7656182301d0 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:32.963103 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dd59c-0337-4190-91f6-7656182301d0 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:33.016911 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d5d0f-27e6-4462-ae00-1182b2e3a5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:33.017621 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d5d0f-27e6-4462-ae00-1182b2e3a5ef admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:33.017961 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d5d0f-27e6-4462-ae00-1182b2e3a5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:33.018359 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d5d0f-27e6-4462-ae00-1182b2e3a5ef admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:33.019504 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d5d0f-27e6-4462-ae00-1182b2e3a5ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:33.021434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d5d0f-27e6-4462-ae00-1182b2e3a5ef admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:33.041031 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1380/2766] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:32 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:33.045098 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa2057-7349-4945-a1bc-66e159bd86bd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:33.055340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa2057-7349-4945-a1bc-66e159bd86bd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:33.059928 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34321897-3160-4797-a6c8-0b11d8746f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:33.060570 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34321897-3160-4797-a6c8-0b11d8746f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:33.060847 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34321897-3160-4797-a6c8-0b11d8746f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:33.061116 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34321897-3160-4797-a6c8-0b11d8746f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:33.061840 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34321897-3160-4797-a6c8-0b11d8746f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:33.063405 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34321897-3160-4797-a6c8-0b11d8746f54 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:33.074381 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1387/2767] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:33.078176 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d5d0f-27e6-4462-ae00-1182b2e3a5ef admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:33.087926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d5d0f-27e6-4462-ae00-1182b2e3a5ef admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:33.092434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ad78a-d678-4c91-85f2-19bdab417849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:33.093084 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad78a-d678-4c91-85f2-19bdab417849 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:33.093363 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad78a-d678-4c91-85f2-19bdab417849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:33.093634 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad78a-d678-4c91-85f2-19bdab417849 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:33.094343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ad78a-d678-4c91-85f2-19bdab417849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:33.095947 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ad78a-d678-4c91-85f2-19bdab417849 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:33.106577 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1381/2768] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:33.110716 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34321897-3160-4797-a6c8-0b11d8746f54 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:33.121652 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34321897-3160-4797-a6c8-0b11d8746f54 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:33.126311 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce61bd-f4f9-4156-8bc7-7a1e1fa5141f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:33.127139 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce61bd-f4f9-4156-8bc7-7a1e1fa5141f admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:33.127490 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce61bd-f4f9-4156-8bc7-7a1e1fa5141f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:33.127852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce61bd-f4f9-4156-8bc7-7a1e1fa5141f admin admin] PATH_INFO: `/v3/projects/2d787be48cc54cc3916129ed88ec2a19/users/a9567fe6103b410c807bc30336beeb12/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:33.143663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce61bd-f4f9-4156-8bc7-7a1e1fa5141f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d787be48cc54cc3916129ed88ec2a19, user_id=a9567fe6103b410c807bc30336beeb12, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:33.146297 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce61bd-f4f9-4156-8bc7-7a1e1fa5141f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:33.158972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1388/2769] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:33 2022] PUT /identity/v3/projects/2d787be48cc54cc3916129ed88ec2a19/users/a9567fe6103b410c807bc30336beeb12/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:33.170880 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ca795-8206-453b-b7cc-60daf455f015 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:33.171168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ca795-8206-453b-b7cc-60daf455f015 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:33.171445 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ca795-8206-453b-b7cc-60daf455f015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:33.197602 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-461ca795-8206-453b-b7cc-60daf455f015 None None] MFA Rules not processed for user `a9567fe6103b410c807bc30336beeb12`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:33.198772 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-461ca795-8206-453b-b7cc-60daf455f015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:33.263595 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1382/2770] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:33.268597 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce61bd-f4f9-4156-8bc7-7a1e1fa5141f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:33.329837 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce61bd-f4f9-4156-8bc7-7a1e1fa5141f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:33.334779 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe575e0-dbb7-43c9-98af-d3af7429a3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:33.335994 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe575e0-dbb7-43c9-98af-d3af7429a3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:33.336273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe575e0-dbb7-43c9-98af-d3af7429a3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:33.336556 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe575e0-dbb7-43c9-98af-d3af7429a3e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:33.337235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe575e0-dbb7-43c9-98af-d3af7429a3e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:33.339163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe575e0-dbb7-43c9-98af-d3af7429a3e6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:33.363777 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1389/2771] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:33 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:18:33.367962 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ca795-8206-453b-b7cc-60daf455f015 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:33.378956 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ca795-8206-453b-b7cc-60daf455f015 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:33.434586 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656db344-6126-411d-8dba-4d0cdab2925c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:33.435249 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656db344-6126-411d-8dba-4d0cdab2925c admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:33.435529 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656db344-6126-411d-8dba-4d0cdab2925c admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:33.435843 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656db344-6126-411d-8dba-4d0cdab2925c admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:33.436514 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656db344-6126-411d-8dba-4d0cdab2925c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:33.438411 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656db344-6126-411d-8dba-4d0cdab2925c admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:33.457622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1383/2772] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:33 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:33.462600 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe575e0-dbb7-43c9-98af-d3af7429a3e6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:33.473359 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe575e0-dbb7-43c9-98af-d3af7429a3e6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:33.478616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadcbc0-4e27-433f-9f32-a3cbcc79781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:33.479271 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadcbc0-4e27-433f-9f32-a3cbcc79781e admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:33.479555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadcbc0-4e27-433f-9f32-a3cbcc79781e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:33.479859 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadcbc0-4e27-433f-9f32-a3cbcc79781e admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:33.480576 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadcbc0-4e27-433f-9f32-a3cbcc79781e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:33.482167 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadcbc0-4e27-433f-9f32-a3cbcc79781e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:33.492759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1390/2773] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:33.496786 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656db344-6126-411d-8dba-4d0cdab2925c admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:33.506426 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656db344-6126-411d-8dba-4d0cdab2925c admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:33.511149 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19744ba3-2af7-462c-a1c0-89554dd9f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:33.512049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19744ba3-2af7-462c-a1c0-89554dd9f0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:33.512328 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19744ba3-2af7-462c-a1c0-89554dd9f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:33.512600 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19744ba3-2af7-462c-a1c0-89554dd9f0b9 admin admin] PATH_INFO: `/v3/projects/f0f7c6cbddc94e028fc54e178ed6cc4e/users/c59479eb75b346ef8d8b084be969ebb4/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:33.529184 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19744ba3-2af7-462c-a1c0-89554dd9f0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f7c6cbddc94e028fc54e178ed6cc4e, user_id=c59479eb75b346ef8d8b084be969ebb4, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:33.531807 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19744ba3-2af7-462c-a1c0-89554dd9f0b9 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:33.545835 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1384/2774] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:33 2022] PUT /identity/v3/projects/f0f7c6cbddc94e028fc54e178ed6cc4e/users/c59479eb75b346ef8d8b084be969ebb4/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:33.550139 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadcbc0-4e27-433f-9f32-a3cbcc79781e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:33.560529 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadcbc0-4e27-433f-9f32-a3cbcc79781e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:33.614424 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c5dd5-b899-4192-9bf2-bcddd40c11a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:33.615103 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c5dd5-b899-4192-9bf2-bcddd40c11a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:33.615359 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c5dd5-b899-4192-9bf2-bcddd40c11a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:33.615658 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c5dd5-b899-4192-9bf2-bcddd40c11a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:33.616379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c5dd5-b899-4192-9bf2-bcddd40c11a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:33.618159 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c5dd5-b899-4192-9bf2-bcddd40c11a6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:33.627493 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1391/2775] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:18:33.631736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19744ba3-2af7-462c-a1c0-89554dd9f0b9 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:33.642613 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19744ba3-2af7-462c-a1c0-89554dd9f0b9 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:33.647418 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2dd65-9752-4c3d-bbef-faf4b91c503d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:33.648888 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2dd65-9752-4c3d-bbef-faf4b91c503d admin admin] REQUEST_METHOD: `PUT` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:33.649169 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2dd65-9752-4c3d-bbef-faf4b91c503d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:33.649702 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2dd65-9752-4c3d-bbef-faf4b91c503d admin admin] PATH_INFO: `/v3/projects/f0f7c6cbddc94e028fc54e178ed6cc4e/users/c59479eb75b346ef8d8b084be969ebb4/roles/04c37f430c9a4af3beb85a9f2c0f6bea` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:33.651714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2dd65-9752-4c3d-bbef-faf4b91c503d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f7c6cbddc94e028fc54e178ed6cc4e, user_id=c59479eb75b346ef8d8b084be969ebb4, role_id=04c37f430c9a4af3beb85a9f2c0f6bea)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:33.654403 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2dd65-9752-4c3d-bbef-faf4b91c503d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:33.664440 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1385/2776] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:33 2022] PUT /identity/v3/projects/f0f7c6cbddc94e028fc54e178ed6cc4e/users/c59479eb75b346ef8d8b084be969ebb4/roles/04c37f430c9a4af3beb85a9f2c0f6bea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:33.674372 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6199325-9a82-4118-a8b1-e78a6d361547 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:33.674664 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6199325-9a82-4118-a8b1-e78a6d361547 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:33.674947 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6199325-9a82-4118-a8b1-e78a6d361547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:33.700471 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e6199325-9a82-4118-a8b1-e78a6d361547 None None] MFA Rules not processed for user `c59479eb75b346ef8d8b084be969ebb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:33.701659 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e6199325-9a82-4118-a8b1-e78a6d361547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:33.770396 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1392/2777] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:33.781354 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2dd65-9752-4c3d-bbef-faf4b91c503d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:33.783230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-23f2dd65-9752-4c3d-bbef-faf4b91c503d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:33.842322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2dd65-9752-4c3d-bbef-faf4b91c503d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:33.846602 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaedf4-7f65-46ef-863a-710d16cba7a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:33.847328 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaedf4-7f65-46ef-863a-710d16cba7a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:33.847781 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaedf4-7f65-46ef-863a-710d16cba7a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:33.848193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaedf4-7f65-46ef-863a-710d16cba7a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:33.858585 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceaedf4-7f65-46ef-863a-710d16cba7a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:33.860063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceaedf4-7f65-46ef-863a-710d16cba7a7 service cinder] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:33.869820 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1386/2778] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:34.087833 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6199325-9a82-4118-a8b1-e78a6d361547 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:34.155792 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6199325-9a82-4118-a8b1-e78a6d361547 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:34.161972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5926b2-8728-4b31-b508-4cfc5c79c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:34.162963 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5926b2-8728-4b31-b508-4cfc5c79c72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:34.163852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5926b2-8728-4b31-b508-4cfc5c79c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:34.164199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5926b2-8728-4b31-b508-4cfc5c79c72e admin admin] PATH_INFO: `/v3/users/a9567fe6103b410c807bc30336beeb12` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:34.165604 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5926b2-8728-4b31-b508-4cfc5c79c72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9567fe6103b410c807bc30336beeb12)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:34.167757 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5926b2-8728-4b31-b508-4cfc5c79c72e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:34.221329 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cc5926b2-8728-4b31-b508-4cfc5c79c72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9567fe6103b410c807bc30336beeb12'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:34.233394 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cc5926b2-8728-4b31-b508-4cfc5c79c72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9567fe6103b410c807bc30336beeb12'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:34.239808 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cc5926b2-8728-4b31-b508-4cfc5c79c72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9567fe6103b410c807bc30336beeb12'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:34.240477 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cc5926b2-8728-4b31-b508-4cfc5c79c72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9567fe6103b410c807bc30336beeb12'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:34.241076 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cc5926b2-8728-4b31-b508-4cfc5c79c72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9567fe6103b410c807bc30336beeb12'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:34.253334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1393/2779] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:34 2022] DELETE /identity/v3/users/a9567fe6103b410c807bc30336beeb12 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:34.258584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345865-54a7-4ab1-8fb4-1ee4722d5544 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:34.259101 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345865-54a7-4ab1-8fb4-1ee4722d5544 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:34.259229 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345865-54a7-4ab1-8fb4-1ee4722d5544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:34.276638 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-12345865-54a7-4ab1-8fb4-1ee4722d5544 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:34.277814 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-12345865-54a7-4ab1-8fb4-1ee4722d5544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:34.337005 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1387/2780] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:18:34.347384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5926b2-8728-4b31-b508-4cfc5c79c72e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:34.348906 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cc5926b2-8728-4b31-b508-4cfc5c79c72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:34.408806 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5926b2-8728-4b31-b508-4cfc5c79c72e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:34.412416 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd3282-8cab-42bb-b8c7-d03477d53771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:34.413571 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd3282-8cab-42bb-b8c7-d03477d53771 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:34.413869 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd3282-8cab-42bb-b8c7-d03477d53771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:34.414142 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd3282-8cab-42bb-b8c7-d03477d53771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:34.423097 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd3282-8cab-42bb-b8c7-d03477d53771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:34.424556 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd3282-8cab-42bb-b8c7-d03477d53771 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:34.434294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1394/2781] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:34.706662 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12345865-54a7-4ab1-8fb4-1ee4722d5544 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:34.708117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-12345865-54a7-4ab1-8fb4-1ee4722d5544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:34.720347 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12345865-54a7-4ab1-8fb4-1ee4722d5544 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:34.725059 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:34.726610 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:34.727052 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:34.727337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc admin admin] PATH_INFO: `/v3/projects/2d787be48cc54cc3916129ed88ec2a19` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:34.728576 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d787be48cc54cc3916129ed88ec2a19)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:34.730492 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:34.776032 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d787be48cc54cc3916129ed88ec2a19', 'request_id': 'req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:34.781207 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d787be48cc54cc3916129ed88ec2a19', 'request_id': 'req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:34.789272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d787be48cc54cc3916129ed88ec2a19', 'request_id': 'req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:34.800214 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc admin admin] The token cache is being invalidate because project 2d787be48cc54cc3916129ed88ec2a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:34.800500 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:34.801125 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:34.802661 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1388/2782] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:34 2022] DELETE /identity/v3/projects/2d787be48cc54cc3916129ed88ec2a19 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:34.807158 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd3282-8cab-42bb-b8c7-d03477d53771 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:34.816653 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd3282-8cab-42bb-b8c7-d03477d53771 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:34.872812 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef71ee-7cab-4b02-bdff-2ef50776b038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:34.873682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef71ee-7cab-4b02-bdff-2ef50776b038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:34.873959 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef71ee-7cab-4b02-bdff-2ef50776b038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:34.874229 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef71ee-7cab-4b02-bdff-2ef50776b038 admin admin] PATH_INFO: `/v3/users/c59479eb75b346ef8d8b084be969ebb4` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:34.875385 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef71ee-7cab-4b02-bdff-2ef50776b038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c59479eb75b346ef8d8b084be969ebb4)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:34.877388 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef71ee-7cab-4b02-bdff-2ef50776b038 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:34.923217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0ef71ee-7cab-4b02-bdff-2ef50776b038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c59479eb75b346ef8d8b084be969ebb4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:34.934602 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0ef71ee-7cab-4b02-bdff-2ef50776b038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c59479eb75b346ef8d8b084be969ebb4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:34.940976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0ef71ee-7cab-4b02-bdff-2ef50776b038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c59479eb75b346ef8d8b084be969ebb4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:34.941633 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0ef71ee-7cab-4b02-bdff-2ef50776b038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c59479eb75b346ef8d8b084be969ebb4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:34.942228 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e0ef71ee-7cab-4b02-bdff-2ef50776b038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c59479eb75b346ef8d8b084be969ebb4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:34.954470 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1395/2783] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:34 2022] DELETE /identity/v3/users/c59479eb75b346ef8d8b084be969ebb4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:35.210747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:35.212388 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:35.226477 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d61a5-53fa-45b5-81d8-ddcfa905a0fc admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:35.236661 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef71ee-7cab-4b02-bdff-2ef50776b038 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:35.238210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e0ef71ee-7cab-4b02-bdff-2ef50776b038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:35.288953 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50876842-f17d-40d5-8f92-e8ea2153b209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:35.289833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50876842-f17d-40d5-8f92-e8ea2153b209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:35.290114 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50876842-f17d-40d5-8f92-e8ea2153b209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:35.290385 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50876842-f17d-40d5-8f92-e8ea2153b209 admin admin] PATH_INFO: `/v3/users/25a6effad5c4484d939dfc427c729029` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:35.291636 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50876842-f17d-40d5-8f92-e8ea2153b209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a6effad5c4484d939dfc427c729029)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:35.293584 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50876842-f17d-40d5-8f92-e8ea2153b209 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:35.306217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef71ee-7cab-4b02-bdff-2ef50776b038 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:35.310954 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a8be0-9133-4dfe-99b9-a64bf4fa3bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:35.311844 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a8be0-9133-4dfe-99b9-a64bf4fa3bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:35.312181 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a8be0-9133-4dfe-99b9-a64bf4fa3bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:35.312469 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a8be0-9133-4dfe-99b9-a64bf4fa3bd9 admin admin] PATH_INFO: `/v3/projects/f0f7c6cbddc94e028fc54e178ed6cc4e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:35.313684 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a8be0-9133-4dfe-99b9-a64bf4fa3bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f7c6cbddc94e028fc54e178ed6cc4e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:35.315636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a8be0-9133-4dfe-99b9-a64bf4fa3bd9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:35.344993 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-50876842-f17d-40d5-8f92-e8ea2153b209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a6effad5c4484d939dfc427c729029'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:35.345650 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-50876842-f17d-40d5-8f92-e8ea2153b209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a6effad5c4484d939dfc427c729029'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:35.359267 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-50876842-f17d-40d5-8f92-e8ea2153b209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a6effad5c4484d939dfc427c729029'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:35.366945 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-50876842-f17d-40d5-8f92-e8ea2153b209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a6effad5c4484d939dfc427c729029'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:35.367644 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-50876842-f17d-40d5-8f92-e8ea2153b209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a6effad5c4484d939dfc427c729029'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:35.368501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9a4a8be0-9133-4dfe-99b9-a64bf4fa3bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f7c6cbddc94e028fc54e178ed6cc4e', 'request_id': 'req-9a4a8be0-9133-4dfe-99b9-a64bf4fa3bd9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:35.376189 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9a4a8be0-9133-4dfe-99b9-a64bf4fa3bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f7c6cbddc94e028fc54e178ed6cc4e', 'request_id': 'req-9a4a8be0-9133-4dfe-99b9-a64bf4fa3bd9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:35.383897 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1389/2784] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:35 2022] DELETE /identity/v3/users/25a6effad5c4484d939dfc427c729029 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:35.388022 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9a4a8be0-9133-4dfe-99b9-a64bf4fa3bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f7c6cbddc94e028fc54e178ed6cc4e', 'request_id': 'req-9a4a8be0-9133-4dfe-99b9-a64bf4fa3bd9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:35.389739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10021fe-c7fc-4bfd-b994-eb3a94626c4a None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:35.390196 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10021fe-c7fc-4bfd-b994-eb3a94626c4a None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:35.390646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10021fe-c7fc-4bfd-b994-eb3a94626c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:35.405241 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9a4a8be0-9133-4dfe-99b9-a64bf4fa3bd9 admin admin] The token cache is being invalidate because project f0f7c6cbddc94e028fc54e178ed6cc4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:35.405521 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9a4a8be0-9133-4dfe-99b9-a64bf4fa3bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:35.406257 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9a4a8be0-9133-4dfe-99b9-a64bf4fa3bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:35.408082 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1396/2785] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:35 2022] DELETE /identity/v3/projects/f0f7c6cbddc94e028fc54e178ed6cc4e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:18:35.414090 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18da25-4050-4c67-b93a-7cae80096ee4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:35.414427 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18da25-4050-4c67-b93a-7cae80096ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:35.414730 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18da25-4050-4c67-b93a-7cae80096ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:35.417104 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-d10021fe-c7fc-4bfd-b994-eb3a94626c4a None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:35.418304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d10021fe-c7fc-4bfd-b994-eb3a94626c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:35.433114 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0f18da25-4050-4c67-b93a-7cae80096ee4 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:35.434295 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0f18da25-4050-4c67-b93a-7cae80096ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:35.474860 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1390/2786] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:35.485218 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10021fe-c7fc-4bfd-b994-eb3a94626c4a None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:35.486848 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-d10021fe-c7fc-4bfd-b994-eb3a94626c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:35.495673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1397/2787] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:35.504630 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fa11f-a8f8-4a76-8d3c-a902bd769038 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:35.505355 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fa11f-a8f8-4a76-8d3c-a902bd769038 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:35.505961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fa11f-a8f8-4a76-8d3c-a902bd769038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:35.527047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f64fa11f-a8f8-4a76-8d3c-a902bd769038 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:35.528671 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f64fa11f-a8f8-4a76-8d3c-a902bd769038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:35.537597 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1398/2788] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:18:35.542492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fa11f-a8f8-4a76-8d3c-a902bd769038 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:35.550296 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10021fe-c7fc-4bfd-b994-eb3a94626c4a None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:35.552716 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fa11f-a8f8-4a76-8d3c-a902bd769038 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:35.555707 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5c18d-3cff-4c80-9810-0104f2d4c12e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:35.556426 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5c18d-3cff-4c80-9810-0104f2d4c12e service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:35.556778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5c18d-3cff-4c80-9810-0104f2d4c12e service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:35.557119 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5c18d-3cff-4c80-9810-0104f2d4c12e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:35.557865 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ba1a3-f7e5-429f-b270-0fa8a5693bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:35.558583 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ba1a3-f7e5-429f-b270-0fa8a5693bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:35.558947 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ba1a3-f7e5-429f-b270-0fa8a5693bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:35.559288 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ba1a3-f7e5-429f-b270-0fa8a5693bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:35.560418 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ba1a3-f7e5-429f-b270-0fa8a5693bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:18:35.560801 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ba1a3-f7e5-429f-b270-0fa8a5693bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:35.562663 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ba1a3-f7e5-429f-b270-0fa8a5693bf9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:35.567878 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5c18d-3cff-4c80-9810-0104f2d4c12e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:35.569487 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5c18d-3cff-4c80-9810-0104f2d4c12e service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:35.575432 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1399/2789] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:18:35.579511 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ba1a3-f7e5-429f-b270-0fa8a5693bf9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:35.583651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1391/2790] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:35.594348 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ba1a3-f7e5-429f-b270-0fa8a5693bf9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:35.599395 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99253fed-a60e-4afc-b294-aabab0158293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:35.600179 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99253fed-a60e-4afc-b294-aabab0158293 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:35.600560 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99253fed-a60e-4afc-b294-aabab0158293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:35.601628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99253fed-a60e-4afc-b294-aabab0158293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:35.602403 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99253fed-a60e-4afc-b294-aabab0158293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:35.604430 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99253fed-a60e-4afc-b294-aabab0158293 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:35.632170 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1400/2791] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:35 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:35.636326 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5c18d-3cff-4c80-9810-0104f2d4c12e service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:35.649324 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5c18d-3cff-4c80-9810-0104f2d4c12e service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:35.711407 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25096b8-d383-445c-bba4-3bee0d7b5909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:35.712504 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25096b8-d383-445c-bba4-3bee0d7b5909 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:35.712976 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25096b8-d383-445c-bba4-3bee0d7b5909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:35.713715 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25096b8-d383-445c-bba4-3bee0d7b5909 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:35.714557 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25096b8-d383-445c-bba4-3bee0d7b5909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:35.717205 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25096b8-d383-445c-bba4-3bee0d7b5909 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:35.741946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1392/2792] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:35 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:35.745960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99253fed-a60e-4afc-b294-aabab0158293 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:35.757730 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99253fed-a60e-4afc-b294-aabab0158293 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:35.762959 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e2079-ddce-4d88-b219-a147711dd0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:35.763685 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e2079-ddce-4d88-b219-a147711dd0bb admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:35.763939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e2079-ddce-4d88-b219-a147711dd0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:35.764212 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e2079-ddce-4d88-b219-a147711dd0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:35.764940 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e2079-ddce-4d88-b219-a147711dd0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:35.766672 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e2079-ddce-4d88-b219-a147711dd0bb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:35.778723 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1401/2793] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:35.782643 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25096b8-d383-445c-bba4-3bee0d7b5909 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:35.794184 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25096b8-d383-445c-bba4-3bee0d7b5909 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:35.799419 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e5d12-88d9-4d60-9975-aa079ec8e0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:35.800474 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5d12-88d9-4d60-9975-aa079ec8e0cb admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:35.800889 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5d12-88d9-4d60-9975-aa079ec8e0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:35.801417 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5d12-88d9-4d60-9975-aa079ec8e0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:35.802138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e5d12-88d9-4d60-9975-aa079ec8e0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:35.804413 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e5d12-88d9-4d60-9975-aa079ec8e0cb admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:35.815118 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1393/2794] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:18:35.820039 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e2079-ddce-4d88-b219-a147711dd0bb admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:35.830589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e2079-ddce-4d88-b219-a147711dd0bb admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:35.835455 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126393a0-c7a6-4432-8745-24cdc8723a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:35.836384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126393a0-c7a6-4432-8745-24cdc8723a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:35.837084 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126393a0-c7a6-4432-8745-24cdc8723a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:35.837084 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126393a0-c7a6-4432-8745-24cdc8723a59 admin admin] PATH_INFO: `/v3/projects/de1048d537bb4d88909acd59cba08bc8/users/0d97abfaaba04fd096a7174688774bb0/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:35.852291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126393a0-c7a6-4432-8745-24cdc8723a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1048d537bb4d88909acd59cba08bc8, user_id=0d97abfaaba04fd096a7174688774bb0, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:35.855129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126393a0-c7a6-4432-8745-24cdc8723a59 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:35.867500 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e5d12-88d9-4d60-9975-aa079ec8e0cb admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:35.869496 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a86e5d12-88d9-4d60-9975-aa079ec8e0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:35.879147 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1402/2795] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:35 2022] PUT /identity/v3/projects/de1048d537bb4d88909acd59cba08bc8/users/0d97abfaaba04fd096a7174688774bb0/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:35.881656 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf871859-cabe-4993-9941-c2785f36643d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:35.882574 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf871859-cabe-4993-9941-c2785f36643d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:35.882770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf871859-cabe-4993-9941-c2785f36643d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:35.885490 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e5d12-88d9-4d60-9975-aa079ec8e0cb admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:35.910768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cf871859-cabe-4993-9941-c2785f36643d None None] MFA Rules not processed for user `0d97abfaaba04fd096a7174688774bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:35.912028 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cf871859-cabe-4993-9941-c2785f36643d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:35.946084 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a4594-b2fb-4e4a-bc56-d207c4c99687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:35.946865 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a4594-b2fb-4e4a-bc56-d207c4c99687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:35.947145 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a4594-b2fb-4e4a-bc56-d207c4c99687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:35.947419 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a4594-b2fb-4e4a-bc56-d207c4c99687 admin admin] PATH_INFO: `/v3/projects/8a756546d7eb416ebf4ab750089cb496` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:35.948622 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a4594-b2fb-4e4a-bc56-d207c4c99687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a756546d7eb416ebf4ab750089cb496)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:35.950543 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a4594-b2fb-4e4a-bc56-d207c4c99687 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:35.975286 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1403/2796] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:35.987456 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf871859-cabe-4993-9941-c2785f36643d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:35.988921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cf871859-cabe-4993-9941-c2785f36643d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:35.997634 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-326a4594-b2fb-4e4a-bc56-d207c4c99687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a756546d7eb416ebf4ab750089cb496', 'request_id': 'req-326a4594-b2fb-4e4a-bc56-d207c4c99687'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:36.003191 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-326a4594-b2fb-4e4a-bc56-d207c4c99687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a756546d7eb416ebf4ab750089cb496', 'request_id': 'req-326a4594-b2fb-4e4a-bc56-d207c4c99687'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:36.010575 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-326a4594-b2fb-4e4a-bc56-d207c4c99687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a756546d7eb416ebf4ab750089cb496', 'request_id': 'req-326a4594-b2fb-4e4a-bc56-d207c4c99687'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:36.023058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-326a4594-b2fb-4e4a-bc56-d207c4c99687 admin admin] The token cache is being invalidate because project 8a756546d7eb416ebf4ab750089cb496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:36.023360 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-326a4594-b2fb-4e4a-bc56-d207c4c99687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:36.024005 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-326a4594-b2fb-4e4a-bc56-d207c4c99687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:36.025797 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1394/2797] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:35 2022] DELETE /identity/v3/projects/8a756546d7eb416ebf4ab750089cb496 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:18:36.032840 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e433b-7cd6-49bd-8210-f117a7cd7306 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:36.033165 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e433b-7cd6-49bd-8210-f117a7cd7306 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:36.033424 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e433b-7cd6-49bd-8210-f117a7cd7306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:36.051024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3b9e433b-7cd6-49bd-8210-f117a7cd7306 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:36.051609 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf871859-cabe-4993-9941-c2785f36643d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:36.052239 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3b9e433b-7cd6-49bd-8210-f117a7cd7306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:36.100362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d23ed7-b528-43fa-a12e-7b07dd9f4cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:36.101545 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d23ed7-b528-43fa-a12e-7b07dd9f4cdf service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:36.101852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d23ed7-b528-43fa-a12e-7b07dd9f4cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:36.102088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d23ed7-b528-43fa-a12e-7b07dd9f4cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:36.103914 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-31d23ed7-b528-43fa-a12e-7b07dd9f4cdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:36.110959 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1395/2798] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:18:36.118866 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ba84b-a408-4a72-b340-361843c56fe7 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:36.119156 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ba84b-a408-4a72-b340-361843c56fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:36.119473 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ba84b-a408-4a72-b340-361843c56fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:36.138452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a16ba84b-a408-4a72-b340-361843c56fe7 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:36.139679 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a16ba84b-a408-4a72-b340-361843c56fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:36.147656 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1396/2799] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:18:36.152429 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ba84b-a408-4a72-b340-361843c56fe7 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:36.160778 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d23ed7-b528-43fa-a12e-7b07dd9f4cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:36.160988 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ba84b-a408-4a72-b340-361843c56fe7 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:36.162220 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d23ed7-b528-43fa-a12e-7b07dd9f4cdf service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:36.166465 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc059f-cf2a-44b9-9eb4-67b7239f5a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:36.167116 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc059f-cf2a-44b9-9eb4-67b7239f5a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:36.167399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc059f-cf2a-44b9-9eb4-67b7239f5a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:36.167710 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc059f-cf2a-44b9-9eb4-67b7239f5a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:36.168493 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc059f-cf2a-44b9-9eb4-67b7239f5a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:18:36.168787 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc059f-cf2a-44b9-9eb4-67b7239f5a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:36.170416 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc059f-cf2a-44b9-9eb4-67b7239f5a1d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:36.171966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1404/2800] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 17:18:36.182802 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1397/2801] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:18:36.187029 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d23ed7-b528-43fa-a12e-7b07dd9f4cdf service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:36.197382 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d23ed7-b528-43fa-a12e-7b07dd9f4cdf service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:36.201855 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff6c17-4bd3-4fa7-bbed-c6c55d492bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:36.202496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff6c17-4bd3-4fa7-bbed-c6c55d492bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:36.202776 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff6c17-4bd3-4fa7-bbed-c6c55d492bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:36.203042 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff6c17-4bd3-4fa7-bbed-c6c55d492bd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:36.203759 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff6c17-4bd3-4fa7-bbed-c6c55d492bd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:36.205641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff6c17-4bd3-4fa7-bbed-c6c55d492bd0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:36.236764 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1405/2802] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:36 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:18:36.240734 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc059f-cf2a-44b9-9eb4-67b7239f5a1d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:36.252171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc059f-cf2a-44b9-9eb4-67b7239f5a1d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:36.318746 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809707d-4f2f-43ba-b572-55a9bbc10f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:36.319592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809707d-4f2f-43ba-b572-55a9bbc10f0d admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:36.320210 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809707d-4f2f-43ba-b572-55a9bbc10f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:36.320764 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809707d-4f2f-43ba-b572-55a9bbc10f0d admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:36.321387 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809707d-4f2f-43ba-b572-55a9bbc10f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:36.323511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809707d-4f2f-43ba-b572-55a9bbc10f0d admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:36.347367 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1398/2803] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:36 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:36.352275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff6c17-4bd3-4fa7-bbed-c6c55d492bd0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:36.363183 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff6c17-4bd3-4fa7-bbed-c6c55d492bd0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:36.368033 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1075c6-a442-4488-948d-3645f1860355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:36.368737 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1075c6-a442-4488-948d-3645f1860355 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:36.368984 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1075c6-a442-4488-948d-3645f1860355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:36.369465 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1075c6-a442-4488-948d-3645f1860355 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:36.370379 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1075c6-a442-4488-948d-3645f1860355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:36.372930 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1075c6-a442-4488-948d-3645f1860355 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:36.385560 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1406/2804] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:36.389540 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809707d-4f2f-43ba-b572-55a9bbc10f0d admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:36.401736 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809707d-4f2f-43ba-b572-55a9bbc10f0d admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:36.405944 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6e802-1903-4efa-aa45-e4a7b7a3e4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:36.406797 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6e802-1903-4efa-aa45-e4a7b7a3e4bc admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:36.407162 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6e802-1903-4efa-aa45-e4a7b7a3e4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:36.407511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6e802-1903-4efa-aa45-e4a7b7a3e4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:36.408403 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6e802-1903-4efa-aa45-e4a7b7a3e4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:36.412289 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6e802-1903-4efa-aa45-e4a7b7a3e4bc admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:36.427882 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1399/2805] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:36.429129 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1075c6-a442-4488-948d-3645f1860355 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:36.441584 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1075c6-a442-4488-948d-3645f1860355 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:36.446895 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a589ed-7ee5-4dad-b2c0-8bc480b29539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:36.448055 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a589ed-7ee5-4dad-b2c0-8bc480b29539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:36.448345 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a589ed-7ee5-4dad-b2c0-8bc480b29539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:36.448688 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a589ed-7ee5-4dad-b2c0-8bc480b29539 admin admin] PATH_INFO: `/v3/projects/ba9cfe02d2bc429d8f376fc7925cbbf9/users/bebb55b1588f4d8698d12df7521fd1bd/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:36.466499 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a589ed-7ee5-4dad-b2c0-8bc480b29539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9cfe02d2bc429d8f376fc7925cbbf9, user_id=bebb55b1588f4d8698d12df7521fd1bd, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:36.472428 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a589ed-7ee5-4dad-b2c0-8bc480b29539 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:36.488453 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1407/2806] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:36 2022] PUT /identity/v3/projects/ba9cfe02d2bc429d8f376fc7925cbbf9/users/bebb55b1588f4d8698d12df7521fd1bd/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:36.499122 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6c3bc-f5cf-4d64-a1df-e0e2074951ba None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:36.499561 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6c3bc-f5cf-4d64-a1df-e0e2074951ba None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:36.499875 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6c3bc-f5cf-4d64-a1df-e0e2074951ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:36.527924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3de6c3bc-f5cf-4d64-a1df-e0e2074951ba None None] MFA Rules not processed for user `bebb55b1588f4d8698d12df7521fd1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:36.529421 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3de6c3bc-f5cf-4d64-a1df-e0e2074951ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:36.593974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1400/2807] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:36.606426 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a589ed-7ee5-4dad-b2c0-8bc480b29539 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:36.608357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-57a589ed-7ee5-4dad-b2c0-8bc480b29539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:36.664334 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a589ed-7ee5-4dad-b2c0-8bc480b29539 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:36.667977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceaf5c8-d4d9-406e-b220-d0c76a27435b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:36.668616 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaf5c8-d4d9-406e-b220-d0c76a27435b service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:36.668898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaf5c8-d4d9-406e-b220-d0c76a27435b service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:36.669173 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaf5c8-d4d9-406e-b220-d0c76a27435b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:36.677154 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceaf5c8-d4d9-406e-b220-d0c76a27435b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:36.678639 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceaf5c8-d4d9-406e-b220-d0c76a27435b service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:36.687206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1408/2808] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:38.492529 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6c3bc-f5cf-4d64-a1df-e0e2074951ba None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:38.494566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3de6c3bc-f5cf-4d64-a1df-e0e2074951ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:38.557776 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6c3bc-f5cf-4d64-a1df-e0e2074951ba None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:38.562282 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de311fb9-3681-4c4f-9ca3-73d4969fa844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:38.563147 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de311fb9-3681-4c4f-9ca3-73d4969fa844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:38.563425 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de311fb9-3681-4c4f-9ca3-73d4969fa844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:38.563731 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de311fb9-3681-4c4f-9ca3-73d4969fa844 admin admin] PATH_INFO: `/v3/users/12090ac2033e4bd0b427248bbfdeef7c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:38.564906 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de311fb9-3681-4c4f-9ca3-73d4969fa844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12090ac2033e4bd0b427248bbfdeef7c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:38.566822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de311fb9-3681-4c4f-9ca3-73d4969fa844 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:38.610504 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-de311fb9-3681-4c4f-9ca3-73d4969fa844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12090ac2033e4bd0b427248bbfdeef7c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:38.611149 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-de311fb9-3681-4c4f-9ca3-73d4969fa844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12090ac2033e4bd0b427248bbfdeef7c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:38.622949 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-de311fb9-3681-4c4f-9ca3-73d4969fa844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12090ac2033e4bd0b427248bbfdeef7c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:38.629848 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-de311fb9-3681-4c4f-9ca3-73d4969fa844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12090ac2033e4bd0b427248bbfdeef7c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:38.630516 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-de311fb9-3681-4c4f-9ca3-73d4969fa844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12090ac2033e4bd0b427248bbfdeef7c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:38.643243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1401/2809] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:38 2022] DELETE /identity/v3/users/12090ac2033e4bd0b427248bbfdeef7c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:38.649591 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a81637-6dca-4358-821a-711538d1c79e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:38.650090 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a81637-6dca-4358-821a-711538d1c79e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:38.650200 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a81637-6dca-4358-821a-711538d1c79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:38.667786 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-34a81637-6dca-4358-821a-711538d1c79e None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:38.668967 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-34a81637-6dca-4358-821a-711538d1c79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:38.729207 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1409/2810] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:18:38.737884 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de311fb9-3681-4c4f-9ca3-73d4969fa844 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:38.739451 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-de311fb9-3681-4c4f-9ca3-73d4969fa844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:38.796567 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de311fb9-3681-4c4f-9ca3-73d4969fa844 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:38.800391 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3b599-210b-49b5-965b-4f64aa7d3e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:38.801046 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3b599-210b-49b5-965b-4f64aa7d3e12 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:38.801380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3b599-210b-49b5-965b-4f64aa7d3e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:38.801665 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3b599-210b-49b5-965b-4f64aa7d3e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:38.811514 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3b599-210b-49b5-965b-4f64aa7d3e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:38.812974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3b599-210b-49b5-965b-4f64aa7d3e12 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:38.822173 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1402/2811] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:39.083942 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a81637-6dca-4358-821a-711538d1c79e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:39.085482 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-34a81637-6dca-4358-821a-711538d1c79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:39.098904 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a81637-6dca-4358-821a-711538d1c79e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:39.104023 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d2ceb-34b3-44cc-871c-585550f213db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:39.105035 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d2ceb-34b3-44cc-871c-585550f213db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:39.105312 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d2ceb-34b3-44cc-871c-585550f213db admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:39.105580 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d2ceb-34b3-44cc-871c-585550f213db admin admin] PATH_INFO: `/v3/projects/b8656ffc24e54f4e90c1023b46f7ed19` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:39.106773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d2ceb-34b3-44cc-871c-585550f213db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8656ffc24e54f4e90c1023b46f7ed19)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:39.108796 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d2ceb-34b3-44cc-871c-585550f213db admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:39.154667 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-498d2ceb-34b3-44cc-871c-585550f213db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8656ffc24e54f4e90c1023b46f7ed19', 'request_id': 'req-498d2ceb-34b3-44cc-871c-585550f213db'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:39.159966 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-498d2ceb-34b3-44cc-871c-585550f213db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8656ffc24e54f4e90c1023b46f7ed19', 'request_id': 'req-498d2ceb-34b3-44cc-871c-585550f213db'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:39.167631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-498d2ceb-34b3-44cc-871c-585550f213db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8656ffc24e54f4e90c1023b46f7ed19', 'request_id': 'req-498d2ceb-34b3-44cc-871c-585550f213db'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:39.178423 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-498d2ceb-34b3-44cc-871c-585550f213db admin admin] The token cache is being invalidate because project b8656ffc24e54f4e90c1023b46f7ed19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:39.178709 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-498d2ceb-34b3-44cc-871c-585550f213db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:39.179350 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-498d2ceb-34b3-44cc-871c-585550f213db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:39.180910 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1410/2812] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:39 2022] DELETE /identity/v3/projects/b8656ffc24e54f4e90c1023b46f7ed19 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:39.186518 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460a51c-c425-4ce8-a49e-07d3b56cbadf None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:39.186807 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460a51c-c425-4ce8-a49e-07d3b56cbadf None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:39.187079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460a51c-c425-4ce8-a49e-07d3b56cbadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:39.204301 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-2460a51c-c425-4ce8-a49e-07d3b56cbadf None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:39.205485 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2460a51c-c425-4ce8-a49e-07d3b56cbadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:39.266646 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1403/2813] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:39.274669 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60f668-ca18-444d-aea2-0fd568917125 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:39.274958 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60f668-ca18-444d-aea2-0fd568917125 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:39.276000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60f668-ca18-444d-aea2-0fd568917125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:39.294156 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bc60f668-ca18-444d-aea2-0fd568917125 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:39.295338 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bc60f668-ca18-444d-aea2-0fd568917125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:39.303210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1411/2814] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:39.307852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460a51c-c425-4ce8-a49e-07d3b56cbadf None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:39.317180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460a51c-c425-4ce8-a49e-07d3b56cbadf None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:39.321796 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2148405-2065-4875-ae81-228500dd1feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:39.322668 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2148405-2065-4875-ae81-228500dd1feb admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:39.323040 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2148405-2065-4875-ae81-228500dd1feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:39.323317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2148405-2065-4875-ae81-228500dd1feb admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:39.324077 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2148405-2065-4875-ae81-228500dd1feb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:18:39.324386 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2148405-2065-4875-ae81-228500dd1feb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:39.325964 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2148405-2065-4875-ae81-228500dd1feb admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:39.336954 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1404/2815] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:18:39.341627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60f668-ca18-444d-aea2-0fd568917125 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:39.350710 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60f668-ca18-444d-aea2-0fd568917125 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:39.356405 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b16f4-f788-4e5f-8e04-e3d255f51374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:39.357049 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b16f4-f788-4e5f-8e04-e3d255f51374 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:39.357360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b16f4-f788-4e5f-8e04-e3d255f51374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:39.357636 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b16f4-f788-4e5f-8e04-e3d255f51374 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:39.358344 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b16f4-f788-4e5f-8e04-e3d255f51374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:39.360417 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b16f4-f788-4e5f-8e04-e3d255f51374 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:39.384555 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1412/2816] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:39 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:39.388821 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2148405-2065-4875-ae81-228500dd1feb admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:39.398711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2148405-2065-4875-ae81-228500dd1feb admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:39.454431 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac39f7-90cf-4b1c-bf47-d357657e6865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:39.455097 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac39f7-90cf-4b1c-bf47-d357657e6865 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:39.455378 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac39f7-90cf-4b1c-bf47-d357657e6865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:39.455681 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac39f7-90cf-4b1c-bf47-d357657e6865 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:39.456372 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac39f7-90cf-4b1c-bf47-d357657e6865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:39.458287 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac39f7-90cf-4b1c-bf47-d357657e6865 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:39.477852 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1405/2817] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:39 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:39.483088 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b16f4-f788-4e5f-8e04-e3d255f51374 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:39.493322 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b16f4-f788-4e5f-8e04-e3d255f51374 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:39.497990 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8dfe2-2ef1-41c2-9d1b-c93be9341f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:39.498640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8dfe2-2ef1-41c2-9d1b-c93be9341f5a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:39.498918 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8dfe2-2ef1-41c2-9d1b-c93be9341f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:39.499217 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8dfe2-2ef1-41c2-9d1b-c93be9341f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:39.499960 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8dfe2-2ef1-41c2-9d1b-c93be9341f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:39.501542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8dfe2-2ef1-41c2-9d1b-c93be9341f5a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:39.511686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1413/2818] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:39.515715 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac39f7-90cf-4b1c-bf47-d357657e6865 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:39.526310 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac39f7-90cf-4b1c-bf47-d357657e6865 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:39.530979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8abfe-6015-4520-bf29-86ecec5cb667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:39.531625 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8abfe-6015-4520-bf29-86ecec5cb667 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:39.531924 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8abfe-6015-4520-bf29-86ecec5cb667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:39.532202 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8abfe-6015-4520-bf29-86ecec5cb667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:39.532917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8abfe-6015-4520-bf29-86ecec5cb667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:39.534498 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8abfe-6015-4520-bf29-86ecec5cb667 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:39.544957 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1406/2819] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:39.549054 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8dfe2-2ef1-41c2-9d1b-c93be9341f5a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:39.559062 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8dfe2-2ef1-41c2-9d1b-c93be9341f5a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:39.563631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee5c4-6bfa-4209-b307-82ca08f6e034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:39.564521 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee5c4-6bfa-4209-b307-82ca08f6e034 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:39.564800 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee5c4-6bfa-4209-b307-82ca08f6e034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:39.565073 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee5c4-6bfa-4209-b307-82ca08f6e034 admin admin] PATH_INFO: `/v3/projects/3d27922170ad411198f2cc0676de346c/users/ae5d7648c79c46d7ba3444fc05e9b4cc/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:39.579505 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ee5c4-6bfa-4209-b307-82ca08f6e034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d27922170ad411198f2cc0676de346c, user_id=ae5d7648c79c46d7ba3444fc05e9b4cc, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:39.582164 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ee5c4-6bfa-4209-b307-82ca08f6e034 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:39.596563 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1414/2820] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:39 2022] PUT /identity/v3/projects/3d27922170ad411198f2cc0676de346c/users/ae5d7648c79c46d7ba3444fc05e9b4cc/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:39.607583 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ec73c-2992-49f5-b8b9-dd2aaf26623c None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:39.607903 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ec73c-2992-49f5-b8b9-dd2aaf26623c None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:39.608180 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ec73c-2992-49f5-b8b9-dd2aaf26623c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:39.633807 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c34ec73c-2992-49f5-b8b9-dd2aaf26623c None None] MFA Rules not processed for user `ae5d7648c79c46d7ba3444fc05e9b4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:39.635741 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c34ec73c-2992-49f5-b8b9-dd2aaf26623c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:39.695508 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1407/2821] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:39.706885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee5c4-6bfa-4209-b307-82ca08f6e034 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:39.708588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8d8ee5c4-6bfa-4209-b307-82ca08f6e034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:39.765045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee5c4-6bfa-4209-b307-82ca08f6e034 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:39.768668 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e653db-1fcf-4dff-85b8-da10352a26d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:39.769318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e653db-1fcf-4dff-85b8-da10352a26d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:39.769603 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e653db-1fcf-4dff-85b8-da10352a26d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:39.769879 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e653db-1fcf-4dff-85b8-da10352a26d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:39.778406 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e653db-1fcf-4dff-85b8-da10352a26d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:39.779885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e653db-1fcf-4dff-85b8-da10352a26d1 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:39.789138 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1415/2822] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:39.815322 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ec73c-2992-49f5-b8b9-dd2aaf26623c None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:39.877858 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ec73c-2992-49f5-b8b9-dd2aaf26623c None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:39.882454 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3750a-1e1e-4de3-ab19-7f68f79b93fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:39.883349 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3750a-1e1e-4de3-ab19-7f68f79b93fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:39.883662 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3750a-1e1e-4de3-ab19-7f68f79b93fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:39.883942 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3750a-1e1e-4de3-ab19-7f68f79b93fb admin admin] PATH_INFO: `/v3/users/ae5d7648c79c46d7ba3444fc05e9b4cc` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:39.885332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3750a-1e1e-4de3-ab19-7f68f79b93fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5d7648c79c46d7ba3444fc05e9b4cc)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:39.887238 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3750a-1e1e-4de3-ab19-7f68f79b93fb admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:39.934373 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2af3750a-1e1e-4de3-ab19-7f68f79b93fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5d7648c79c46d7ba3444fc05e9b4cc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:39.935068 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2af3750a-1e1e-4de3-ab19-7f68f79b93fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5d7648c79c46d7ba3444fc05e9b4cc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:39.947530 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2af3750a-1e1e-4de3-ab19-7f68f79b93fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5d7648c79c46d7ba3444fc05e9b4cc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:39.954074 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2af3750a-1e1e-4de3-ab19-7f68f79b93fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5d7648c79c46d7ba3444fc05e9b4cc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:39.954724 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-2af3750a-1e1e-4de3-ab19-7f68f79b93fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5d7648c79c46d7ba3444fc05e9b4cc'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:39.968095 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1408/2823] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:39 2022] DELETE /identity/v3/users/ae5d7648c79c46d7ba3444fc05e9b4cc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:39.972637 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be1f57-76d5-4192-b094-6b76e9a6777e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:39.972921 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be1f57-76d5-4192-b094-6b76e9a6777e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:39.973220 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be1f57-76d5-4192-b094-6b76e9a6777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:39.990963 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a7be1f57-76d5-4192-b094-6b76e9a6777e None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:39.992173 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a7be1f57-76d5-4192-b094-6b76e9a6777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:40.049238 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1416/2824] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:40.058921 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3750a-1e1e-4de3-ab19-7f68f79b93fb admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:40.060329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-2af3750a-1e1e-4de3-ab19-7f68f79b93fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:40.114784 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3750a-1e1e-4de3-ab19-7f68f79b93fb admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:40.118343 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551965f-f176-4e20-b8ec-979553cc7401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:40.119015 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551965f-f176-4e20-b8ec-979553cc7401 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:40.119294 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551965f-f176-4e20-b8ec-979553cc7401 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:40.119569 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551965f-f176-4e20-b8ec-979553cc7401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:40.128293 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551965f-f176-4e20-b8ec-979553cc7401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:40.129728 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551965f-f176-4e20-b8ec-979553cc7401 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:40.139434 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1409/2825] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:40.396881 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be1f57-76d5-4192-b094-6b76e9a6777e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:40.398341 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a7be1f57-76d5-4192-b094-6b76e9a6777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:40.410771 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be1f57-76d5-4192-b094-6b76e9a6777e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:40.415351 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0d4a3-5156-46ee-a8f4-3aa0d6862c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:40.416861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0d4a3-5156-46ee-a8f4-3aa0d6862c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:40.417178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0d4a3-5156-46ee-a8f4-3aa0d6862c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:40.417420 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0d4a3-5156-46ee-a8f4-3aa0d6862c61 admin admin] PATH_INFO: `/v3/projects/3d27922170ad411198f2cc0676de346c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:40.418612 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0d4a3-5156-46ee-a8f4-3aa0d6862c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d27922170ad411198f2cc0676de346c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:40.420673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0d4a3-5156-46ee-a8f4-3aa0d6862c61 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:40.468207 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cdb0d4a3-5156-46ee-a8f4-3aa0d6862c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d27922170ad411198f2cc0676de346c', 'request_id': 'req-cdb0d4a3-5156-46ee-a8f4-3aa0d6862c61'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:40.473362 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cdb0d4a3-5156-46ee-a8f4-3aa0d6862c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d27922170ad411198f2cc0676de346c', 'request_id': 'req-cdb0d4a3-5156-46ee-a8f4-3aa0d6862c61'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:40.481029 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cdb0d4a3-5156-46ee-a8f4-3aa0d6862c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d27922170ad411198f2cc0676de346c', 'request_id': 'req-cdb0d4a3-5156-46ee-a8f4-3aa0d6862c61'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:40.491975 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cdb0d4a3-5156-46ee-a8f4-3aa0d6862c61 admin admin] The token cache is being invalidate because project 3d27922170ad411198f2cc0676de346c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:40.492279 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cdb0d4a3-5156-46ee-a8f4-3aa0d6862c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:40.492884 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-cdb0d4a3-5156-46ee-a8f4-3aa0d6862c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:40.495063 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1417/2826] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:40 2022] DELETE /identity/v3/projects/3d27922170ad411198f2cc0676de346c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:40.502193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96023db-0de1-40e3-9200-b7fbd488bdde None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:40.502696 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96023db-0de1-40e3-9200-b7fbd488bdde None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:40.503193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96023db-0de1-40e3-9200-b7fbd488bdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:40.521054 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-b96023db-0de1-40e3-9200-b7fbd488bdde None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:40.522244 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b96023db-0de1-40e3-9200-b7fbd488bdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:40.579946 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1410/2827] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:40.588900 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab74d6-86af-4858-a0fe-4f58c7a86445 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:40.589308 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab74d6-86af-4858-a0fe-4f58c7a86445 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:40.589691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab74d6-86af-4858-a0fe-4f58c7a86445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:40.611542 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5fab74d6-86af-4858-a0fe-4f58c7a86445 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:40.612744 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5fab74d6-86af-4858-a0fe-4f58c7a86445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:40.621608 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1418/2828] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:40.626065 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96023db-0de1-40e3-9200-b7fbd488bdde None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:40.635739 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96023db-0de1-40e3-9200-b7fbd488bdde None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:40.640473 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf10c0b-d5a0-4aa4-a842-b2819b3f1c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:40.641175 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf10c0b-d5a0-4aa4-a842-b2819b3f1c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:40.641457 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf10c0b-d5a0-4aa4-a842-b2819b3f1c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:40.641731 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf10c0b-d5a0-4aa4-a842-b2819b3f1c20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:40.642449 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf10c0b-d5a0-4aa4-a842-b2819b3f1c20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:18:40.642754 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf10c0b-d5a0-4aa4-a842-b2819b3f1c20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:40.644396 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf10c0b-d5a0-4aa4-a842-b2819b3f1c20 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:40.656008 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1411/2829] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:18:40.660541 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab74d6-86af-4858-a0fe-4f58c7a86445 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:40.670273 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab74d6-86af-4858-a0fe-4f58c7a86445 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:40.676651 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cde22f-8236-46a3-be01-55a3159ca12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:40.677309 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cde22f-8236-46a3-be01-55a3159ca12a admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:40.677588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cde22f-8236-46a3-be01-55a3159ca12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:40.677859 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cde22f-8236-46a3-be01-55a3159ca12a admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:40.678551 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cde22f-8236-46a3-be01-55a3159ca12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:40.680845 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cde22f-8236-46a3-be01-55a3159ca12a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:40.708206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1419/2830] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:40 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:40.713513 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf10c0b-d5a0-4aa4-a842-b2819b3f1c20 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:40.723810 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf10c0b-d5a0-4aa4-a842-b2819b3f1c20 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:40.783559 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4501aee-7307-4ce4-af1b-ea6c527be413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:40.784268 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4501aee-7307-4ce4-af1b-ea6c527be413 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:40.784552 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4501aee-7307-4ce4-af1b-ea6c527be413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:40.784830 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4501aee-7307-4ce4-af1b-ea6c527be413 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:40.785517 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4501aee-7307-4ce4-af1b-ea6c527be413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:40.787778 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4501aee-7307-4ce4-af1b-ea6c527be413 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:40.807328 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1412/2831] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:40 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:40.811502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cde22f-8236-46a3-be01-55a3159ca12a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:40.821798 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cde22f-8236-46a3-be01-55a3159ca12a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:40.827568 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3d442-d114-4f76-bd1d-ffb53da08229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:40.828628 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3d442-d114-4f76-bd1d-ffb53da08229 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:40.828763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3d442-d114-4f76-bd1d-ffb53da08229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:40.829140 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3d442-d114-4f76-bd1d-ffb53da08229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:40.830064 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3d442-d114-4f76-bd1d-ffb53da08229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:40.831833 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3d442-d114-4f76-bd1d-ffb53da08229 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:40.843302 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1420/2832] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:40.847453 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4501aee-7307-4ce4-af1b-ea6c527be413 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:40.858374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4501aee-7307-4ce4-af1b-ea6c527be413 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:40.864117 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceab177-cbb3-4a0d-85e7-2b282f50cedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:40.864774 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceab177-cbb3-4a0d-85e7-2b282f50cedd admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:40.865058 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceab177-cbb3-4a0d-85e7-2b282f50cedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:40.865337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceab177-cbb3-4a0d-85e7-2b282f50cedd admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:40.866057 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceab177-cbb3-4a0d-85e7-2b282f50cedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:40.867672 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceab177-cbb3-4a0d-85e7-2b282f50cedd admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:40.877822 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1413/2833] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:40.882012 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3d442-d114-4f76-bd1d-ffb53da08229 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:40.891815 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3d442-d114-4f76-bd1d-ffb53da08229 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:40.896521 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c38fa-6de6-4ba7-a295-787e7dc9b8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:40.897392 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c38fa-6de6-4ba7-a295-787e7dc9b8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:40.897673 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c38fa-6de6-4ba7-a295-787e7dc9b8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:40.897948 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c38fa-6de6-4ba7-a295-787e7dc9b8d4 admin admin] PATH_INFO: `/v3/projects/141ccb11a3e9417a8684a1b14109db45/users/6f7ff5347a504b519e7716bdcf6e44db/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:40.913833 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c38fa-6de6-4ba7-a295-787e7dc9b8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141ccb11a3e9417a8684a1b14109db45, user_id=6f7ff5347a504b519e7716bdcf6e44db, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:40.917182 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c38fa-6de6-4ba7-a295-787e7dc9b8d4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:40.929857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1421/2834] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:40 2022] PUT /identity/v3/projects/141ccb11a3e9417a8684a1b14109db45/users/6f7ff5347a504b519e7716bdcf6e44db/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:40.940546 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa01ed0-476e-4771-a036-a8b3656233a9 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:40.940839 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa01ed0-476e-4771-a036-a8b3656233a9 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:40.941132 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa01ed0-476e-4771-a036-a8b3656233a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:40.968700 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-7aa01ed0-476e-4771-a036-a8b3656233a9 None None] MFA Rules not processed for user `6f7ff5347a504b519e7716bdcf6e44db`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:40.970013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7aa01ed0-476e-4771-a036-a8b3656233a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:41.036947 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1414/2835] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:41.048892 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c38fa-6de6-4ba7-a295-787e7dc9b8d4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:41.050691 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fc3c38fa-6de6-4ba7-a295-787e7dc9b8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:41.109070 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c38fa-6de6-4ba7-a295-787e7dc9b8d4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:41.114679 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2020156-9e94-4949-8d0d-1cbeafb54f23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:41.115588 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2020156-9e94-4949-8d0d-1cbeafb54f23 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:41.116092 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2020156-9e94-4949-8d0d-1cbeafb54f23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:41.116559 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2020156-9e94-4949-8d0d-1cbeafb54f23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:41.132496 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2020156-9e94-4949-8d0d-1cbeafb54f23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:41.134269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2020156-9e94-4949-8d0d-1cbeafb54f23 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:41.144565 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1422/2836] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:41.392264 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa01ed0-476e-4771-a036-a8b3656233a9 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:41.393717 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-7aa01ed0-476e-4771-a036-a8b3656233a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:41.464000 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa01ed0-476e-4771-a036-a8b3656233a9 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:41.468627 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe3ba7-0d59-40c5-84f6-446e543e25ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:41.469498 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe3ba7-0d59-40c5-84f6-446e543e25ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:41.469826 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe3ba7-0d59-40c5-84f6-446e543e25ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:41.470127 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe3ba7-0d59-40c5-84f6-446e543e25ea admin admin] PATH_INFO: `/v3/users/bebb55b1588f4d8698d12df7521fd1bd` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:41.472167 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe3ba7-0d59-40c5-84f6-446e543e25ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=bebb55b1588f4d8698d12df7521fd1bd)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:41.475165 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe3ba7-0d59-40c5-84f6-446e543e25ea admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:41.523741 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a6fe3ba7-0d59-40c5-84f6-446e543e25ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bebb55b1588f4d8698d12df7521fd1bd'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:41.524842 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a6fe3ba7-0d59-40c5-84f6-446e543e25ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bebb55b1588f4d8698d12df7521fd1bd'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:41.537201 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a6fe3ba7-0d59-40c5-84f6-446e543e25ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bebb55b1588f4d8698d12df7521fd1bd'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:41.555426 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a6fe3ba7-0d59-40c5-84f6-446e543e25ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bebb55b1588f4d8698d12df7521fd1bd'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:41.556722 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-a6fe3ba7-0d59-40c5-84f6-446e543e25ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bebb55b1588f4d8698d12df7521fd1bd'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:41.570797 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1415/2837] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:41 2022] DELETE /identity/v3/users/bebb55b1588f4d8698d12df7521fd1bd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:41.576121 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ae6f8-3656-4863-aa81-280f9cc6aafd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:41.576502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ae6f8-3656-4863-aa81-280f9cc6aafd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:41.576706 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ae6f8-3656-4863-aa81-280f9cc6aafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:41.596365 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5b8ae6f8-3656-4863-aa81-280f9cc6aafd None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:41.597791 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5b8ae6f8-3656-4863-aa81-280f9cc6aafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:41.657777 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1423/2838] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:18:41.667617 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe3ba7-0d59-40c5-84f6-446e543e25ea admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:41.669023 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a6fe3ba7-0d59-40c5-84f6-446e543e25ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:41.724397 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe3ba7-0d59-40c5-84f6-446e543e25ea admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:41.728170 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bcf39-1126-4e41-ae22-78c942bd66ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:41.728917 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bcf39-1126-4e41-ae22-78c942bd66ef service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:41.729228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bcf39-1126-4e41-ae22-78c942bd66ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:41.729511 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bcf39-1126-4e41-ae22-78c942bd66ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:41.738785 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bcf39-1126-4e41-ae22-78c942bd66ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:41.740292 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bcf39-1126-4e41-ae22-78c942bd66ef service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:41.750157 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1416/2839] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:42.017390 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ae6f8-3656-4863-aa81-280f9cc6aafd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:42.019366 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5b8ae6f8-3656-4863-aa81-280f9cc6aafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:42.032360 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ae6f8-3656-4863-aa81-280f9cc6aafd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:42.037119 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272dcbb-36a4-49fd-8f8d-6ce6dc76385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:42.038082 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272dcbb-36a4-49fd-8f8d-6ce6dc76385f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:42.038590 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272dcbb-36a4-49fd-8f8d-6ce6dc76385f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:42.038953 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272dcbb-36a4-49fd-8f8d-6ce6dc76385f admin admin] PATH_INFO: `/v3/projects/ba9cfe02d2bc429d8f376fc7925cbbf9` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:42.040502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272dcbb-36a4-49fd-8f8d-6ce6dc76385f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba9cfe02d2bc429d8f376fc7925cbbf9)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:42.043413 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272dcbb-36a4-49fd-8f8d-6ce6dc76385f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:42.089027 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1272dcbb-36a4-49fd-8f8d-6ce6dc76385f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba9cfe02d2bc429d8f376fc7925cbbf9', 'request_id': 'req-1272dcbb-36a4-49fd-8f8d-6ce6dc76385f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:42.094539 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1272dcbb-36a4-49fd-8f8d-6ce6dc76385f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba9cfe02d2bc429d8f376fc7925cbbf9', 'request_id': 'req-1272dcbb-36a4-49fd-8f8d-6ce6dc76385f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:42.102340 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1272dcbb-36a4-49fd-8f8d-6ce6dc76385f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba9cfe02d2bc429d8f376fc7925cbbf9', 'request_id': 'req-1272dcbb-36a4-49fd-8f8d-6ce6dc76385f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:42.114107 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1272dcbb-36a4-49fd-8f8d-6ce6dc76385f admin admin] The token cache is being invalidate because project ba9cfe02d2bc429d8f376fc7925cbbf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:42.114396 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1272dcbb-36a4-49fd-8f8d-6ce6dc76385f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:42.115024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1272dcbb-36a4-49fd-8f8d-6ce6dc76385f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:42.116594 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1424/2840] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:42 2022] DELETE /identity/v3/projects/ba9cfe02d2bc429d8f376fc7925cbbf9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:43.557663 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bcf39-1126-4e41-ae22-78c942bd66ef service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:43.559055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-808bcf39-1126-4e41-ae22-78c942bd66ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:43.571380 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bcf39-1126-4e41-ae22-78c942bd66ef service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:43.623550 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c0f9b-514c-445a-9076-087d85e5f271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:43.624437 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c0f9b-514c-445a-9076-087d85e5f271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:43.624712 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c0f9b-514c-445a-9076-087d85e5f271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:43.624979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c0f9b-514c-445a-9076-087d85e5f271 admin admin] PATH_INFO: `/v3/users/0d97abfaaba04fd096a7174688774bb0` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:43.626139 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c0f9b-514c-445a-9076-087d85e5f271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d97abfaaba04fd096a7174688774bb0)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:43.628068 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c0f9b-514c-445a-9076-087d85e5f271 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:43.672534 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1e3c0f9b-514c-445a-9076-087d85e5f271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d97abfaaba04fd096a7174688774bb0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:43.673177 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1e3c0f9b-514c-445a-9076-087d85e5f271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d97abfaaba04fd096a7174688774bb0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:43.685168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1e3c0f9b-514c-445a-9076-087d85e5f271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d97abfaaba04fd096a7174688774bb0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:43.691537 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1e3c0f9b-514c-445a-9076-087d85e5f271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d97abfaaba04fd096a7174688774bb0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:43.692181 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1e3c0f9b-514c-445a-9076-087d85e5f271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d97abfaaba04fd096a7174688774bb0'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:43.704358 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1417/2841] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:43 2022] DELETE /identity/v3/users/0d97abfaaba04fd096a7174688774bb0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:43.708956 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba3a64-6d3b-4b34-8afd-727921c09d04 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:43.709454 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba3a64-6d3b-4b34-8afd-727921c09d04 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:43.709587 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba3a64-6d3b-4b34-8afd-727921c09d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:43.727113 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7eba3a64-6d3b-4b34-8afd-727921c09d04 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:43.728444 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7eba3a64-6d3b-4b34-8afd-727921c09d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:43.785024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1425/2842] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:43.794628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c0f9b-514c-445a-9076-087d85e5f271 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:43.797024 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1e3c0f9b-514c-445a-9076-087d85e5f271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:43.856045 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c0f9b-514c-445a-9076-087d85e5f271 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:43.859747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b94ad-9e82-4001-b371-076255da7d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:43.860385 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b94ad-9e82-4001-b371-076255da7d69 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:43.860665 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b94ad-9e82-4001-b371-076255da7d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:43.860968 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b94ad-9e82-4001-b371-076255da7d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:43.870452 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b94ad-9e82-4001-b371-076255da7d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:43.871902 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b94ad-9e82-4001-b371-076255da7d69 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:43.881608 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1418/2843] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:44.144680 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba3a64-6d3b-4b34-8afd-727921c09d04 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:44.146141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7eba3a64-6d3b-4b34-8afd-727921c09d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:44.159291 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba3a64-6d3b-4b34-8afd-727921c09d04 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:44.164318 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1f7e3-e1cd-4e79-86f3-b0c6b299c444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:44.165188 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1f7e3-e1cd-4e79-86f3-b0c6b299c444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:44.165507 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1f7e3-e1cd-4e79-86f3-b0c6b299c444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:44.166328 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1f7e3-e1cd-4e79-86f3-b0c6b299c444 admin admin] PATH_INFO: `/v3/projects/de1048d537bb4d88909acd59cba08bc8` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:44.167674 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1f7e3-e1cd-4e79-86f3-b0c6b299c444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de1048d537bb4d88909acd59cba08bc8)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:44.169640 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1f7e3-e1cd-4e79-86f3-b0c6b299c444 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:44.215220 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-53d1f7e3-e1cd-4e79-86f3-b0c6b299c444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de1048d537bb4d88909acd59cba08bc8', 'request_id': 'req-53d1f7e3-e1cd-4e79-86f3-b0c6b299c444'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:44.220485 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-53d1f7e3-e1cd-4e79-86f3-b0c6b299c444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de1048d537bb4d88909acd59cba08bc8', 'request_id': 'req-53d1f7e3-e1cd-4e79-86f3-b0c6b299c444'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:44.227554 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-53d1f7e3-e1cd-4e79-86f3-b0c6b299c444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de1048d537bb4d88909acd59cba08bc8', 'request_id': 'req-53d1f7e3-e1cd-4e79-86f3-b0c6b299c444'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:44.238991 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-53d1f7e3-e1cd-4e79-86f3-b0c6b299c444 admin admin] The token cache is being invalidate because project de1048d537bb4d88909acd59cba08bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:44.239286 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-53d1f7e3-e1cd-4e79-86f3-b0c6b299c444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:44.239948 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-53d1f7e3-e1cd-4e79-86f3-b0c6b299c444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:44.241474 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1426/2844] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:44 2022] DELETE /identity/v3/projects/de1048d537bb4d88909acd59cba08bc8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:44.246849 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a0c3e-3978-4661-ba15-bf091bf0a541 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:44.247138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a0c3e-3978-4661-ba15-bf091bf0a541 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:44.247414 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a0c3e-3978-4661-ba15-bf091bf0a541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:44.265043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-c64a0c3e-3978-4661-ba15-bf091bf0a541 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:44.266230 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-c64a0c3e-3978-4661-ba15-bf091bf0a541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:44.324128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1419/2845] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:44.332222 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f029ac-4532-4a3c-aaf8-88d352a2d516 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:44.332509 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f029ac-4532-4a3c-aaf8-88d352a2d516 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:44.332781 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f029ac-4532-4a3c-aaf8-88d352a2d516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:44.351206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-72f029ac-4532-4a3c-aaf8-88d352a2d516 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:44.352430 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-72f029ac-4532-4a3c-aaf8-88d352a2d516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:44.360213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1427/2846] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:44.364187 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a0c3e-3978-4661-ba15-bf091bf0a541 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:44.374138 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a0c3e-3978-4661-ba15-bf091bf0a541 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:44.379155 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ac0dd-3d1c-4da0-b3ec-24d9671cef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:44.379838 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ac0dd-3d1c-4da0-b3ec-24d9671cef13 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:44.380123 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ac0dd-3d1c-4da0-b3ec-24d9671cef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:44.380399 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ac0dd-3d1c-4da0-b3ec-24d9671cef13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:44.381116 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ac0dd-3d1c-4da0-b3ec-24d9671cef13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80070) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:18:44.381422 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ac0dd-3d1c-4da0-b3ec-24d9671cef13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:44.383012 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ac0dd-3d1c-4da0-b3ec-24d9671cef13 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:44.395066 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1420/2847] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 17:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:18:44.399562 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f029ac-4532-4a3c-aaf8-88d352a2d516 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:44.409724 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f029ac-4532-4a3c-aaf8-88d352a2d516 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:44.414216 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9549a8-ef79-45c2-a1ea-34d3b7a4093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:44.414852 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9549a8-ef79-45c2-a1ea-34d3b7a4093e admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:44.415133 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9549a8-ef79-45c2-a1ea-34d3b7a4093e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:44.415455 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9549a8-ef79-45c2-a1ea-34d3b7a4093e admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:44.416384 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9549a8-ef79-45c2-a1ea-34d3b7a4093e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:44.418274 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9549a8-ef79-45c2-a1ea-34d3b7a4093e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:44.443041 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1428/2848] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 17:18:44 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:44.447859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ac0dd-3d1c-4da0-b3ec-24d9671cef13 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:44.457711 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ac0dd-3d1c-4da0-b3ec-24d9671cef13 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:44.512284 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a8963-ae38-46ba-bfc8-f97865dc7906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:44.512939 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a8963-ae38-46ba-bfc8-f97865dc7906 admin admin] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:44.513225 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a8963-ae38-46ba-bfc8-f97865dc7906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:44.513494 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a8963-ae38-46ba-bfc8-f97865dc7906 admin admin] PATH_INFO: `/v3/users` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:44.514171 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a8963-ae38-46ba-bfc8-f97865dc7906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:44.516098 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a8963-ae38-46ba-bfc8-f97865dc7906 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:44.535758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1421/2849] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 17:18:44 2022] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:18:44.539861 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9549a8-ef79-45c2-a1ea-34d3b7a4093e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:44.550148 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9549a8-ef79-45c2-a1ea-34d3b7a4093e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:44.554672 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a590ea-1e6d-49bc-9d92-2005f2c0aa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:44.555324 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a590ea-1e6d-49bc-9d92-2005f2c0aa1c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:44.555631 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a590ea-1e6d-49bc-9d92-2005f2c0aa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:44.555912 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a590ea-1e6d-49bc-9d92-2005f2c0aa1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:44.557354 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a590ea-1e6d-49bc-9d92-2005f2c0aa1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:44.558955 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a590ea-1e6d-49bc-9d92-2005f2c0aa1c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:44.569069 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1429/2850] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 17:18:44.573515 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a8963-ae38-46ba-bfc8-f97865dc7906 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:44.583249 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a8963-ae38-46ba-bfc8-f97865dc7906 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:44.587974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494c2cb-1923-4acc-9d23-0a4ff503aee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:44.588642 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494c2cb-1923-4acc-9d23-0a4ff503aee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:44.588925 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494c2cb-1923-4acc-9d23-0a4ff503aee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:44.589206 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494c2cb-1923-4acc-9d23-0a4ff503aee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:44.589928 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494c2cb-1923-4acc-9d23-0a4ff503aee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:44.591480 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494c2cb-1923-4acc-9d23-0a4ff503aee1 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:44.601127 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1422/2851] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 17:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 17:18:44.605282 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a590ea-1e6d-49bc-9d92-2005f2c0aa1c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:44.614825 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a590ea-1e6d-49bc-9d92-2005f2c0aa1c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:44.619962 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810e72-761c-44b3-8db3-daca1790c21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:44.620823 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810e72-761c-44b3-8db3-daca1790c21f admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:44.621100 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810e72-761c-44b3-8db3-daca1790c21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:44.621373 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810e72-761c-44b3-8db3-daca1790c21f admin admin] PATH_INFO: `/v3/projects/795d2a46943f4e00a3c768507f8db459/users/7bfcb8c99e9f4854bfa71d2f13600025/roles/e613911293e3458c975cbab36cae354d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:44.636647 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee810e72-761c-44b3-8db3-daca1790c21f admin admin] RBAC: Authorizing `identity:create_grant(project_id=795d2a46943f4e00a3c768507f8db459, user_id=7bfcb8c99e9f4854bfa71d2f13600025, role_id=e613911293e3458c975cbab36cae354d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:44.639293 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee810e72-761c-44b3-8db3-daca1790c21f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:44.652110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1430/2852] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 17:18:44 2022] PUT /identity/v3/projects/795d2a46943f4e00a3c768507f8db459/users/7bfcb8c99e9f4854bfa71d2f13600025/roles/e613911293e3458c975cbab36cae354d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:44.715329 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1524913-7df1-4cd3-a64e-d0a307d627fb None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:44.715651 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1524913-7df1-4cd3-a64e-d0a307d627fb None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:44.716087 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1524913-7df1-4cd3-a64e-d0a307d627fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:44.741833 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-a1524913-7df1-4cd3-a64e-d0a307d627fb None None] MFA Rules not processed for user `7bfcb8c99e9f4854bfa71d2f13600025`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:44.743050 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a1524913-7df1-4cd3-a64e-d0a307d627fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:44.804553 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1423/2853] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:18:44.815947 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810e72-761c-44b3-8db3-daca1790c21f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:44.817585 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ee810e72-761c-44b3-8db3-daca1790c21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:44.873302 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810e72-761c-44b3-8db3-daca1790c21f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:44.877037 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dae69-3da6-4b38-bee1-70c3bf117622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:44.877682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dae69-3da6-4b38-bee1-70c3bf117622 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:44.877961 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dae69-3da6-4b38-bee1-70c3bf117622 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:44.878235 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dae69-3da6-4b38-bee1-70c3bf117622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:44.886518 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3dae69-3da6-4b38-bee1-70c3bf117622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:44.887972 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3dae69-3da6-4b38-bee1-70c3bf117622 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:44.896618 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1431/2854] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:49.426168 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1524913-7df1-4cd3-a64e-d0a307d627fb None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:49.427592 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a1524913-7df1-4cd3-a64e-d0a307d627fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:49.490838 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1524913-7df1-4cd3-a64e-d0a307d627fb None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:49.495552 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4775b51-0440-4f77-b579-5ef4f32716c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:49.496447 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4775b51-0440-4f77-b579-5ef4f32716c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:49.496759 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4775b51-0440-4f77-b579-5ef4f32716c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:49.497038 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4775b51-0440-4f77-b579-5ef4f32716c7 admin admin] PATH_INFO: `/v3/users/6f7ff5347a504b519e7716bdcf6e44db` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:49.498275 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4775b51-0440-4f77-b579-5ef4f32716c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7ff5347a504b519e7716bdcf6e44db)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:49.500304 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4775b51-0440-4f77-b579-5ef4f32716c7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:49.548111 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b4775b51-0440-4f77-b579-5ef4f32716c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7ff5347a504b519e7716bdcf6e44db'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:49.548902 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b4775b51-0440-4f77-b579-5ef4f32716c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7ff5347a504b519e7716bdcf6e44db'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:49.560594 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b4775b51-0440-4f77-b579-5ef4f32716c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7ff5347a504b519e7716bdcf6e44db'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:49.567435 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b4775b51-0440-4f77-b579-5ef4f32716c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7ff5347a504b519e7716bdcf6e44db'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:49.568193 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-b4775b51-0440-4f77-b579-5ef4f32716c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7ff5347a504b519e7716bdcf6e44db'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:49.582408 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1424/2855] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:18:49 2022] DELETE /identity/v3/users/6f7ff5347a504b519e7716bdcf6e44db => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:18:49.586872 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39990636-1644-4b5e-bdbb-4b4cac379347 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:49.588255 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39990636-1644-4b5e-bdbb-4b4cac379347 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:49.588255 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39990636-1644-4b5e-bdbb-4b4cac379347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:49.608710 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-39990636-1644-4b5e-bdbb-4b4cac379347 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:18:49.610145 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-39990636-1644-4b5e-bdbb-4b4cac379347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:49.690094 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1432/2856] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:18:49.704475 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4775b51-0440-4f77-b579-5ef4f32716c7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:49.706137 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-b4775b51-0440-4f77-b579-5ef4f32716c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:49.765173 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4775b51-0440-4f77-b579-5ef4f32716c7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:49.768902 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c13d47-2f0d-410e-a365-4337fcf70bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:49.769568 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c13d47-2f0d-410e-a365-4337fcf70bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:49.769853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c13d47-2f0d-410e-a365-4337fcf70bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:49.770129 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c13d47-2f0d-410e-a365-4337fcf70bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:49.779889 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c13d47-2f0d-410e-a365-4337fcf70bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:49.781332 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c13d47-2f0d-410e-a365-4337fcf70bf3 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:49.790809 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1425/2857] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:18:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:18:50.060755 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39990636-1644-4b5e-bdbb-4b4cac379347 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:18:50.062175 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-39990636-1644-4b5e-bdbb-4b4cac379347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:18:50.076010 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39990636-1644-4b5e-bdbb-4b4cac379347 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:18:50.080757 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426ec3f-bea5-4ba4-9ed2-591dacfa00a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:18:50.081624 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ec3f-bea5-4ba4-9ed2-591dacfa00a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:18:50.081909 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ec3f-bea5-4ba4-9ed2-591dacfa00a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:18:50.082178 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ec3f-bea5-4ba4-9ed2-591dacfa00a8 admin admin] PATH_INFO: `/v3/projects/141ccb11a3e9417a8684a1b14109db45` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:18:50.084052 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426ec3f-bea5-4ba4-9ed2-591dacfa00a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=141ccb11a3e9417a8684a1b14109db45)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:18:50.086136 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426ec3f-bea5-4ba4-9ed2-591dacfa00a8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:18:50.138311 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f426ec3f-bea5-4ba4-9ed2-591dacfa00a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141ccb11a3e9417a8684a1b14109db45', 'request_id': 'req-f426ec3f-bea5-4ba4-9ed2-591dacfa00a8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:50.143451 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f426ec3f-bea5-4ba4-9ed2-591dacfa00a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141ccb11a3e9417a8684a1b14109db45', 'request_id': 'req-f426ec3f-bea5-4ba4-9ed2-591dacfa00a8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:50.150300 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f426ec3f-bea5-4ba4-9ed2-591dacfa00a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141ccb11a3e9417a8684a1b14109db45', 'request_id': 'req-f426ec3f-bea5-4ba4-9ed2-591dacfa00a8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:50.161012 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f426ec3f-bea5-4ba4-9ed2-591dacfa00a8 admin admin] The token cache is being invalidate because project 141ccb11a3e9417a8684a1b14109db45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:18:50.161294 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f426ec3f-bea5-4ba4-9ed2-591dacfa00a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:50.161942 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f426ec3f-bea5-4ba4-9ed2-591dacfa00a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:18:50.163503 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1433/2858] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:18:50 2022] DELETE /identity/v3/projects/141ccb11a3e9417a8684a1b14109db45 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:19:01.057430 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c13d47-2f0d-410e-a365-4337fcf70bf3 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:19:01.058846 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-28c13d47-2f0d-410e-a365-4337fcf70bf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:19:01.071518 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c13d47-2f0d-410e-a365-4337fcf70bf3 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:19:01.126566 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1af73-bf7e-4ffb-befe-4efed90d91e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:19:01.127366 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1af73-bf7e-4ffb-befe-4efed90d91e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:19:01.127680 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1af73-bf7e-4ffb-befe-4efed90d91e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:19:01.127958 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1af73-bf7e-4ffb-befe-4efed90d91e7 admin admin] PATH_INFO: `/v3/users/7bfcb8c99e9f4854bfa71d2f13600025` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:19:01.129257 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1af73-bf7e-4ffb-befe-4efed90d91e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bfcb8c99e9f4854bfa71d2f13600025)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:19:01.131178 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1af73-bf7e-4ffb-befe-4efed90d91e7 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:19:01.175827 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-89e1af73-bf7e-4ffb-befe-4efed90d91e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bfcb8c99e9f4854bfa71d2f13600025'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:01.176664 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-89e1af73-bf7e-4ffb-befe-4efed90d91e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bfcb8c99e9f4854bfa71d2f13600025'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:01.187902 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-89e1af73-bf7e-4ffb-befe-4efed90d91e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bfcb8c99e9f4854bfa71d2f13600025'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:01.194541 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-89e1af73-bf7e-4ffb-befe-4efed90d91e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bfcb8c99e9f4854bfa71d2f13600025'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:01.195203 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-89e1af73-bf7e-4ffb-befe-4efed90d91e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bfcb8c99e9f4854bfa71d2f13600025'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:01.208043 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1426/2859] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:19:01 2022] DELETE /identity/v3/users/7bfcb8c99e9f4854bfa71d2f13600025 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:19:01.212681 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d825d4-201c-40ff-b099-d5a3bcdf9d77 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:19:01.213170 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d825d4-201c-40ff-b099-d5a3bcdf9d77 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:19:01.213269 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d825d4-201c-40ff-b099-d5a3bcdf9d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:19:01.230753 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b2d825d4-201c-40ff-b099-d5a3bcdf9d77 None None] MFA Rules not processed for user `f95fdce949f547f29f3329fa96fe74ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:19:01.233000 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b2d825d4-201c-40ff-b099-d5a3bcdf9d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:19:01.290790 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1434/2860] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 17:19:01.300954 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1af73-bf7e-4ffb-befe-4efed90d91e7 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:19:01.302400 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-89e1af73-bf7e-4ffb-befe-4efed90d91e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:19:01.356683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1af73-bf7e-4ffb-befe-4efed90d91e7 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:19:01.361025 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0fd1a-ffb8-4752-bea2-ad9c01c08897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:19:01.361699 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0fd1a-ffb8-4752-bea2-ad9c01c08897 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:19:01.361976 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0fd1a-ffb8-4752-bea2-ad9c01c08897 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:19:01.362276 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0fd1a-ffb8-4752-bea2-ad9c01c08897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:19:01.371133 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0fd1a-ffb8-4752-bea2-ad9c01c08897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:19:01.373235 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0fd1a-ffb8-4752-bea2-ad9c01c08897 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:19:01.383212 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1427/2861] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:19:01.736581 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d825d4-201c-40ff-b099-d5a3bcdf9d77 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:19:01.737999 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b2d825d4-201c-40ff-b099-d5a3bcdf9d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:19:01.752048 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d825d4-201c-40ff-b099-d5a3bcdf9d77 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:19:01.756905 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5e310-e225-4c2c-a57e-966052f12fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:19:01.757767 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5e310-e225-4c2c-a57e-966052f12fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:19:01.758045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5e310-e225-4c2c-a57e-966052f12fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:19:01.758344 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5e310-e225-4c2c-a57e-966052f12fd4 admin admin] PATH_INFO: `/v3/projects/795d2a46943f4e00a3c768507f8db459` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:19:01.759516 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5e310-e225-4c2c-a57e-966052f12fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=795d2a46943f4e00a3c768507f8db459)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:19:01.761460 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5e310-e225-4c2c-a57e-966052f12fd4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:19:01.810173 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-72f5e310-e225-4c2c-a57e-966052f12fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '795d2a46943f4e00a3c768507f8db459', 'request_id': 'req-72f5e310-e225-4c2c-a57e-966052f12fd4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:01.815532 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-72f5e310-e225-4c2c-a57e-966052f12fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '795d2a46943f4e00a3c768507f8db459', 'request_id': 'req-72f5e310-e225-4c2c-a57e-966052f12fd4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:01.822682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-72f5e310-e225-4c2c-a57e-966052f12fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '795d2a46943f4e00a3c768507f8db459', 'request_id': 'req-72f5e310-e225-4c2c-a57e-966052f12fd4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:01.833472 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-72f5e310-e225-4c2c-a57e-966052f12fd4 admin admin] The token cache is being invalidate because project 795d2a46943f4e00a3c768507f8db459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:19:01.833763 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-72f5e310-e225-4c2c-a57e-966052f12fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:01.834397 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-72f5e310-e225-4c2c-a57e-966052f12fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:01.836107 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1435/2862] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:19:01 2022] DELETE /identity/v3/projects/795d2a46943f4e00a3c768507f8db459 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:19:24.221513 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0fd1a-ffb8-4752-bea2-ad9c01c08897 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:19:24.222911 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e9f0fd1a-ffb8-4752-bea2-ad9c01c08897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:19:24.291317 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0fd1a-ffb8-4752-bea2-ad9c01c08897 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:19:24.350151 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53780-5544-4c90-b1de-d9b20687ff67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7730d6cad2ba40c19cb671268cf04d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:19:24.350716 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53780-5544-4c90-b1de-d9b20687ff67 service placement] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:19:24.351001 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53780-5544-4c90-b1de-d9b20687ff67 service placement] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:19:24.351281 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53780-5544-4c90-b1de-d9b20687ff67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:19:24.353088 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-46a53780-5544-4c90-b1de-d9b20687ff67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:19:24.364153 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a53780-5544-4c90-b1de-d9b20687ff67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:19:24.366418 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a53780-5544-4c90-b1de-d9b20687ff67 service placement] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:19:24.376706 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1428/2863] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:19:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:19:38.101508 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5e310-e225-4c2c-a57e-966052f12fd4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:19:38.102898 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-72f5e310-e225-4c2c-a57e-966052f12fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:19:38.158370 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5e310-e225-4c2c-a57e-966052f12fd4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:19:38.162548 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01a59a-fd40-43ab-8ba8-e6b3ea09591c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e0aa0cdd8544ca9e16d1af3bff411f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:19:38.163186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01a59a-fd40-43ab-8ba8-e6b3ea09591c service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:19:38.163461 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01a59a-fd40-43ab-8ba8-e6b3ea09591c service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:19:38.163765 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01a59a-fd40-43ab-8ba8-e6b3ea09591c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:19:38.165502 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6c01a59a-fd40-43ab-8ba8-e6b3ea09591c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:19:38.221068 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01a59a-fd40-43ab-8ba8-e6b3ea09591c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:19:38.222501 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01a59a-fd40-43ab-8ba8-e6b3ea09591c service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:19:38.232024 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1436/2864] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:19:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:19:42.848747 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c137f-00a3-4c92-88da-706c49432605 None None] REQUEST_METHOD: `POST` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:19:42.849476 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c137f-00a3-4c92-88da-706c49432605 None None] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:19:42.849683 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c137f-00a3-4c92-88da-706c49432605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:19:42.867049 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.auth.core [None req-3d2c137f-00a3-4c92-88da-706c49432605 None None] MFA Rules not processed for user `38bdb5f8e08e49358f9f27e4f1ce167b`. Rule list: `[]` (Enabled: `True`). {{(pid=80070) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:19:42.868295 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3d2c137f-00a3-4c92-88da-706c49432605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:19:42.876071 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1429/2865] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 17:19:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:19:47.909981 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084bb10-bb30-41b3-8a26-c9abdd8108c8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:19:47.910475 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084bb10-bb30-41b3-8a26-c9abdd8108c8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:19:47.910589 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084bb10-bb30-41b3-8a26-c9abdd8108c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:19:47.928627 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9084bb10-bb30-41b3-8a26-c9abdd8108c8 None None] MFA Rules not processed for user `c0b16bc0880a4e12879ebb512ebb848b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:19:47.929753 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9084bb10-bb30-41b3-8a26-c9abdd8108c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:19:47.985682 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1437/2866] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 17 17:19:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 17:19:48.028669 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c137f-00a3-4c92-88da-706c49432605 None None] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:19:48.030063 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-3d2c137f-00a3-4c92-88da-706c49432605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:19:48.103539 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c137f-00a3-4c92-88da-706c49432605 None None] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:19:48.108602 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e1fbe-2d87-476a-86f8-19993fc6ddbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87aba3662244bea0428475bb0c9e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:19:48.109261 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e1fbe-2d87-476a-86f8-19993fc6ddbe service swift] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:19:48.109538 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e1fbe-2d87-476a-86f8-19993fc6ddbe service swift] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:19:48.109807 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e1fbe-2d87-476a-86f8-19993fc6ddbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:19:48.118061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e1fbe-2d87-476a-86f8-19993fc6ddbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:19:48.119694 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e1fbe-2d87-476a-86f8-19993fc6ddbe service swift] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:19:48.127536 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1430/2867] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 17:19:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:19:54.959574 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084bb10-bb30-41b3-8a26-c9abdd8108c8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:19:54.961107 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9084bb10-bb30-41b3-8a26-c9abdd8108c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:19:55.033110 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084bb10-bb30-41b3-8a26-c9abdd8108c8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:19:55.041271 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448412c8-b300-4138-a659-dbf3798b6fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:19:55.043286 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448412c8-b300-4138-a659-dbf3798b6fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:19:55.043286 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448412c8-b300-4138-a659-dbf3798b6fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:19:55.043286 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448412c8-b300-4138-a659-dbf3798b6fe9 admin admin] PATH_INFO: `/v3/users/b62f5ec1700d4a86aab654c9f2eb0201` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:19:55.044008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448412c8-b300-4138-a659-dbf3798b6fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62f5ec1700d4a86aab654c9f2eb0201)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:19:55.046008 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448412c8-b300-4138-a659-dbf3798b6fe9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:19:55.091754 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-448412c8-b300-4138-a659-dbf3798b6fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62f5ec1700d4a86aab654c9f2eb0201'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.104190 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-448412c8-b300-4138-a659-dbf3798b6fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62f5ec1700d4a86aab654c9f2eb0201'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.111101 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-448412c8-b300-4138-a659-dbf3798b6fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62f5ec1700d4a86aab654c9f2eb0201'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.111831 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-448412c8-b300-4138-a659-dbf3798b6fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62f5ec1700d4a86aab654c9f2eb0201'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.112425 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-448412c8-b300-4138-a659-dbf3798b6fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62f5ec1700d4a86aab654c9f2eb0201'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.124825 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1438/2868] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:19:54 2022] DELETE /identity/v3/users/b62f5ec1700d4a86aab654c9f2eb0201 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:19:55.296609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e1fbe-2d87-476a-86f8-19993fc6ddbe service swift] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:19:55.308078 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e1fbe-2d87-476a-86f8-19993fc6ddbe service swift] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:19:55.362368 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5114ad3-12d7-4832-a898-009d1457eb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:19:55.363224 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5114ad3-12d7-4832-a898-009d1457eb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:19:55.363531 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5114ad3-12d7-4832-a898-009d1457eb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:19:55.363837 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5114ad3-12d7-4832-a898-009d1457eb29 admin admin] PATH_INFO: `/v3/projects/21c32c98238c44e7a3581a668e1a5ea3` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:19:55.365079 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5114ad3-12d7-4832-a898-009d1457eb29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c32c98238c44e7a3581a668e1a5ea3)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:19:55.366953 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5114ad3-12d7-4832-a898-009d1457eb29 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:19:55.412340 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e5114ad3-12d7-4832-a898-009d1457eb29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c32c98238c44e7a3581a668e1a5ea3', 'request_id': 'req-e5114ad3-12d7-4832-a898-009d1457eb29'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.417758 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e5114ad3-12d7-4832-a898-009d1457eb29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c32c98238c44e7a3581a668e1a5ea3', 'request_id': 'req-e5114ad3-12d7-4832-a898-009d1457eb29'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.425541 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e5114ad3-12d7-4832-a898-009d1457eb29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c32c98238c44e7a3581a668e1a5ea3', 'request_id': 'req-e5114ad3-12d7-4832-a898-009d1457eb29'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.437105 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e5114ad3-12d7-4832-a898-009d1457eb29 admin admin] The token cache is being invalidate because project 21c32c98238c44e7a3581a668e1a5ea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:19:55.437453 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e5114ad3-12d7-4832-a898-009d1457eb29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.438088 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-e5114ad3-12d7-4832-a898-009d1457eb29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.439872 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1431/2869] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:19:55 2022] DELETE /identity/v3/projects/21c32c98238c44e7a3581a668e1a5ea3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:19:55.444342 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448412c8-b300-4138-a659-dbf3798b6fe9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:19:55.445762 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-448412c8-b300-4138-a659-dbf3798b6fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:19:55.459266 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448412c8-b300-4138-a659-dbf3798b6fe9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:19:55.514686 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27105ff-032e-4cc6-94be-d72ee8492dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:19:55.515567 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27105ff-032e-4cc6-94be-d72ee8492dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:19:55.515934 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27105ff-032e-4cc6-94be-d72ee8492dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:19:55.516213 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27105ff-032e-4cc6-94be-d72ee8492dab admin admin] PATH_INFO: `/v3/users/a4a067e8b43e440f9349fc44d207549c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:19:55.517407 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27105ff-032e-4cc6-94be-d72ee8492dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a067e8b43e440f9349fc44d207549c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:19:55.519338 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27105ff-032e-4cc6-94be-d72ee8492dab admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:19:55.572773 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f27105ff-032e-4cc6-94be-d72ee8492dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a067e8b43e440f9349fc44d207549c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.587579 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f27105ff-032e-4cc6-94be-d72ee8492dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a067e8b43e440f9349fc44d207549c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.597210 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f27105ff-032e-4cc6-94be-d72ee8492dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a067e8b43e440f9349fc44d207549c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.597952 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f27105ff-032e-4cc6-94be-d72ee8492dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a067e8b43e440f9349fc44d207549c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.598750 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f27105ff-032e-4cc6-94be-d72ee8492dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a067e8b43e440f9349fc44d207549c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.613065 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1439/2870] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:19:55 2022] DELETE /identity/v3/users/a4a067e8b43e440f9349fc44d207549c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:19:55.791665 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5114ad3-12d7-4832-a898-009d1457eb29 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:19:55.793090 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-e5114ad3-12d7-4832-a898-009d1457eb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:19:55.810714 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5114ad3-12d7-4832-a898-009d1457eb29 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:19:55.877243 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca05456-f0dd-4eea-b4c6-65af1cc42839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:19:55.878326 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca05456-f0dd-4eea-b4c6-65af1cc42839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:19:55.878608 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca05456-f0dd-4eea-b4c6-65af1cc42839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:19:55.878882 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca05456-f0dd-4eea-b4c6-65af1cc42839 admin admin] PATH_INFO: `/v3/projects/36139a33d392483580afe4b25335bfc1` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:19:55.880306 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca05456-f0dd-4eea-b4c6-65af1cc42839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36139a33d392483580afe4b25335bfc1)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:19:55.882280 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca05456-f0dd-4eea-b4c6-65af1cc42839 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:19:55.934161 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1ca05456-f0dd-4eea-b4c6-65af1cc42839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36139a33d392483580afe4b25335bfc1', 'request_id': 'req-1ca05456-f0dd-4eea-b4c6-65af1cc42839'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.939503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1ca05456-f0dd-4eea-b4c6-65af1cc42839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36139a33d392483580afe4b25335bfc1', 'request_id': 'req-1ca05456-f0dd-4eea-b4c6-65af1cc42839'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.946994 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1ca05456-f0dd-4eea-b4c6-65af1cc42839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36139a33d392483580afe4b25335bfc1', 'request_id': 'req-1ca05456-f0dd-4eea-b4c6-65af1cc42839'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.959086 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1ca05456-f0dd-4eea-b4c6-65af1cc42839 admin admin] The token cache is being invalidate because project 36139a33d392483580afe4b25335bfc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80070) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:19:55.959374 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1ca05456-f0dd-4eea-b4c6-65af1cc42839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.960061 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-1ca05456-f0dd-4eea-b4c6-65af1cc42839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:19:55.962373 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1432/2871] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:19:55 2022] DELETE /identity/v3/projects/36139a33d392483580afe4b25335bfc1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:21:28.943226 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27105ff-032e-4cc6-94be-d72ee8492dab admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:21:28.944857 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f27105ff-032e-4cc6-94be-d72ee8492dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:21:29.001408 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27105ff-032e-4cc6-94be-d72ee8492dab admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:21:29.048061 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56113a2b-55a5-4434-85a9-540b5ffee449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:21:29.048711 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56113a2b-55a5-4434-85a9-540b5ffee449 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:21:29.048987 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56113a2b-55a5-4434-85a9-540b5ffee449 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:21:29.049258 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56113a2b-55a5-4434-85a9-540b5ffee449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:21:29.051045 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-56113a2b-55a5-4434-85a9-540b5ffee449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:21:29.061624 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56113a2b-55a5-4434-85a9-540b5ffee449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:21:29.062959 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56113a2b-55a5-4434-85a9-540b5ffee449 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:21:29.072769 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1440/2872] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:21:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:21:29.312953 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca05456-f0dd-4eea-b4c6-65af1cc42839 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:21:29.314780 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-1ca05456-f0dd-4eea-b4c6-65af1cc42839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:21:29.329458 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca05456-f0dd-4eea-b4c6-65af1cc42839 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:21:29.334274 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbe382-e2ab-46dd-bcd1-780d69c60dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:21:29.334941 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbe382-e2ab-46dd-bcd1-780d69c60dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:21:29.335228 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbe382-e2ab-46dd-bcd1-780d69c60dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:21:29.335509 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbe382-e2ab-46dd-bcd1-780d69c60dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:21:29.338064 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-90bbe382-e2ab-46dd-bcd1-780d69c60dd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:21:29.428170 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbe382-e2ab-46dd-bcd1-780d69c60dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:21:29.429628 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbe382-e2ab-46dd-bcd1-780d69c60dd9 service neutron] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:21:29.442337 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1433/2873] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:21:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:21:30.623698 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56113a2b-55a5-4434-85a9-540b5ffee449 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:21:30.632259 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56113a2b-55a5-4434-85a9-540b5ffee449 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:21:30.635693 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a48234-ab4b-4226-af85-f7192c0585a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:21:30.636321 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a48234-ab4b-4226-af85-f7192c0585a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:21:30.636600 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a48234-ab4b-4226-af85-f7192c0585a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:21:30.636978 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a48234-ab4b-4226-af85-f7192c0585a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:21:30.638968 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-59a48234-ab4b-4226-af85-f7192c0585a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:21:30.652817 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a48234-ab4b-4226-af85-f7192c0585a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:21:30.654839 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a48234-ab4b-4226-af85-f7192c0585a3 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:21:30.665492 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1441/2874] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:21:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:21:31.534013 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbe382-e2ab-46dd-bcd1-780d69c60dd9 service neutron] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:21:31.535926 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-90bbe382-e2ab-46dd-bcd1-780d69c60dd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:21:31.550907 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbe382-e2ab-46dd-bcd1-780d69c60dd9 service neutron] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:21:31.558009 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3801766-c3b0-4c9d-8a7c-56e86cb8be39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5becb135afbd43e9bc0b1347ba04e2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:21:31.558657 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3801766-c3b0-4c9d-8a7c-56e86cb8be39 service nova] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:21:31.558935 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3801766-c3b0-4c9d-8a7c-56e86cb8be39 service nova] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:21:31.559874 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3801766-c3b0-4c9d-8a7c-56e86cb8be39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:21:31.561824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a3801766-c3b0-4c9d-8a7c-56e86cb8be39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:21:31.574827 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3801766-c3b0-4c9d-8a7c-56e86cb8be39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:21:31.577272 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3801766-c3b0-4c9d-8a7c-56e86cb8be39 service nova] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:21:31.588761 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1434/2875] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:21:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:21:41.452575 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a48234-ab4b-4226-af85-f7192c0585a3 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:21:41.461357 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a48234-ab4b-4226-af85-f7192c0585a3 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:21:41.465141 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23e016-4367-4bc8-9bc6-b730f23bebef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819e022286b454e9e2f23d975c6e921', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:21:41.465770 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23e016-4367-4bc8-9bc6-b730f23bebef service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:21:41.466047 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23e016-4367-4bc8-9bc6-b730f23bebef service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:21:41.466320 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23e016-4367-4bc8-9bc6-b730f23bebef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:21:41.468135 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cc23e016-4367-4bc8-9bc6-b730f23bebef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:21:41.531886 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23e016-4367-4bc8-9bc6-b730f23bebef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:21:41.533429 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23e016-4367-4bc8-9bc6-b730f23bebef service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:21:41.543864 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1442/2876] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 17:21:47.618030 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3801766-c3b0-4c9d-8a7c-56e86cb8be39 service nova] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:21:47.619503 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-a3801766-c3b0-4c9d-8a7c-56e86cb8be39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:21:47.638862 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3801766-c3b0-4c9d-8a7c-56e86cb8be39 service nova] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:21:47.644039 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a1f9e-3daa-4c30-8981-9f3a1c583b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:21:47.644933 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a1f9e-3daa-4c30-8981-9f3a1c583b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:21:47.645226 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a1f9e-3daa-4c30-8981-9f3a1c583b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:21:47.645572 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a1f9e-3daa-4c30-8981-9f3a1c583b24 admin admin] PATH_INFO: `/v3/users/38bdb5f8e08e49358f9f27e4f1ce167b` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:21:47.646825 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a1f9e-3daa-4c30-8981-9f3a1c583b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38bdb5f8e08e49358f9f27e4f1ce167b)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:21:47.648789 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a1f9e-3daa-4c30-8981-9f3a1c583b24 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:21:47.706974 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ce1a1f9e-3daa-4c30-8981-9f3a1c583b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38bdb5f8e08e49358f9f27e4f1ce167b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:47.707638 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ce1a1f9e-3daa-4c30-8981-9f3a1c583b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38bdb5f8e08e49358f9f27e4f1ce167b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:47.719541 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ce1a1f9e-3daa-4c30-8981-9f3a1c583b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38bdb5f8e08e49358f9f27e4f1ce167b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:47.725947 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ce1a1f9e-3daa-4c30-8981-9f3a1c583b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38bdb5f8e08e49358f9f27e4f1ce167b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:47.726609 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ce1a1f9e-3daa-4c30-8981-9f3a1c583b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38bdb5f8e08e49358f9f27e4f1ce167b'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:47.742631 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1435/2877] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:21:47 2022] DELETE /identity/v3/users/38bdb5f8e08e49358f9f27e4f1ce167b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:21:47.916026 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23e016-4367-4bc8-9bc6-b730f23bebef service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:21:47.926275 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23e016-4367-4bc8-9bc6-b730f23bebef service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:21:47.991459 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32914e3a-234f-4ccf-a2c6-2980148089c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:21:47.992361 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32914e3a-234f-4ccf-a2c6-2980148089c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:21:47.992646 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32914e3a-234f-4ccf-a2c6-2980148089c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:21:47.992923 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32914e3a-234f-4ccf-a2c6-2980148089c2 admin admin] PATH_INFO: `/v3/projects/b1528992e3c74c08b5c4192466f23852` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:21:47.994102 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32914e3a-234f-4ccf-a2c6-2980148089c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1528992e3c74c08b5c4192466f23852)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:21:47.996075 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32914e3a-234f-4ccf-a2c6-2980148089c2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:21:48.040953 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32914e3a-234f-4ccf-a2c6-2980148089c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1528992e3c74c08b5c4192466f23852', 'request_id': 'req-32914e3a-234f-4ccf-a2c6-2980148089c2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:48.046199 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32914e3a-234f-4ccf-a2c6-2980148089c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1528992e3c74c08b5c4192466f23852', 'request_id': 'req-32914e3a-234f-4ccf-a2c6-2980148089c2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:48.052939 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32914e3a-234f-4ccf-a2c6-2980148089c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1528992e3c74c08b5c4192466f23852', 'request_id': 'req-32914e3a-234f-4ccf-a2c6-2980148089c2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:48.064299 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32914e3a-234f-4ccf-a2c6-2980148089c2 admin admin] The token cache is being invalidate because project b1528992e3c74c08b5c4192466f23852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:21:48.064599 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32914e3a-234f-4ccf-a2c6-2980148089c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:48.065206 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32914e3a-234f-4ccf-a2c6-2980148089c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:48.066719 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1443/2878] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:21:47 2022] DELETE /identity/v3/projects/b1528992e3c74c08b5c4192466f23852 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:21:48.070859 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a1f9e-3daa-4c30-8981-9f3a1c583b24 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:21:48.072285 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ce1a1f9e-3daa-4c30-8981-9f3a1c583b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:21:48.085979 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a1f9e-3daa-4c30-8981-9f3a1c583b24 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:21:48.142021 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff798ba0-e018-4fa9-a802-e45c827d1391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:21:48.142931 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798ba0-e018-4fa9-a802-e45c827d1391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:21:48.143469 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798ba0-e018-4fa9-a802-e45c827d1391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:21:48.143791 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798ba0-e018-4fa9-a802-e45c827d1391 admin admin] PATH_INFO: `/v3/users/1165d9b18b9e4778ac09458948a2488c` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:21:48.144978 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff798ba0-e018-4fa9-a802-e45c827d1391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1165d9b18b9e4778ac09458948a2488c)` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:21:48.146909 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff798ba0-e018-4fa9-a802-e45c827d1391 admin admin] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:21:48.190896 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ff798ba0-e018-4fa9-a802-e45c827d1391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1165d9b18b9e4778ac09458948a2488c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:48.191468 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ff798ba0-e018-4fa9-a802-e45c827d1391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1165d9b18b9e4778ac09458948a2488c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:48.203686 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ff798ba0-e018-4fa9-a802-e45c827d1391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1165d9b18b9e4778ac09458948a2488c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:48.210356 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ff798ba0-e018-4fa9-a802-e45c827d1391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1165d9b18b9e4778ac09458948a2488c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:48.211027 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.notifications [None req-ff798ba0-e018-4fa9-a802-e45c827d1391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1165d9b18b9e4778ac09458948a2488c'} {{(pid=80070) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:48.223128 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1436/2879] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 17:21:48 2022] DELETE /identity/v3/users/1165d9b18b9e4778ac09458948a2488c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:21:48.393772 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32914e3a-234f-4ccf-a2c6-2980148089c2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:21:48.395186 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-32914e3a-234f-4ccf-a2c6-2980148089c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:21:48.408090 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32914e3a-234f-4ccf-a2c6-2980148089c2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:21:48.463641 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db610e7-cce5-407a-82af-e0628aff5430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f95fdce949f547f29f3329fa96fe74ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a3ee3f323ac4b12815e2057e52b4ed6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:21:48.464429 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db610e7-cce5-407a-82af-e0628aff5430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:21:48.464706 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db610e7-cce5-407a-82af-e0628aff5430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:21:48.464976 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db610e7-cce5-407a-82af-e0628aff5430 admin admin] PATH_INFO: `/v3/projects/7e342982d1b8446ebd34d3ec75b0ca09` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:21:48.466149 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db610e7-cce5-407a-82af-e0628aff5430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e342982d1b8446ebd34d3ec75b0ca09)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:21:48.468099 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db610e7-cce5-407a-82af-e0628aff5430 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:21:48.511768 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3db610e7-cce5-407a-82af-e0628aff5430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e342982d1b8446ebd34d3ec75b0ca09', 'request_id': 'req-3db610e7-cce5-407a-82af-e0628aff5430'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:48.517163 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3db610e7-cce5-407a-82af-e0628aff5430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e342982d1b8446ebd34d3ec75b0ca09', 'request_id': 'req-3db610e7-cce5-407a-82af-e0628aff5430'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:48.524885 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3db610e7-cce5-407a-82af-e0628aff5430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e342982d1b8446ebd34d3ec75b0ca09', 'request_id': 'req-3db610e7-cce5-407a-82af-e0628aff5430'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:48.535452 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3db610e7-cce5-407a-82af-e0628aff5430 admin admin] The token cache is being invalidate because project 7e342982d1b8446ebd34d3ec75b0ca09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 17:21:48.535841 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3db610e7-cce5-407a-82af-e0628aff5430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:48.536458 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3db610e7-cce5-407a-82af-e0628aff5430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 17:21:48.537977 dv-cinder-842149-1-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1444/2880] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 17:21:48 2022] DELETE /identity/v3/projects/7e342982d1b8446ebd34d3ec75b0ca09 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:24:31.154620 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff798ba0-e018-4fa9-a802-e45c827d1391 admin admin] Authenticating user token {{(pid=80070) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:24:31.156055 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-ff798ba0-e018-4fa9-a802-e45c827d1391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:24:31.287824 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff798ba0-e018-4fa9-a802-e45c827d1391 admin admin] Validating token access rules against request {{(pid=80070) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:24:31.344873 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345d77f-86ed-4b9f-adf7-b200dadef8de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7730d6cad2ba40c19cb671268cf04d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b356e72cf84d099f2ce8678103ecef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80070) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:24:31.345517 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345d77f-86ed-4b9f-adf7-b200dadef8de service placement] REQUEST_METHOD: `GET` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:24:31.345799 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345d77f-86ed-4b9f-adf7-b200dadef8de service placement] SCRIPT_NAME: `/identity` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:24:31.346075 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345d77f-86ed-4b9f-adf7-b200dadef8de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80070) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:24:31.347853 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.fernet_utils [None req-6345d77f-86ed-4b9f-adf7-b200dadef8de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80070) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:24:31.358783 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345d77f-86ed-4b9f-adf7-b200dadef8de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:24:31.360888 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345d77f-86ed-4b9f-adf7-b200dadef8de service placement] RBAC: Authorization granted {{(pid=80070) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:24:31.370484 dv-cinder-842149-1-iscsi devstack@keystone.service[80070]: [pid: 80070|app: 0|req: 1437/2881] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 17:24:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)